2023-03-27T09:51:52.612 INFO:root:teuthology version: 0.0.1.dev1+ge372916 2023-03-27T09:51:52.613 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221298 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221298/orig.config.yaml 2023-03-27T09:51:52.659 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-27T09:51:52.745 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221298 branch: wip-rishabh-cephman-6 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7221298' kernel: client: branch: testing flavor: default kdb: true sha1: 1776e8f494e94fd3414d7679e5782ec22e83c95f last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-rishabh-cephman-6 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: b70fdf973c2ffa23c0d8aa6918519da05d922302 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b70fdf973c2ffa23c0d8aa6918519da05d922302 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: CephManager-in-CephFSTestCase sha1: 342392241eddd9827618f3dbb8134df7441718a8 owner: scheduled_rishabh@teuthology priority: 200 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: b70fdf973c2ffa23c0d8aa6918519da05d922302 sleep_before_teardown: 0 suite: fs suite_branch: CephManager-in-CephFSTestCase suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_342392241eddd9827618f3dbb8134df7441718a8/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 342392241eddd9827618f3dbb8134df7441718a8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi172.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRgxxdjWX3i5NfNprCr0CNZLbnCHWtkHDPUiBcVcGH2RZV1KlLfhJUkWUSf0AzEUCfWvpdj99CSV9oS9Bd5d2k8YfKl8CgHl+qy4W5LE9um2w4Xx5NBOwqeq9n/LshhWZmai5ViH6iCqpDndhXAjmPNqI3jpeKZfvTU1LpKkVCrnlKG84HGtoz/wYda4RHx3O3UP3ox2vk8tb+OdtHdRDTwmvhOoIYihGkcuvW/q2hkyQzPn7siaGp1tByBNkcjRrbkm47hdJn0h0HdGBnE90WQaajSzzsuV4K7gfM3JYPquhQhk6RaXYc/i6b4j0Jyw/DPQEOAwAqXfCHXhCjbyedZhodON4UZVqUnszbgEELgw8mqCcz1iUWTqm5nWw53ZEyDgV6S6gfr2Yho+uDW0uXbyPOs5TdHc0NnF3L8U+NpY2lmKv1ToUtRTzNE3cbXBwLG40LMIvLVu5nsqDNa5e4a/vX8oBt2VSAeutj12aSsIynwHv7aPMlREIaD4EEjnk= smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUsACoBjqbtzKUqkO6CEtOs8Zk8l0rAEMqpHG0oVcHfDu4ZDTxjByJhcf1BdOxeA7D1GNN3eljeNotglAcmD3+Tq+z+TguTEkD2qCjUr39Y6bAjGNjwI9+GEplwYpGlU5GZQsmCLA84TDKzQTNj+iumV5ixwqEVRQodNc2C7r3Y9CJj9iNIibJs8T5OutS/0munmv6c+I2x+DQtCP0H8SsqTF4OPgHS+eqOiB5l53p54NrKv/eVGg0INjZ/KeGSL5Rz5eooWKxQkrbxPXorHPzxxr4M0fdI/BydRrB+OJ30ra8Q73KpKGPpFLyuCoxsA8L2G2rl7l90Fe9H6ItEweqM/ztZfy5kKtmeZgNIalkQeQX6LZqgbho4ANSqp5yZ+TVEq03LV5UbJjNNSd08PD/lcJJjHwl+TaN+PUqRmHR7WK42VuOFRvJ5bd3RfIHg0IXFF8n8z8WIsii/1A8ehk97FgcjCfd1EefXu/Z5h/TtCImn5N5Li2Fc0kF7TpcmrE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e3729161eecf8e6d09a4069acbb883cdcd5e9f50 timestamp: 2023-03-27_06:39:30 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4538 2023-03-27T09:51:52.745 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_342392241eddd9827618f3dbb8134df7441718a8/qa; will attempt to use it 2023-03-27T09:51:52.746 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_342392241eddd9827618f3dbb8134df7441718a8/qa/tasks 2023-03-27T09:51:52.747 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-27T09:51:52.748 INFO:teuthology.task.internal:Checking packages... 2023-03-27T09:51:52.776 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b70fdf973c2ffa23c0d8aa6918519da05d922302' 2023-03-27T09:51:52.777 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-27T09:51:52.777 INFO:teuthology.packaging:ref: None 2023-03-27T09:51:52.778 INFO:teuthology.packaging:tag: None 2023-03-27T09:51:52.778 INFO:teuthology.packaging:branch: wip-rishabh-cephman-6 2023-03-27T09:51:52.778 INFO:teuthology.packaging:sha1: b70fdf973c2ffa23c0d8aa6918519da05d922302 2023-03-27T09:51:52.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-cephman-6 2023-03-27T09:51:52.915 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2533.gb70fdf97 2023-03-27T09:51:52.916 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-27T09:51:52.930 INFO:teuthology.task.internal:no buildpackages task found 2023-03-27T09:51:52.930 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-27T09:51:52.977 INFO:teuthology.task.internal:Saving configuration 2023-03-27T09:51:52.995 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-27T09:51:53.020 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-27T09:51:53.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221298', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-27 09:46:31.845845', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpVrOFDmWbzkUuZ8eICwK1iVcU9pxiRRgf+6FjFP4JMlx0TrrkSVhQH3ET6XOc1APNa+USg0D1Jf1RyoLx/7fg='} 2023-03-27T09:51:53.075 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221298', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-27 09:46:31.843941', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRVXYTcMhpnlEEMGsgPmjJvY0CCxY9dupua0hXbDFHoufreXAkgjeOzYZyyLW9WBMfXLpVIyXJS8RSIe2xtShY='} 2023-03-27T09:51:53.075 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-27T09:51:53.088 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-03-27T09:51:53.089 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-03-27T09:51:53.089 INFO:teuthology.run_tasks:Running task console_log... 2023-03-27T09:51:53.205 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b6befe4c0>, signals=[15]) 2023-03-27T09:51:53.208 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-27T09:51:53.223 INFO:teuthology.task.internal:Opening connections... 2023-03-27T09:51:53.224 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T09:51:53.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T09:51:53.297 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T09:51:53.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T09:51:53.366 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-27T09:51:53.377 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-03-27T09:51:53.397 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-03-27T09:51:53.397 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-03-27T09:51:53.455 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-03-27T09:51:53.455 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8" 2023-03-27T09:51:53.455 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-27T09:51:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-03-27T09:51:53.457 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-27T09:51:53.457 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-27T09:51:53.457 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-27T09:51:53.458 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-03-27T09:51:53.484 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-03-27T09:51:53.503 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-03-27T09:51:53.504 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-03-27T09:51:53.561 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-03-27T09:51:53.562 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-03-27T09:51:53.562 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-03-27T09:51:53.562 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-03-27T09:51:53.563 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-03-27T09:51:53.563 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-03-27T09:51:53.563 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-27T09:51:53.563 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-03-27T09:51:53.563 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-27T09:51:53.563 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-03-27T09:51:53.564 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-27T09:51:53.564 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-27T09:51:53.564 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-27T09:51:53.564 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-03-27T09:51:53.594 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-27T09:51:53.608 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-27T09:51:53.645 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-27T09:51:53.646 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-03-27T09:51:53.649 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2023-03-27T09:51:53.667 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-27T09:51:53.678 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-27T09:51:53.679 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-03-27T09:51:53.708 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2023-03-27T09:51:53.743 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-27T09:51:53.810 INFO:teuthology.run_tasks:Running task kernel... 2023-03-27T09:51:53.833 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1776e8f494e94fd3414d7679e5782ec22e83c95f'} 2023-03-27T09:51:53.834 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-03-27T09:51:53.834 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-03-27T09:51:53.835 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-27T09:51:53.835 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-27T09:51:53.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T09:51:53.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-03-27T09:51:53.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T09:51:53.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-03-27T09:51:54.046 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1776e8f494e94fd3414d7679e5782ec22e83c95f 2023-03-27T09:51:54.046 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1776e8f494e94fd3414d7679e5782ec22e83c95f"... 2023-03-27T09:51:54.046 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-03-27T09:51:54.062 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1776e8f494e94fd3414d7679e5782ec22e83c95f 2023-03-27T09:51:54.062 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1776e8f494e94fd3414d7679e5782ec22e83c95f"... 2023-03-27T09:51:54.062 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-03-27T09:51:54.065 INFO:teuthology.orchestra.run.smithi172.stdout:4.18.0-408.el8.x86_64 2023-03-27T09:51:54.066 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-408.el8.x86_64 vs 1776e8f494e94fd3414d7679e5782ec22e83c95f 2023-03-27T09:51:54.066 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-27T09:51:54.067 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum upgrade -y linux-firmware 2023-03-27T09:51:54.080 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-408.el8.x86_64 2023-03-27T09:51:54.081 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-408.el8.x86_64 vs 1776e8f494e94fd3414d7679e5782ec22e83c95f 2023-03-27T09:51:54.081 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-03-27T09:51:54.081 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum upgrade -y linux-firmware 2023-03-27T09:51:57.646 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - AppStream 36 MB/s | 29 MB 00:00 2023-03-27T09:51:57.897 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - AppStream 28 MB/s | 29 MB 00:01 2023-03-27T09:52:03.413 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - BaseOS 42 MB/s | 28 MB 00:00 2023-03-27T09:52:03.781 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - BaseOS 40 MB/s | 28 MB 00:00 2023-03-27T09:52:07.703 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - Extras 138 kB/s | 18 kB 00:00 2023-03-27T09:52:08.105 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - PowerTools 21 MB/s | 5.8 MB 00:00 2023-03-27T09:52:08.179 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - Extras 125 kB/s | 18 kB 00:00 2023-03-27T09:52:08.590 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - PowerTools 21 MB/s | 5.8 MB 00:00 2023-03-27T09:52:09.338 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-03-27T09:52:10.022 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-03-27T09:52:10.480 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 14 MB/s | 14 MB 00:01 2023-03-27T09:52:11.180 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2023-03-27T09:52:13.846 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 391 kB/s | 24 kB 00:00 2023-03-27T09:52:14.664 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 151 kB/s | 24 kB 00:00 2023-03-27T09:52:17.270 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-03-27T09:52:17.271 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-03-27T09:52:17.271 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-03-27T09:52:17.271 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-03-27T09:52:17.271 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2023-03-27T09:52:17.271 INFO:teuthology.orchestra.run.smithi172.stdout: linux-firmware noarch 20230217-113.git83f1d778.el8 CentOS-BaseOS 263 M 2023-03-27T09:52:17.272 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T09:52:17.272 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-03-27T09:52:17.272 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-03-27T09:52:17.272 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 1 Package 2023-03-27T09:52:17.272 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T09:52:17.273 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 263 M 2023-03-27T09:52:17.273 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-03-27T09:52:18.135 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-03-27T09:52:18.136 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-03-27T09:52:18.136 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-03-27T09:52:18.136 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: linux-firmware noarch 20230217-113.git83f1d778.el8 CentOS-BaseOS 263 M 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 1 Package 2023-03-27T09:52:18.137 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T09:52:18.138 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 263 M 2023-03-27T09:52:18.138 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-03-27T09:52:22.073 INFO:teuthology.orchestra.run.smithi172.stdout:linux-firmware-20230217-113.git83f1d778.el8.noa 55 MB/s | 263 MB 00:04 2023-03-27T09:52:22.074 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-03-27T09:52:22.075 INFO:teuthology.orchestra.run.smithi172.stdout:Total 55 MB/s | 263 MB 00:04 2023-03-27T09:52:23.634 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-03-27T09:52:23.683 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-03-27T09:52:23.684 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-03-27T09:52:24.456 INFO:teuthology.orchestra.run.smithi191.stdout:linux-firmware-20230217-113.git83f1d778.el8.noa 42 MB/s | 263 MB 00:06 2023-03-27T09:52:24.458 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-03-27T09:52:24.458 INFO:teuthology.orchestra.run.smithi191.stdout:Total 42 MB/s | 263 MB 00:06 2023-03-27T09:52:25.793 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-03-27T09:52:25.827 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-03-27T09:52:26.023 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-03-27T09:52:26.227 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-03-27T09:52:26.227 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-03-27T09:52:28.361 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-03-27T09:52:28.386 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-03-27T09:52:43.837 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-03-27T09:52:44.471 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : linux-firmware-20230217-113.git83f1d778.el8.noarch 1/2 2023-03-27T09:52:44.723 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : linux-firmware-20220726-110.git150864a4.el8.noarch 2/2 2023-03-27T09:52:45.035 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: linux-firmware-20220726-110.git150864a4.el8.noarch 2/2 2023-03-27T09:52:45.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 1/2 2023-03-27T09:52:45.650 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : linux-firmware-20220726-110.git150864a4.el8.noarch 2/2 2023-03-27T09:52:45.651 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T09:52:45.651 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2023-03-27T09:52:45.651 INFO:teuthology.orchestra.run.smithi172.stdout: linux-firmware-20230217-113.git83f1d778.el8.noarch 2023-03-27T09:52:45.651 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T09:52:45.651 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-03-27T09:52:45.785 INFO:teuthology.task.kernel:Downloading kernel 1776e8f494e94fd3414d7679e5782ec22e83c95f on client.0... 2023-03-27T09:52:45.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1776e8f494e94fd3414d7679e5782ec22e83c95f 2023-03-27T09:52:45.925 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1776e8f494e94fd3414d7679e5782ec22e83c95f/centos/8/flavors/default/x86_64/ 2023-03-27T09:52:45.926 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_rc3_g1776e8f494e9-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1776e8f494e94fd3414d7679e5782ec22e83c95f/centos/8/flavors/default/x86_64/ --input-file=- 2023-03-27T09:52:45.929 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi172.front.sepia.ceph.com to complete... 2023-03-27T09:52:46.576 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-03-27T09:52:46.965 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : linux-firmware-20230217-113.git83f1d778.el8.noarch 1/2 2023-03-27T09:52:47.182 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : linux-firmware-20220726-110.git150864a4.el8.noarch 2/2 2023-03-27T09:52:47.498 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: linux-firmware-20220726-110.git150864a4.el8.noarch 2/2 2023-03-27T09:52:47.498 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 1/2 2023-03-27T09:52:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : linux-firmware-20220726-110.git150864a4.el8.noarch 2/2 2023-03-27T09:52:48.137 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T09:52:48.137 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2023-03-27T09:52:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: linux-firmware-20230217-113.git83f1d778.el8.noarch 2023-03-27T09:52:48.138 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T09:52:48.138 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-03-27T09:52:48.270 INFO:teuthology.task.kernel:Downloading kernel 1776e8f494e94fd3414d7679e5782ec22e83c95f on client.1... 2023-03-27T09:52:48.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1776e8f494e94fd3414d7679e5782ec22e83c95f 2023-03-27T09:52:48.407 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1776e8f494e94fd3414d7679e5782ec22e83c95f/centos/8/flavors/default/x86_64/ 2023-03-27T09:52:48.408 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_rc3_g1776e8f494e9-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1776e8f494e94fd3414d7679e5782ec22e83c95f/centos/8/flavors/default/x86_64/ --input-file=- 2023-03-27T09:52:48.410 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi191.front.sepia.ceph.com to complete... 2023-03-27T09:53:02.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27 09:53:02 URL:https://2.chacra.ceph.com/r/kernel/testing/1776e8f494e94fd3414d7679e5782ec22e83c95f/centos/8/flavors/default/x86_64/kernel-6.3.0_rc3_g1776e8f494e9-1.x86_64.rpm [377992976/377992976] -> "/tmp/kernel.x86_64.rpm" [1] 2023-03-27T09:53:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:FINISHED --2023-03-27 09:53:02-- 2023-03-27T09:53:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:Total wall clock time: 17s 2023-03-27T09:53:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:Downloaded: 1 files, 360M in 16s (22.1 MB/s) 2023-03-27T09:53:02.479 INFO:teuthology.task.kernel:Installing kernel 1776e8f494e94fd3414d7679e5782ec22e83c95f on client.0... 2023-03-27T09:53:02.479 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-03-27T09:53:04.360 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying... ######################################## 2023-03-27T09:53:04.817 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing... ######################################## 2023-03-27T09:53:04.917 INFO:teuthology.orchestra.run.smithi172.stdout:Updating / installing... 2023-03-27T09:53:11.044 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27 09:53:11 URL:https://2.chacra.ceph.com/r/kernel/testing/1776e8f494e94fd3414d7679e5782ec22e83c95f/centos/8/flavors/default/x86_64/kernel-6.3.0_rc3_g1776e8f494e9-1.x86_64.rpm [377992976/377992976] -> "/tmp/kernel.x86_64.rpm" [1] 2023-03-27T09:53:11.045 INFO:teuthology.orchestra.run.smithi191.stderr:FINISHED --2023-03-27 09:53:11-- 2023-03-27T09:53:11.045 INFO:teuthology.orchestra.run.smithi191.stderr:Total wall clock time: 23s 2023-03-27T09:53:11.045 INFO:teuthology.orchestra.run.smithi191.stderr:Downloaded: 1 files, 360M in 22s (16.2 MB/s) 2023-03-27T09:53:11.046 INFO:teuthology.task.kernel:Installing kernel 1776e8f494e94fd3414d7679e5782ec22e83c95f on client.1... 2023-03-27T09:53:11.046 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-03-27T09:53:12.702 INFO:teuthology.orchestra.run.smithi191.stdout:Verifying... ######################################## 2023-03-27T09:53:13.578 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing... ######################################## 2023-03-27T09:53:13.680 INFO:teuthology.orchestra.run.smithi191.stdout:Updating / installing... 2023-03-27T09:53:42.679 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-6.3.0_rc3_g1776e8f494e9-1 ######################################## 2023-03-27T09:53:51.329 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-6.3.0_rc3_g1776e8f494e9-1 ######################################## 2023-03-27T09:54:07.720 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-03-27T09:54:07.720 DEBUG:teuthology.orchestra.run.smithi172:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-03-27T09:54:07.775 INFO:teuthology.orchestra.run.smithi172.stdout:/boot/System.map-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:07.775 INFO:teuthology.orchestra.run.smithi172.stdout:/boot/config-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto 2023-03-27T09:54:07.776 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-27T09:54:07.777 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/crc32c-intel.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-27T09:54:07.778 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel/cpu 2023-03-27T09:54:07.779 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel/cpu/mce 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm/kvm.ko 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/ansi_cprng.ko 2023-03-27T09:54:07.780 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/anubis.ko 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/arc4.ko 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_memcpy.ko 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_pq.ko 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_tx.ko 2023-03-27T09:54:07.781 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_xor.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/raid6test.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/authenc.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/authencesn.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/blake2b_generic.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/blowfish_common.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/blowfish_generic.ko 2023-03-27T09:54:07.782 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/camellia_generic.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cast5_generic.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cast6_generic.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cast_common.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/ccm.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cmac.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/crc32_generic.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/crypto_engine.ko 2023-03-27T09:54:07.783 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/crypto_user.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cts.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/des_generic.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/dh_generic.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/echainiv.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/essiv.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/fcrypt.ko 2023-03-27T09:54:07.784 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/khazad.ko 2023-03-27T09:54:07.785 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/lz4.ko 2023-03-27T09:54:07.785 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/lz4hc.ko 2023-03-27T09:54:07.785 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/md4.ko 2023-03-27T09:54:07.785 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/michael_mic.ko 2023-03-27T09:54:07.785 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/pcbc.ko 2023-03-27T09:54:07.785 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/pcrypt.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/rmd160.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/seed.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/serpent_generic.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/tcrypt.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/tea.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/twofish_common.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/twofish_generic.ko 2023-03-27T09:54:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/vmac.ko 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/wp512.ko 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/xcbc.ko 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/xor.ko 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/xxhash_generic.ko 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi 2023-03-27T09:54:07.787 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/acpi_pad.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/custom_method.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/ec_sys.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/platform_profile.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/sbs.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/sbshc.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/video.ko 2023-03-27T09:54:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/acard-ahci.ko 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/ahci_platform.ko 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/ata_generic.ko 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/libahci_platform.ko 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_acpi.ko 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ali.ko 2023-03-27T09:54:07.789 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_amd.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_artop.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_atiixp.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_atp867x.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_cmd640.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_cmd64x.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_cypress.ko 2023-03-27T09:54:07.790 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_efar.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt366.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt37x.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_it8213.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_it821x.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_jmicron.ko 2023-03-27T09:54:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_marvell.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_mpiix.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_netcell.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ninja32.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ns87410.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ns87415.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_oldpiix.ko 2023-03-27T09:54:07.792 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_opti.ko 2023-03-27T09:54:07.793 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_optidma.ko 2023-03-27T09:54:07.793 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_pcmcia.ko 2023-03-27T09:54:07.793 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-27T09:54:07.793 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-27T09:54:07.793 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_piccolo.ko 2023-03-27T09:54:07.793 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_rdc.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sch.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_serverworks.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sil680.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sis.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sl82c105.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_triflex.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_via.ko 2023-03-27T09:54:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pdc_adma.ko 2023-03-27T09:54:07.795 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_inic162x.ko 2023-03-27T09:54:07.795 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_mv.ko 2023-03-27T09:54:07.795 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_nv.ko 2023-03-27T09:54:07.795 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_promise.ko 2023-03-27T09:54:07.795 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_qstor.ko 2023-03-27T09:54:07.795 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sil.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sil24.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sis.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_svw.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sx4.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_uli.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_via.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_vsc.ko 2023-03-27T09:54:07.796 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/auxdisplay 2023-03-27T09:54:07.797 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/auxdisplay/ks0108.ko 2023-03-27T09:54:07.797 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/base 2023-03-27T09:54:07.797 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/base/regmap 2023-03-27T09:54:07.797 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/base/regmap/regmap-i2c.ko 2023-03-27T09:54:07.797 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/bcma 2023-03-27T09:54:07.798 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/bcma/bcma.ko 2023-03-27T09:54:07.798 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block 2023-03-27T09:54:07.798 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/aoe 2023-03-27T09:54:07.798 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/aoe/aoe.ko 2023-03-27T09:54:07.799 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/brd.ko 2023-03-27T09:54:07.799 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/drbd 2023-03-27T09:54:07.799 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/drbd/drbd.ko 2023-03-27T09:54:07.799 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/floppy.ko 2023-03-27T09:54:07.800 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/loop.ko 2023-03-27T09:54:07.800 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/mtip32xx 2023-03-27T09:54:07.800 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-27T09:54:07.800 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/nbd.ko 2023-03-27T09:54:07.801 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/null_blk 2023-03-27T09:54:07.801 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/null_blk/null_blk.ko 2023-03-27T09:54:07.801 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/pktcdvd.ko 2023-03-27T09:54:07.801 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/rbd.ko 2023-03-27T09:54:07.802 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/virtio_blk.ko 2023-03-27T09:54:07.802 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/xen-blkback 2023-03-27T09:54:07.802 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-27T09:54:07.802 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/xen-blkfront.ko 2023-03-27T09:54:07.803 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/zram 2023-03-27T09:54:07.803 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/zram/zram.ko 2023-03-27T09:54:07.803 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char 2023-03-27T09:54:07.803 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hangcheck-timer.ko 2023-03-27T09:54:07.804 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random 2023-03-27T09:54:07.804 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-27T09:54:07.804 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-27T09:54:07.804 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/via-rng.ko 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-27T09:54:07.805 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/lp.ko 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/mwave 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/mwave/mwave.ko 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/pcmcia 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-27T09:54:07.806 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ppdev.ko 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tlclk.ko 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm.ko 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-27T09:54:07.807 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_tis.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/uv_mmtimer.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/virtio_console.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-27T09:54:07.808 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/powernow-k8.ko 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/ccp 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-27T09:54:07.809 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/ccp/ccp.ko 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/padlock-aes.ko 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/padlock-sha.ko 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_common 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_dh895xcc 2023-03-27T09:54:07.810 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/virtio 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dca 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dca/dca.ko 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/devfreq 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-03-27T09:54:07.811 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/dw 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/ioat 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/amd64_edac.ko 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/e752x_edac.ko 2023-03-27T09:54:07.812 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/edac_mce_amd.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i3000_edac.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i3200_edac.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i5100_edac.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i5400_edac.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i7300_edac.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i7core_edac.ko 2023-03-27T09:54:07.813 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i82975x_edac.ko 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/ie31200_edac.ko 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/sb_edac.ko 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/x38_edac.ko 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/firmware 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/firmware/edd.ko 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-27T09:54:07.814 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/gpio 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/gpio/gpio-ich.ko 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-appleir.ko 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-aureal.ko 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-axff.ko 2023-03-27T09:54:07.815 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-dr.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-elecom.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-elo.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-emsff.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-gaff.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-gt683r.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-gyration.ko 2023-03-27T09:54:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-27T09:54:07.817 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-27T09:54:07.817 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-holtekff.ko 2023-03-27T09:54:07.817 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-hyperv.ko 2023-03-27T09:54:07.817 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-icade.ko 2023-03-27T09:54:07.817 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-keytouch.ko 2023-03-27T09:54:07.818 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-kye.ko 2023-03-27T09:54:07.818 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-lcpower.ko 2023-03-27T09:54:07.818 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-led.ko 2023-03-27T09:54:07.818 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-lenovo.ko 2023-03-27T09:54:07.819 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-27T09:54:07.819 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-27T09:54:07.819 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-multitouch.ko 2023-03-27T09:54:07.819 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-ortek.ko 2023-03-27T09:54:07.820 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-penmount.ko 2023-03-27T09:54:07.820 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-petalynx.ko 2023-03-27T09:54:07.821 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-picolcd.ko 2023-03-27T09:54:07.821 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-pl.ko 2023-03-27T09:54:07.821 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-plantronics.ko 2023-03-27T09:54:07.821 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-primax.ko 2023-03-27T09:54:07.822 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-rmi.ko 2023-03-27T09:54:07.822 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-27T09:54:07.822 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-common.ko 2023-03-27T09:54:07.822 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-27T09:54:07.823 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-27T09:54:07.823 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-27T09:54:07.823 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-27T09:54:07.824 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-27T09:54:07.824 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-27T09:54:07.824 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-27T09:54:07.824 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-27T09:54:07.824 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-saitek.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-samsung.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sjoy.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sony.ko 2023-03-27T09:54:07.825 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-speedlink.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-steelseries.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sunplus.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-tivo.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-tmff.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-topseed.ko 2023-03-27T09:54:07.826 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-twinhan.ko 2023-03-27T09:54:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-uclogic.ko 2023-03-27T09:54:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-waltop.ko 2023-03-27T09:54:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-wiimote.ko 2023-03-27T09:54:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-xinmo.ko 2023-03-27T09:54:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-zpff.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-zydacron.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/uhid.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/wacom.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv/hv_balloon.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv/hv_utils.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv/hv_vmbus.ko 2023-03-27T09:54:07.828 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon 2023-03-27T09:54:07.829 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/abituguru.ko 2023-03-27T09:54:07.829 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/abituguru3.ko 2023-03-27T09:54:07.829 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-27T09:54:07.829 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ad7414.ko 2023-03-27T09:54:07.829 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ad7418.ko 2023-03-27T09:54:07.829 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adc128d818.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1025.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1026.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1029.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1031.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm9240.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ads7828.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7410.ko 2023-03-27T09:54:07.830 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7411.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7462.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7470.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7475.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7x10.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/amc6821.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/applesmc.ko 2023-03-27T09:54:07.831 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/asb100.ko 2023-03-27T09:54:07.832 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/asc7621.ko 2023-03-27T09:54:07.832 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-27T09:54:07.832 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/atxp1.ko 2023-03-27T09:54:07.832 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/coretemp.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/dme1737.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ds1621.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ds620.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/emc1403.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/emc6w201.ko 2023-03-27T09:54:07.833 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/f71805f.ko 2023-03-27T09:54:07.834 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/f71882fg.ko 2023-03-27T09:54:07.834 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/f75375s.ko 2023-03-27T09:54:07.834 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/fam15h_power.ko 2023-03-27T09:54:07.834 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/fschmd.ko 2023-03-27T09:54:07.834 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/g760a.ko 2023-03-27T09:54:07.835 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/g762.ko 2023-03-27T09:54:07.835 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/gl518sm.ko 2023-03-27T09:54:07.835 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/gl520sm.ko 2023-03-27T09:54:07.835 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-27T09:54:07.835 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/i5500_temp.ko 2023-03-27T09:54:07.835 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/i5k_amb.ko 2023-03-27T09:54:07.836 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ibmaem.ko 2023-03-27T09:54:07.836 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ibmpex.ko 2023-03-27T09:54:07.836 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ina209.ko 2023-03-27T09:54:07.836 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ina2xx.ko 2023-03-27T09:54:07.836 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/it87.ko 2023-03-27T09:54:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/k10temp.ko 2023-03-27T09:54:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/k8temp.ko 2023-03-27T09:54:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lineage-pem.ko 2023-03-27T09:54:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm63.ko 2023-03-27T09:54:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm73.ko 2023-03-27T09:54:07.837 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm75.ko 2023-03-27T09:54:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm77.ko 2023-03-27T09:54:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm78.ko 2023-03-27T09:54:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm80.ko 2023-03-27T09:54:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm83.ko 2023-03-27T09:54:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm85.ko 2023-03-27T09:54:07.838 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm87.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm90.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm92.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm93.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm95234.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm95241.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm95245.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc2945.ko 2023-03-27T09:54:07.839 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4151.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4215.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4222.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4245.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4260.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4261.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max16065.ko 2023-03-27T09:54:07.840 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max1619.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max1668.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max197.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max6639.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max6650.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max6697.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/mcp3021.ko 2023-03-27T09:54:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct6683.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct6775-core.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct6775.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct7802.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pc87360.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pc87427.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pcf8591.ko 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus 2023-03-27T09:54:07.842 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-27T09:54:07.843 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/powr1220.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sch5627.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sch5636.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-27T09:54:07.844 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sht15.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sht21.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/shtc1.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sis5595.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/smsc47b397.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/smsc47m1.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/smsc47m192.ko 2023-03-27T09:54:07.845 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/thmc50.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp102.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp103.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp401.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp421.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/via-cputemp.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/via686a.ko 2023-03-27T09:54:07.846 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/vt1211.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/vt8231.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83627ehf.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83627hf.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83781d.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83791d.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83792d.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83793.ko 2023-03-27T09:54:07.847 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83795.ko 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83l785ts.ko 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83l786ng.ko 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/algos 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-27T09:54:07.848 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-27T09:54:07.849 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-27T09:54:07.850 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-27T09:54:07.850 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-27T09:54:07.850 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-27T09:54:07.850 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-27T09:54:07.850 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-27T09:54:07.850 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-27T09:54:07.851 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-dev.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-mux.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-smbus.ko 2023-03-27T09:54:07.852 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-stub.ko 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_core.ko 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-27T09:54:07.853 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/cxgb4 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx4 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-27T09:54:07.854 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx5 2023-03-27T09:54:07.855 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-27T09:54:07.855 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mthca 2023-03-27T09:54:07.855 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-27T09:54:07.855 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp 2023-03-27T09:54:07.855 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/ipoib 2023-03-27T09:54:07.856 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-27T09:54:07.856 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/iser 2023-03-27T09:54:07.856 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-27T09:54:07.856 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/isert 2023-03-27T09:54:07.857 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-27T09:54:07.857 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srp 2023-03-27T09:54:07.857 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-27T09:54:07.858 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srpt 2023-03-27T09:54:07.858 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-27T09:54:07.858 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input 2023-03-27T09:54:07.858 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport 2023-03-27T09:54:07.859 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-27T09:54:07.859 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-27T09:54:07.859 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/gameport.ko 2023-03-27T09:54:07.859 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/lightning.ko 2023-03-27T09:54:07.859 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/ns558.ko 2023-03-27T09:54:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/joydev.ko 2023-03-27T09:54:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/keyboard 2023-03-27T09:54:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-27T09:54:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse 2023-03-27T09:54:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/appletouch.ko 2023-03-27T09:54:07.860 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/bcm5974.ko 2023-03-27T09:54:07.861 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/cyapatp.ko 2023-03-27T09:54:07.861 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-27T09:54:07.861 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/sermouse.ko 2023-03-27T09:54:07.861 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-27T09:54:07.861 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-27T09:54:07.861 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/rmi4 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/altera_ps2.ko 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/arc_ps2.ko 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-27T09:54:07.862 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/serio_raw.ko 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/sparse-keymap.ko 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/iommu 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/iommu/amd 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-blinkm.ko 2023-03-27T09:54:07.863 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-lm3530.ko 2023-03-27T09:54:07.864 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-lp3944.ko 2023-03-27T09:54:07.864 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-ss4200.ko 2023-03-27T09:54:07.864 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger 2023-03-27T09:54:07.864 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-27T09:54:07.864 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-27T09:54:07.864 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-27T09:54:07.865 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md 2023-03-27T09:54:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/bcache 2023-03-27T09:54:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/bcache/bcache.ko 2023-03-27T09:54:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-bio-prison.ko 2023-03-27T09:54:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-cache-smq.ko 2023-03-27T09:54:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-cache.ko 2023-03-27T09:54:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-crypt.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-delay.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-flakey.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-log-userspace.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-multipath.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-queue-length.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-raid.ko 2023-03-27T09:54:07.867 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-round-robin.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-service-time.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-switch.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-thin-pool.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-verity.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/faulty.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/linear.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/multipath.ko 2023-03-27T09:54:07.868 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/persistent-data 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid0.ko 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid1.ko 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid10.ko 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid456.ko 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message 2023-03-27T09:54:07.869 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion 2023-03-27T09:54:07.870 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptbase.ko 2023-03-27T09:54:07.870 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptctl.ko 2023-03-27T09:54:07.870 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptfc.ko 2023-03-27T09:54:07.870 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptlan.ko 2023-03-27T09:54:07.870 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptsas.ko 2023-03-27T09:54:07.870 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptscsih.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptspi.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/lpc_ich.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/lpc_sch.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/mfd-core.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/sm501.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/viperboard.ko 2023-03-27T09:54:07.871 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/vx855.ko 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/wl1273-core.ko 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/altera-stapl 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/apds9802als.ko 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/apds990x.ko 2023-03-27T09:54:07.872 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/bh1770glc.ko 2023-03-27T09:54:07.873 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/cb710 2023-03-27T09:54:07.873 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/cb710/cb710.ko 2023-03-27T09:54:07.873 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom 2023-03-27T09:54:07.873 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/at24.ko 2023-03-27T09:54:07.873 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-27T09:54:07.874 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-27T09:54:07.874 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/max6875.ko 2023-03-27T09:54:07.874 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/enclosure.ko 2023-03-27T09:54:07.874 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/hpilo.ko 2023-03-27T09:54:07.874 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/isl29003.ko 2023-03-27T09:54:07.874 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/isl29020.ko 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/lis3lv02d 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei/mei-me.ko 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei/mei-txe.ko 2023-03-27T09:54:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei/mei.ko 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-gru 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-gru/gru.ko 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp/xp.ko 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp/xpc.ko 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-03-27T09:54:07.876 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/tifm_7xx1.ko 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/tifm_core.ko 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/tsl2550.ko 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/vmw_balloon.ko 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/vmw_vmci 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net 2023-03-27T09:54:07.877 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/bonding 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/bonding/bonding.ko 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/b53 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-27T09:54:07.878 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/mv88e6xxx 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dummy.ko 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/eql.ko 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-27T09:54:07.879 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/adaptec 2023-03-27T09:54:07.880 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/agere 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/alteon 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/altera 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-27T09:54:07.881 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/alx 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-27T09:54:07.882 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1c 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1e 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atlx 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom 2023-03-27T09:54:07.883 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/genet 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-27T09:54:07.884 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/brocade 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/brocade/bna 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-27T09:54:07.885 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-03-27T09:54:07.886 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/cisco 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/cisco/enic 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-27T09:54:07.887 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dlink 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dnet.ko 2023-03-27T09:54:07.888 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/emulex 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/emulex/benet 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/ethoc.ko 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/fealnx.ko 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-27T09:54:07.889 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000e 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/fm10k 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/i40e 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-27T09:54:07.890 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/iavf 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igb 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igbvf 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgb 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-27T09:54:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbe 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbevf 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/jme.ko 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-27T09:54:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx4 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx5 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-03-27T09:54:07.893 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/micrel 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/myricom 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/myricom/myri10ge 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/natsemi 2023-03-27T09:54:07.894 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/neterion 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/nvidia 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/packetengines 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-27T09:54:07.895 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/netxen 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-27T09:54:07.896 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rdc 2023-03-27T09:54:07.897 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-27T09:54:07.897 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek 2023-03-27T09:54:07.897 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-27T09:54:07.897 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-27T09:54:07.897 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-27T09:54:07.897 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-27T09:54:07.898 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rocker 2023-03-27T09:54:07.898 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-03-27T09:54:07.898 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sfc 2023-03-27T09:54:07.898 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-27T09:54:07.898 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/silan 2023-03-27T09:54:07.898 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-27T09:54:07.899 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sis 2023-03-27T09:54:07.899 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-27T09:54:07.899 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-27T09:54:07.899 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc 2023-03-27T09:54:07.899 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro/stmmac 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-27T09:54:07.900 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/tehuti 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-27T09:54:07.901 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/ti 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/via 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/wiznet 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-27T09:54:07.902 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/xircom 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/geneve.ko 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/hyperv 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ieee802154 2023-03-27T09:54:07.903 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-27T09:54:07.904 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ifb.ko 2023-03-27T09:54:07.904 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ipvlan 2023-03-27T09:54:07.904 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-27T09:54:07.904 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/macvlan.ko 2023-03-27T09:54:07.905 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/macvtap.ko 2023-03-27T09:54:07.905 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio 2023-03-27T09:54:07.905 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio.ko 2023-03-27T09:54:07.905 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-27T09:54:07.905 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-27T09:54:07.905 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mii.ko 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/net_failover.ko 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/netconsole.ko 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/nlmon.ko 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/pcs 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy 2023-03-27T09:54:07.906 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/amd.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm87xx.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/broadcom.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/cicada.ko 2023-03-27T09:54:07.907 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/davicom.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/dp83640.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/et1011c.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/icplus.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/lxt.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/marvell.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/micrel.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/national.ko 2023-03-27T09:54:07.908 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/phylink.ko 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/qsemi.ko 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/realtek.ko 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/smsc.ko 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/ste10Xp.ko 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/vitesse.ko 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp 2023-03-27T09:54:07.909 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_async.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_generic.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/pppoe.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/pppox.ko 2023-03-27T09:54:07.910 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/pptp.ko 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/slip 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/slip/slhc.ko 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/slip/slip.ko 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/sungem_phy.ko 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/tap.ko 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team 2023-03-27T09:54:07.911 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_random.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/tun.ko 2023-03-27T09:54:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/veth.ko 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/virtio_net.ko 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vmxnet3 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vxlan 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vxlan/vxlan.ko 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/xen-netback 2023-03-27T09:54:07.913 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/xen-netfront.ko 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ntb 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ntb/ntb.ko 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme/host 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme/host/nvme-core.ko 2023-03-27T09:54:07.914 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme/host/nvme.ko 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport.ko 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport_cs.ko 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport_pc.ko 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport_serial.ko 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci 2023-03-27T09:54:07.915 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/hotplug 2023-03-27T09:54:07.916 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-27T09:54:07.916 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/pcie 2023-03-27T09:54:07.916 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/pcie/aer_inject.ko 2023-03-27T09:54:07.916 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/xen-pcifront.ko 2023-03-27T09:54:07.917 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia 2023-03-27T09:54:07.917 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia/i82092.ko 2023-03-27T09:54:07.917 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia/pd6729.ko 2023-03-27T09:54:07.917 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-27T09:54:07.917 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pinctrl 2023-03-27T09:54:07.917 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pinctrl/intel 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/acerhdf.ko 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-27T09:54:07.918 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/hdaps.ko 2023-03-27T09:54:07.919 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/intel 2023-03-27T09:54:07.920 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-27T09:54:07.920 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/intel_ips.ko 2023-03-27T09:54:07.920 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-27T09:54:07.920 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-27T09:54:07.920 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-27T09:54:07.921 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/wmi.ko 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/powercap 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-27T09:54:07.922 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients/pps_parport.ko 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/pps_core.ko 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ptp 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ptp/ptp.ko 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ptp/ptp_kvm.ko 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-27T09:54:07.923 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-27T09:54:07.924 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-27T09:54:07.925 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-27T09:54:07.925 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-27T09:54:07.925 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-em3027.ko 2023-03-27T09:54:07.925 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-27T09:54:07.925 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-27T09:54:07.925 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-max6900.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-27T09:54:07.926 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-27T09:54:07.927 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-x1205.ko 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/3w-9xxx.ko 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/3w-sas.ko 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/3w-xxxx.ko 2023-03-27T09:54:07.928 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/BusLogic.ko 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/a100u2w.ko 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aacraid 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/advansys.ko 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aic7xxx 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-27T09:54:07.929 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/am53c974.ko 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/arcmsr 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/atp870u.ko 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/be2iscsi 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bfa 2023-03-27T09:54:07.930 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bfa/bfa.ko 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2fc 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2i 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ch.ko 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/csiostor 2023-03-27T09:54:07.931 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb3i 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb4i 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-27T09:54:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/dc395x.ko 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/dmx3191d.ko 2023-03-27T09:54:07.933 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/esas2r 2023-03-27T09:54:07.934 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-27T09:54:07.934 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/esp_scsi.ko 2023-03-27T09:54:07.934 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fcoe 2023-03-27T09:54:07.934 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-27T09:54:07.934 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-27T09:54:07.934 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fnic 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fnic/fnic.ko 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/hpsa.ko 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/hptiop.ko 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/hv_storvsc.ko 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/initio.ko 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ipr.ko 2023-03-27T09:54:07.935 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ips.ko 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/isci 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/isci/isci.ko 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libfc 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libfc/libfc.ko 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libiscsi.ko 2023-03-27T09:54:07.936 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libsas 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libsas/libsas.ko 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/lpfc 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid.ko 2023-03-27T09:54:07.937 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mpt3sas 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mvsas 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mvumi.ko 2023-03-27T09:54:07.938 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/pm8001 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/pmcraid.ko 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla1280.ko 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla2xxx 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla4xxx 2023-03-27T09:54:07.939 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-27T09:54:07.940 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/raid_class.ko 2023-03-27T09:54:07.940 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_debug.ko 2023-03-27T09:54:07.940 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-27T09:54:07.940 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-27T09:54:07.940 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-27T09:54:07.940 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-27T09:54:07.941 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-27T09:54:07.941 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ses.ko 2023-03-27T09:54:07.941 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/st.ko 2023-03-27T09:54:07.941 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/stex.ko 2023-03-27T09:54:07.941 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/sym53c8xx_2 2023-03-27T09:54:07.941 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/virtio_scsi.ko 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/wd719x.ko 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ssb 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ssb/ssb.ko 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target 2023-03-27T09:54:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/iscsi 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/loopback 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_file.ko 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_iblock.ko 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_mod.ko 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_pscsi.ko 2023-03-27T09:54:07.943 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_user.ko 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/tcm_fc 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-27T09:54:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-27T09:54:07.945 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-27T09:54:07.945 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-27T09:54:07.945 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-27T09:54:07.945 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-27T09:54:07.946 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-27T09:54:07.946 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-27T09:54:07.946 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-27T09:54:07.946 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-27T09:54:07.946 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-27T09:54:07.947 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-27T09:54:07.947 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-27T09:54:07.947 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-27T09:54:07.947 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-27T09:54:07.947 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty 2023-03-27T09:54:07.947 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/ipwireless 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/n_gsm.ko 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/n_hdlc.ko 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/nozomi.ko 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/8250 2023-03-27T09:54:07.948 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-27T09:54:07.949 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/arc_uart.ko 2023-03-27T09:54:07.949 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/jsm 2023-03-27T09:54:07.949 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-27T09:54:07.949 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/synclink_gt.ko 2023-03-27T09:54:07.949 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs 2023-03-27T09:54:07.949 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/core 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/host 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio.ko 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_aec.ko 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_cif.ko 2023-03-27T09:54:07.950 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_pci_generic.ko 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_sercos3.ko 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/cdc-acm.ko 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/usblp.ko 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/usbtmc.ko 2023-03-27T09:54:07.951 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/host 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/host/u132-hcd.ko 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/image 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/image/mdc800.ko 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/image/microtek.ko 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/adutux.ko 2023-03-27T09:54:07.952 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/appledisplay.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/emi26.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/emi62.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/ezusb.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/idmouse.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/iowarrior.ko 2023-03-27T09:54:07.953 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/ldusb.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/legousbtower.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/sisusbvga 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/usb3503.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/usblcd.ko 2023-03-27T09:54:07.954 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/uss720.ko 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/yurex.ko 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/phy 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/phy/phy-generic.ko 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/aircable.ko 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ark3116.ko 2023-03-27T09:54:07.955 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ch341.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/cp210x.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/cyberjack.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/empeg.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-27T09:54:07.956 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-27T09:54:07.957 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-27T09:54:07.957 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/io_ti.ko 2023-03-27T09:54:07.957 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ipaq.ko 2023-03-27T09:54:07.957 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ipw.ko 2023-03-27T09:54:07.957 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ir-usb.ko 2023-03-27T09:54:07.957 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/keyspan.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/mct_u232.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/mos7720.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/mos7840.ko 2023-03-27T09:54:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/navman.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/omninet.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/opticon.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/option.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/oti6858.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/pl2303.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/qcaux.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/qcserial.ko 2023-03-27T09:54:07.959 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/quatech2.ko 2023-03-27T09:54:07.960 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/safe_serial.ko 2023-03-27T09:54:07.960 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/sierra.ko 2023-03-27T09:54:07.960 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-27T09:54:07.960 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ssu100.ko 2023-03-27T09:54:07.960 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/symbolserial.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/usb_debug.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/visor.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/whiteheat.ko 2023-03-27T09:54:07.961 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/uas.ko 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-27T09:54:07.962 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-karma.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-27T09:54:07.963 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/usb-storage.ko 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/pci 2023-03-27T09:54:07.964 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/vfio.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost_net.ko 2023-03-27T09:54:07.965 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost_scsi.ko 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight/apple_bl.ko 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight/lcd.ko 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio 2023-03-27T09:54:07.966 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_balloon.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_mmio.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_pci.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_ring.ko 2023-03-27T09:54:07.967 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1 2023-03-27T09:54:07.968 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/masters 2023-03-27T09:54:07.968 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/masters/ds2482.ko 2023-03-27T09:54:07.968 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/masters/ds2490.ko 2023-03-27T09:54:07.968 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves 2023-03-27T09:54:07.969 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-27T09:54:07.969 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-27T09:54:07.969 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-27T09:54:07.969 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-27T09:54:07.969 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-27T09:54:07.970 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-27T09:54:07.970 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-27T09:54:07.970 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-27T09:54:07.970 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-27T09:54:07.970 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-27T09:54:07.971 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-27T09:54:07.971 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/wire.ko 2023-03-27T09:54:07.971 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog 2023-03-27T09:54:07.971 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-27T09:54:07.972 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-27T09:54:07.972 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-27T09:54:07.972 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/hpwdt.ko 2023-03-27T09:54:07.972 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/i6300esb.ko 2023-03-27T09:54:07.973 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-27T09:54:07.973 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-27T09:54:07.973 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/ib700wdt.ko 2023-03-27T09:54:07.973 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/ibmasr.ko 2023-03-27T09:54:07.974 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-27T09:54:07.974 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-27T09:54:07.974 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/it87_wdt.ko 2023-03-27T09:54:07.974 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/machzwd.ko 2023-03-27T09:54:07.974 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/nv_tco.ko 2023-03-27T09:54:07.974 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-27T09:54:07.975 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-27T09:54:07.975 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-27T09:54:07.975 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-27T09:54:07.975 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/softdog.ko 2023-03-27T09:54:07.975 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/via_wdt.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/wdt_pci.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/xen_wdt.ko 2023-03-27T09:54:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen 2023-03-27T09:54:07.977 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-acpi-processor.ko 2023-03-27T09:54:07.977 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-evtchn.ko 2023-03-27T09:54:07.977 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-gntalloc.ko 2023-03-27T09:54:07.977 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-gntdev.ko 2023-03-27T09:54:07.977 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-pciback 2023-03-27T09:54:07.977 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-privcmd.ko 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xenfs 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/9p 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/9p/9p.ko 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/affs 2023-03-27T09:54:07.978 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/affs/affs.ko 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/befs 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/befs/befs.ko 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/binfmt_misc.ko 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/btrfs 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/btrfs/btrfs.ko 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cachefiles 2023-03-27T09:54:07.979 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cachefiles/cachefiles.ko 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ceph 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ceph/ceph.ko 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cifs 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cifs/cifs.ko 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/coda 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/coda/coda.ko 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cramfs 2023-03-27T09:54:07.980 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cramfs/cramfs.ko 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/dlm 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/dlm/dlm.ko 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ecryptfs 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ecryptfs/ecryptfs.ko 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/f2fs 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/f2fs/f2fs.ko 2023-03-27T09:54:07.981 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat/fat.ko 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat/msdos.ko 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat/vfat.ko 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fscache 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fscache/fscache.ko 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fuse 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fuse/cuse.ko 2023-03-27T09:54:07.982 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fuse/fuse.ko 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/gfs2 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/gfs2/gfs2.ko 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfs 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfs/hfs.ko 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfsplus 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfsplus/hfsplus.ko 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/isofs 2023-03-27T09:54:07.983 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/isofs/isofs.ko 2023-03-27T09:54:07.984 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/jfs 2023-03-27T09:54:07.984 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/jfs/jfs.ko 2023-03-27T09:54:07.984 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/lockd 2023-03-27T09:54:07.984 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/lockd/lockd.ko 2023-03-27T09:54:07.984 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/minix 2023-03-27T09:54:07.984 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/minix/minix.ko 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/netfs 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/netfs/netfs.ko 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/blocklayout 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/filelayout 2023-03-27T09:54:07.985 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/flexfilelayout 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/nfs.ko 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/nfsv3.ko 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/nfsv4.ko 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs_common 2023-03-27T09:54:07.986 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs_common/grace.ko 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs_common/nfs_acl.ko 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfsd 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfsd/nfsd.ko 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nilfs2 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nilfs2/nilfs2.ko 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls 2023-03-27T09:54:07.987 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-celtic.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-centeuro.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-croatian.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-cyrillic.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-gaelic.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-greek.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-iceland.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-inuit.ko 2023-03-27T09:54:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-roman.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-romanian.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-turkish.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp1250.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp1251.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp1255.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp737.ko 2023-03-27T09:54:07.989 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp775.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp850.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp852.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp855.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp857.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp860.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp861.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp862.ko 2023-03-27T09:54:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp863.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp864.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp865.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp866.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp869.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp874.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp932.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp936.ko 2023-03-27T09:54:07.991 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp949.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp950.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_euc-jp.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-1.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-13.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-14.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-15.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-2.ko 2023-03-27T09:54:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-3.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-4.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-5.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-6.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-7.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-9.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_koi8-r.ko 2023-03-27T09:54:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_koi8-ru.ko 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_koi8-u.ko 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_utf8.ko 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/cluster 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlm 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-27T09:54:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlmfs 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2.ko 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/overlayfs 2023-03-27T09:54:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/overlayfs/overlay.ko 2023-03-27T09:54:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/pstore 2023-03-27T09:54:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/pstore/ramoops.ko 2023-03-27T09:54:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/reiserfs 2023-03-27T09:54:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/reiserfs/reiserfs.ko 2023-03-27T09:54:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/romfs 2023-03-27T09:54:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/romfs/romfs.ko 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/smbfs_common 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/squashfs 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/squashfs/squashfs.ko 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/sysv 2023-03-27T09:54:07.997 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/sysv/sysv.ko 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/udf 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/udf/udf.ko 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ufs 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ufs/ufs.ko 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/xfs 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/xfs/xfs.ko 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel 2023-03-27T09:54:07.998 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/rcu 2023-03-27T09:54:07.999 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/rcu/rcutorture.ko 2023-03-27T09:54:07.999 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/torture.ko 2023-03-27T09:54:07.999 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/trace 2023-03-27T09:54:07.999 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-03-27T09:54:07.999 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib 2023-03-27T09:54:07.999 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/asn1_encoder.ko 2023-03-27T09:54:08.000 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crc-itu-t.ko 2023-03-27T09:54:08.000 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crc8.ko 2023-03-27T09:54:08.000 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crypto 2023-03-27T09:54:08.000 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crypto/libarc4.ko 2023-03-27T09:54:08.000 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crypto/libdes.ko 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/libcrc32c.ko 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lru_cache.ko 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lz4 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lz4/lz4_compress.ko 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lz4/lz4hc_compress.ko 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/math 2023-03-27T09:54:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/math/cordic.ko 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/raid6 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/raid6/raid6_pq.ko 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/reed_solomon 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/ts_bm.ko 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/ts_fsm.ko 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/ts_kmp.ko 2023-03-27T09:54:08.002 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/zstd 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/zstd/zstd_compress.ko 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/mm 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/mm/hwpoison-inject.ko 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/6lowpan.ko 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_dest.ko 2023-03-27T09:54:08.003 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_fragment.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_hop.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_mobility.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_routing.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_udp.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/garp.ko 2023-03-27T09:54:08.004 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/mrp.ko 2023-03-27T09:54:08.005 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/p8022.ko 2023-03-27T09:54:08.005 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/psnap.ko 2023-03-27T09:54:08.005 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/stp.ko 2023-03-27T09:54:08.005 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/8021q 2023-03-27T09:54:08.005 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/8021q/8021q.ko 2023-03-27T09:54:08.005 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet.ko 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet_fd.ko 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet_rdma.ko 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet_virtio.ko 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/batman-adv 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/batman-adv/batman-adv.ko 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge 2023-03-27T09:54:08.006 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/br_netfilter.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/bridge.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-27T09:54:08.007 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-27T09:54:08.008 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-27T09:54:08.009 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-27T09:54:08.009 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-27T09:54:08.009 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-27T09:54:08.009 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-27T09:54:08.009 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-27T09:54:08.009 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtables.ko 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ceph 2023-03-27T09:54:08.010 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ceph/libceph.ko 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/core 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/core/failover.ko 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/core/pktgen.ko 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp.ko 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp_diag.ko 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp_ipv4.ko 2023-03-27T09:54:08.011 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp_ipv6.ko 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dns_resolver 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dns_resolver/dns_resolver.ko 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/dsa_core.ko 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_brcm.ko 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_dsa.ko 2023-03-27T09:54:08.012 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_none.ko 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_trailer.ko 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/6lowpan 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/ieee802154.ko 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-27T09:54:08.013 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ah4.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/esp4.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/fou.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/gre.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/inet_diag.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ip_gre.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ip_tunnel.ko 2023-03-27T09:54:08.014 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ip_vti.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ipcomp.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ipip.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-27T09:54:08.015 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-27T09:54:08.016 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-27T09:54:08.017 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-27T09:54:08.017 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-27T09:54:08.017 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-27T09:54:08.017 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-27T09:54:08.017 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-27T09:54:08.017 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_bic.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_dctcp.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_diag.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_highspeed.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_htcp.ko 2023-03-27T09:54:08.018 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_hybla.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_illinois.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_lp.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_scalable.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_vegas.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_veno.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_westwood.ko 2023-03-27T09:54:08.019 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_yeah.ko 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tunnel4.ko 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/udp_diag.ko 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/udp_tunnel.ko 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ah6.ko 2023-03-27T09:54:08.020 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/esp6.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/fou6.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ip6_tunnel.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ip6_vti.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ipcomp6.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-27T09:54:08.021 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-27T09:54:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-27T09:54:08.023 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-27T09:54:08.024 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/sit.ko 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/tunnel6.ko 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/key 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/key/af_key.ko 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_core.ko 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-27T09:54:08.025 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_eth.ko 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_ip.ko 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_ip6.ko 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_netlink.ko 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_ppp.ko 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/llc 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/llc/llc.ko 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mac802154 2023-03-27T09:54:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mac802154/mac802154.ko 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mpls 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mpls/mpls_gso.ko 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set.ko 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-27T09:54:08.027 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-27T09:54:08.028 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-27T09:54:08.029 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-27T09:54:08.030 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conncount.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack.ko 2023-03-27T09:54:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-27T09:54:08.032 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_flow_table.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-27T09:54:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_log_syslog.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_irc.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_sip.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-27T09:54:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_tables.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_log.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_chain_nat.ko 2023-03-27T09:54:08.035 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_compat.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_ct.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_fib.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_hash.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_limit.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_log.ko 2023-03-27T09:54:08.036 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_masq.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_nat.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_numgen.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_queue.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_quota.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_redir.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_reject.ko 2023-03-27T09:54:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_reject_inet.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_socket.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_tunnel.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_AUDIT.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CT.ko 2023-03-27T09:54:08.038 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_DSCP.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_HL.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_HMARK.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_LED.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_LOG.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-27T09:54:08.039 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_NETMAP.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_NFLOG.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_RATEEST.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_SECMARK.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-27T09:54:08.040 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TEE.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TPROXY.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TRACE.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_addrtype.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_bpf.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_cgroup.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_cluster.ko 2023-03-27T09:54:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_comment.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connbytes.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connlabel.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connlimit.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connmark.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_conntrack.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_cpu.ko 2023-03-27T09:54:08.042 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_dccp.ko 2023-03-27T09:54:08.043 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_devgroup.ko 2023-03-27T09:54:08.043 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_dscp.ko 2023-03-27T09:54:08.043 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_ecn.ko 2023-03-27T09:54:08.043 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_esp.ko 2023-03-27T09:54:08.044 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_hashlimit.ko 2023-03-27T09:54:08.044 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_helper.ko 2023-03-27T09:54:08.044 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_hl.ko 2023-03-27T09:54:08.045 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_ipcomp.ko 2023-03-27T09:54:08.045 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_iprange.ko 2023-03-27T09:54:08.045 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_ipvs.ko 2023-03-27T09:54:08.046 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_l2tp.ko 2023-03-27T09:54:08.046 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_length.ko 2023-03-27T09:54:08.046 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_limit.ko 2023-03-27T09:54:08.046 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_mac.ko 2023-03-27T09:54:08.047 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_mark.ko 2023-03-27T09:54:08.047 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_multiport.ko 2023-03-27T09:54:08.047 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_nat.ko 2023-03-27T09:54:08.047 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_nfacct.ko 2023-03-27T09:54:08.047 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_osf.ko 2023-03-27T09:54:08.048 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_owner.ko 2023-03-27T09:54:08.048 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_physdev.ko 2023-03-27T09:54:08.048 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_pkttype.ko 2023-03-27T09:54:08.048 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_policy.ko 2023-03-27T09:54:08.049 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_quota.ko 2023-03-27T09:54:08.049 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_rateest.ko 2023-03-27T09:54:08.049 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_realm.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_recent.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_sctp.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_set.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_socket.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_state.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_statistic.ko 2023-03-27T09:54:08.050 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_string.ko 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_tcpmss.ko 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_time.ko 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_u32.ko 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netlink 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netlink/netlink_diag.ko 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/nsh 2023-03-27T09:54:08.051 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/nsh/nsh.ko 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/openvswitch.ko 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/vport-geneve.ko 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/vport-gre.ko 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/vport-vxlan.ko 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/packet 2023-03-27T09:54:08.052 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/packet/af_packet_diag.ko 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds/rds.ko 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds/rds_rdma.ko 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds/rds_tcp.ko 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_csum.ko 2023-03-27T09:54:08.053 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_gact.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_ipt.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_mirred.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_nat.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_pedit.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_police.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_simple.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_skbedit.ko 2023-03-27T09:54:08.054 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_vlan.ko 2023-03-27T09:54:08.055 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_basic.ko 2023-03-27T09:54:08.055 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_bpf.ko 2023-03-27T09:54:08.055 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_flow.ko 2023-03-27T09:54:08.055 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_fw.ko 2023-03-27T09:54:08.056 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_route.ko 2023-03-27T09:54:08.056 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_u32.ko 2023-03-27T09:54:08.056 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_cmp.ko 2023-03-27T09:54:08.056 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_ipset.ko 2023-03-27T09:54:08.057 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_meta.ko 2023-03-27T09:54:08.057 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_nbyte.ko 2023-03-27T09:54:08.057 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_text.ko 2023-03-27T09:54:08.057 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_u32.ko 2023-03-27T09:54:08.058 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_choke.ko 2023-03-27T09:54:08.058 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_codel.ko 2023-03-27T09:54:08.058 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_drr.ko 2023-03-27T09:54:08.059 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_fq.ko 2023-03-27T09:54:08.059 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_gred.ko 2023-03-27T09:54:08.059 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_hfsc.ko 2023-03-27T09:54:08.059 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_hhf.ko 2023-03-27T09:54:08.060 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_htb.ko 2023-03-27T09:54:08.060 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_ingress.ko 2023-03-27T09:54:08.060 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_mqprio.ko 2023-03-27T09:54:08.060 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_mqprio_lib.ko 2023-03-27T09:54:08.061 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_multiq.ko 2023-03-27T09:54:08.061 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_netem.ko 2023-03-27T09:54:08.061 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_pie.ko 2023-03-27T09:54:08.061 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_plug.ko 2023-03-27T09:54:08.062 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_prio.ko 2023-03-27T09:54:08.062 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_qfq.ko 2023-03-27T09:54:08.062 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_red.ko 2023-03-27T09:54:08.062 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_sfb.ko 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_sfq.ko 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_tbf.ko 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_teql.ko 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sctp 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sctp/sctp.ko 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sctp/sctp_diag.ko 2023-03-27T09:54:08.063 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/auth_gss 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/sunrpc.ko 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/xprtrdma 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/tipc 2023-03-27T09:54:08.064 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/tipc/diag.ko 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/tipc/tipc.ko 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/unix 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/unix/unix_diag.ko 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-27T09:54:08.065 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vsock.ko 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/xfrm 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/encrypted-keys 2023-03-27T09:54:08.066 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/trusted-keys 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/trusted-keys/trusted.ko 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/virt 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/virt/lib 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/virt/lib/irqbypass.ko 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.alias 2023-03-27T09:54:08.067 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.alias.bin 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.builtin 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.builtin.bin 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.builtin.modinfo 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.dep 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.dep.bin 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.devname 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.order 2023-03-27T09:54:08.068 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.softdep 2023-03-27T09:54:08.069 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.symbols 2023-03-27T09:54:08.069 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.symbols.bin 2023-03-27T09:54:08.070 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:08.070 DEBUG:teuthology.orchestra.run.smithi172:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-03-27T09:54:08.098 INFO:teuthology.orchestra.run.smithi172.stdout:postinstall scriptlet (using /bin/sh): 2023-03-27T09:54:08.098 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 -a -r /boot/System.map-6.3.0-rc3-g1776e8f494e9 ]; then 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:cp /boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 /boot/.vmlinuz-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:cp /boot/System.map-6.3.0-rc3-g1776e8f494e9 /boot/.System.map-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:rm -f /boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 /boot/System.map-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:/sbin/installkernel 6.3.0-rc3-g1776e8f494e9 /boot/.vmlinuz-6.3.0-rc3-g1776e8f494e9-rpm /boot/.System.map-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:rm -f /boot/.vmlinuz-6.3.0-rc3-g1776e8f494e9-rpm /boot/.System.map-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2023-03-27T09:54:08.099 INFO:teuthology.orchestra.run.smithi172.stdout:preuninstall scriptlet (using /bin/sh): 2023-03-27T09:54:08.100 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-03-27T09:54:08.100 INFO:teuthology.orchestra.run.smithi172.stdout:new-kernel-pkg --remove 6.3.0-rc3-g1776e8f494e9 --rminitrd --initrdfile=/boot/initramfs-6.3.0-rc3-g1776e8f494e9.img 2023-03-27T09:54:08.100 INFO:teuthology.orchestra.run.smithi172.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-03-27T09:54:08.100 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-install remove 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:08.100 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2023-03-27T09:54:08.100 INFO:teuthology.orchestra.run.smithi172.stdout:postuninstall scriptlet (using /bin/sh): 2023-03-27T09:54:08.101 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /sbin/update-bootloader ]; then 2023-03-27T09:54:08.101 INFO:teuthology.orchestra.run.smithi172.stdout:/sbin/update-bootloader --remove 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:08.101 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2023-03-27T09:54:08.102 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2023-03-27T09:54:08.182 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2023-03-27T09:54:08.182 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2023-03-27T09:54:08.183 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.02 2023-03-27T09:54:08.183 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 129.el8 2023-03-27T09:54:08.183 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2023-03-27T09:54:08.183 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-03-27T09:54:08.184 INFO:teuthology.orchestra.run.smithi172.stdout:Group : System Environment/Base 2023-03-27T09:54:08.184 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 9265586 2023-03-27T09:54:08.184 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2023-03-27T09:54:08.184 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-03-27T09:54:08.185 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-03-27T09:54:08.185 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-03-27T09:54:08.185 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : kbuilder.bsys.centos.org 2023-03-27T09:54:08.186 INFO:teuthology.orchestra.run.smithi172.stdout:Relocations : (not relocatable) 2023-03-27T09:54:08.186 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : CentOS BuildSystem 2023-03-27T09:54:08.186 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2023-03-27T09:54:08.187 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2023-03-27T09:54:08.187 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2023-03-27T09:54:08.187 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2023-03-27T09:54:08.187 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T09:54:08.188 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-03-27T09:54:08.188 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2023-03-27T09:54:08.188 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2023-03-27T09:54:08.189 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2023-03-27T09:54:08.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T09:54:08.189 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2023-03-27T09:54:08.190 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-03-27T09:54:08.191 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:08.191 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-03-27T09:54:11.098 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2023-03-27T09:54:12.954 INFO:teuthology.orchestra.run.smithi172.stderr:done 2023-03-27T09:54:12.955 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-03-27T09:54:12.979 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.Wv848CKYGS 2023-03-27T09:54:12.980 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Wv848CKYGS 2023-03-27T09:54:13.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.Wv848CKYGS 2023-03-27T09:54:13.210 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.Wv848CKYGS is 6KB 2023-03-27T09:54:13.231 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.Wv848CKYGS 2023-03-27T09:54:13.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2023-03-27T09:54:13.314 INFO:teuthology.orchestra.run.smithi172.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-03-27T09:54:13.315 INFO:teuthology.orchestra.run.smithi172.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-03-27T09:54:13.315 INFO:teuthology.orchestra.run.smithi172.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-03-27T09:54:13.315 INFO:teuthology.orchestra.run.smithi172.stdout:2ff282740cf84d4fa02ff60ed95fbbff-6.3.0-rc3-g1776e8f494e9.conf 2023-03-27T09:54:13.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:13.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2023-03-27T09:54:18.152 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-03-27T09:54:18.153 DEBUG:teuthology.orchestra.run.smithi191:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-03-27T09:54:18.208 INFO:teuthology.orchestra.run.smithi191.stdout:/boot/System.map-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.208 INFO:teuthology.orchestra.run.smithi191.stdout:/boot/config-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.209 INFO:teuthology.orchestra.run.smithi191.stdout:/boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.209 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.209 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel 2023-03-27T09:54:18.210 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch 2023-03-27T09:54:18.210 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86 2023-03-27T09:54:18.210 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto 2023-03-27T09:54:18.210 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-03-27T09:54:18.211 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-03-27T09:54:18.211 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-03-27T09:54:18.211 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-03-27T09:54:18.212 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-03-27T09:54:18.212 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-03-27T09:54:18.212 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-03-27T09:54:18.212 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/crc32c-intel.ko 2023-03-27T09:54:18.213 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-03-27T09:54:18.213 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-03-27T09:54:18.213 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-03-27T09:54:18.214 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-03-27T09:54:18.214 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/serpent-avx2.ko 2023-03-27T09:54:18.214 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-03-27T09:54:18.214 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-03-27T09:54:18.214 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-03-27T09:54:18.215 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-03-27T09:54:18.215 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-03-27T09:54:18.215 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-03-27T09:54:18.215 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-03-27T09:54:18.216 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel 2023-03-27T09:54:18.216 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel/cpu 2023-03-27T09:54:18.216 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel/cpu/mce 2023-03-27T09:54:18.216 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-03-27T09:54:18.217 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm 2023-03-27T09:54:18.217 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm/kvm-amd.ko 2023-03-27T09:54:18.217 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm/kvm-intel.ko 2023-03-27T09:54:18.217 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/arch/x86/kvm/kvm.ko 2023-03-27T09:54:18.217 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/ansi_cprng.ko 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/anubis.ko 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/arc4.ko 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_memcpy.ko 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_pq.ko 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_raid6_recov.ko 2023-03-27T09:54:18.218 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_tx.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/async_xor.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/async_tx/raid6test.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/authenc.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/authencesn.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/blake2b_generic.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/blowfish_common.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/blowfish_generic.ko 2023-03-27T09:54:18.219 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/camellia_generic.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cast5_generic.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cast6_generic.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cast_common.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/ccm.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cmac.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/crc32_generic.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/crypto_engine.ko 2023-03-27T09:54:18.220 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/crypto_user.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/cts.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/des_generic.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/dh_generic.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/echainiv.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/essiv.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/fcrypt.ko 2023-03-27T09:54:18.221 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/khazad.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/lz4.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/lz4hc.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/md4.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/michael_mic.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/pcbc.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/pcrypt.ko 2023-03-27T09:54:18.222 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/rmd160.ko 2023-03-27T09:54:18.223 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/seed.ko 2023-03-27T09:54:18.223 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/serpent_generic.ko 2023-03-27T09:54:18.223 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/tcrypt.ko 2023-03-27T09:54:18.223 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/tea.ko 2023-03-27T09:54:18.223 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/twofish_common.ko 2023-03-27T09:54:18.223 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/twofish_generic.ko 2023-03-27T09:54:18.224 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/vmac.ko 2023-03-27T09:54:18.224 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/wp512.ko 2023-03-27T09:54:18.224 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/xcbc.ko 2023-03-27T09:54:18.224 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/xor.ko 2023-03-27T09:54:18.225 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/crypto/xxhash_generic.ko 2023-03-27T09:54:18.225 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers 2023-03-27T09:54:18.225 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi 2023-03-27T09:54:18.226 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/acpi_ipmi.ko 2023-03-27T09:54:18.226 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/acpi_pad.ko 2023-03-27T09:54:18.226 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/custom_method.ko 2023-03-27T09:54:18.226 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/ec_sys.ko 2023-03-27T09:54:18.227 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/platform_profile.ko 2023-03-27T09:54:18.227 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/sbs.ko 2023-03-27T09:54:18.227 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/sbshc.ko 2023-03-27T09:54:18.227 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/acpi/video.ko 2023-03-27T09:54:18.228 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata 2023-03-27T09:54:18.228 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/acard-ahci.ko 2023-03-27T09:54:18.228 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/ahci_platform.ko 2023-03-27T09:54:18.229 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/ata_generic.ko 2023-03-27T09:54:18.229 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/libahci_platform.ko 2023-03-27T09:54:18.229 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_acpi.ko 2023-03-27T09:54:18.229 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ali.ko 2023-03-27T09:54:18.230 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_amd.ko 2023-03-27T09:54:18.230 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_artop.ko 2023-03-27T09:54:18.230 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_atiixp.ko 2023-03-27T09:54:18.231 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_atp867x.ko 2023-03-27T09:54:18.231 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_cmd640.ko 2023-03-27T09:54:18.231 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_cmd64x.ko 2023-03-27T09:54:18.231 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_cypress.ko 2023-03-27T09:54:18.231 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_efar.ko 2023-03-27T09:54:18.232 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt366.ko 2023-03-27T09:54:18.232 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt37x.ko 2023-03-27T09:54:18.232 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt3x2n.ko 2023-03-27T09:54:18.232 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_hpt3x3.ko 2023-03-27T09:54:18.232 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_it8213.ko 2023-03-27T09:54:18.233 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_it821x.ko 2023-03-27T09:54:18.233 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_jmicron.ko 2023-03-27T09:54:18.233 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_marvell.ko 2023-03-27T09:54:18.234 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_mpiix.ko 2023-03-27T09:54:18.234 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_netcell.ko 2023-03-27T09:54:18.234 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ninja32.ko 2023-03-27T09:54:18.234 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ns87410.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_ns87415.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_oldpiix.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_opti.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_optidma.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_pcmcia.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_pdc2027x.ko 2023-03-27T09:54:18.235 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_piccolo.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_rdc.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sch.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_serverworks.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sil680.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sis.ko 2023-03-27T09:54:18.236 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_sl82c105.ko 2023-03-27T09:54:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_triflex.ko 2023-03-27T09:54:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pata_via.ko 2023-03-27T09:54:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/pdc_adma.ko 2023-03-27T09:54:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_inic162x.ko 2023-03-27T09:54:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_mv.ko 2023-03-27T09:54:18.237 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_nv.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_promise.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_qstor.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sil.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sil24.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sis.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_svw.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_sx4.ko 2023-03-27T09:54:18.238 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_uli.ko 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_via.ko 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ata/sata_vsc.ko 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/auxdisplay 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/auxdisplay/ks0108.ko 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/base 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/base/regmap 2023-03-27T09:54:18.239 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/base/regmap/regmap-i2c.ko 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/bcma 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/bcma/bcma.ko 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/aoe 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/aoe/aoe.ko 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/brd.ko 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/drbd 2023-03-27T09:54:18.240 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/drbd/drbd.ko 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/floppy.ko 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/loop.ko 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/mtip32xx 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/nbd.ko 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/null_blk 2023-03-27T09:54:18.241 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/null_blk/null_blk.ko 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/pktcdvd.ko 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/rbd.ko 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/virtio_blk.ko 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/xen-blkback 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/xen-blkfront.ko 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/zram 2023-03-27T09:54:18.242 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/block/zram/zram.ko 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hangcheck-timer.ko 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/amd-rng.ko 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/intel-rng.ko 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-03-27T09:54:18.243 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/via-rng.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/hw_random/virtio-rng.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_si.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-03-27T09:54:18.244 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/lp.ko 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/mwave 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/mwave/mwave.ko 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/pcmcia 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-03-27T09:54:18.245 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/ppdev.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tlclk.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_atmel.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_infineon.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_nsc.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_tis.ko 2023-03-27T09:54:18.246 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/uv_mmtimer.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/char/virtio_console.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/p4-clockmod.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-03-27T09:54:18.247 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/powernow-k8.ko 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/cpufreq/speedstep-lib.ko 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/ccp 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/ccp/ccp.ko 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/padlock-aes.ko 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/padlock-sha.ko 2023-03-27T09:54:18.248 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_common 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_dh895xcc 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/virtio 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-03-27T09:54:18.249 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dca 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dca/dca.ko 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/devfreq 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/dw 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/dw/dw_dmac.ko 2023-03-27T09:54:18.250 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/ioat 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/dma/ioat/ioatdma.ko 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/amd64_edac.ko 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/e752x_edac.ko 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/edac_mce_amd.ko 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i3000_edac.ko 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i3200_edac.ko 2023-03-27T09:54:18.251 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i5100_edac.ko 2023-03-27T09:54:18.252 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i5400_edac.ko 2023-03-27T09:54:18.252 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i7300_edac.ko 2023-03-27T09:54:18.252 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i7core_edac.ko 2023-03-27T09:54:18.252 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/i82975x_edac.ko 2023-03-27T09:54:18.252 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/ie31200_edac.ko 2023-03-27T09:54:18.252 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/sb_edac.ko 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/edac/x38_edac.ko 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/firmware 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/firmware/edd.ko 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/firmware/iscsi_ibft.ko 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/gpio 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/gpio/gpio-ich.ko 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/gpio/gpio-viperboard.ko 2023-03-27T09:54:18.253 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-appleir.ko 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-aureal.ko 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-axff.ko 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-dr.ko 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-elecom.ko 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-elo.ko 2023-03-27T09:54:18.254 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-emsff.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-gaff.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-gt683r.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-gyration.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-holtek-kbd.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-holtek-mouse.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-holtekff.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-hyperv.ko 2023-03-27T09:54:18.255 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-icade.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-keytouch.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-kye.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-lcpower.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-led.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-lenovo.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-logitech-dj.ko 2023-03-27T09:54:18.256 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-multitouch.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-ortek.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-penmount.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-petalynx.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-picolcd.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-pl.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-plantronics.ko 2023-03-27T09:54:18.257 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-primax.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-rmi.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-arvo.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-common.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-isku.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-kone.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-konepure.ko 2023-03-27T09:54:18.258 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-lua.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-pyra.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-ryos.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat-savu.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-roccat.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-saitek.ko 2023-03-27T09:54:18.259 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-samsung.ko 2023-03-27T09:54:18.260 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sensor-hub.ko 2023-03-27T09:54:18.260 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sjoy.ko 2023-03-27T09:54:18.260 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sony.ko 2023-03-27T09:54:18.260 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-speedlink.ko 2023-03-27T09:54:18.260 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-steelseries.ko 2023-03-27T09:54:18.260 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-sunplus.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-thrustmaster.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-tivo.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-tmff.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-topseed.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-twinhan.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-uclogic.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-waltop.ko 2023-03-27T09:54:18.261 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-wiimote.ko 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-xinmo.ko 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-zpff.ko 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/hid-zydacron.ko 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/uhid.ko 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hid/wacom.ko 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv 2023-03-27T09:54:18.262 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv/hv_balloon.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv/hv_utils.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hv/hv_vmbus.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/abituguru.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/abituguru3.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/acpi_power_meter.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ad7414.ko 2023-03-27T09:54:18.263 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ad7418.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adc128d818.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1025.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1026.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1029.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm1031.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adm9240.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ads7828.ko 2023-03-27T09:54:18.264 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7410.ko 2023-03-27T09:54:18.265 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7411.ko 2023-03-27T09:54:18.265 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7462.ko 2023-03-27T09:54:18.265 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7470.ko 2023-03-27T09:54:18.265 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7475.ko 2023-03-27T09:54:18.265 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/adt7x10.ko 2023-03-27T09:54:18.265 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/amc6821.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/applesmc.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/asb100.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/asc7621.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/asus_atk0110.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/atxp1.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/coretemp.ko 2023-03-27T09:54:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/dme1737.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ds1621.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ds620.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/emc1403.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/emc6w201.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/f71805f.ko 2023-03-27T09:54:18.267 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/f71882fg.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/f75375s.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/fam15h_power.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/fschmd.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/g760a.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/g762.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/gl518sm.ko 2023-03-27T09:54:18.268 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/gl520sm.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/hwmon-vid.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/i5500_temp.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/i5k_amb.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ibmaem.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ibmpex.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ina209.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ina2xx.ko 2023-03-27T09:54:18.269 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/it87.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/k10temp.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/k8temp.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lineage-pem.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm63.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm73.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm75.ko 2023-03-27T09:54:18.270 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm77.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm78.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm80.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm83.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm85.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm87.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm90.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm92.ko 2023-03-27T09:54:18.271 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm93.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm95234.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm95241.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/lm95245.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc2945.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4151.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4215.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4222.ko 2023-03-27T09:54:18.272 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4245.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4260.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/ltc4261.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max16065.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max1619.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max1668.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max197.ko 2023-03-27T09:54:18.273 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max6639.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max6650.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/max6697.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/mcp3021.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct6683.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct6775-core.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct6775.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/nct7802.ko 2023-03-27T09:54:18.274 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pc87360.ko 2023-03-27T09:54:18.275 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pc87427.ko 2023-03-27T09:54:18.275 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pcf8591.ko 2023-03-27T09:54:18.275 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus 2023-03-27T09:54:18.275 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-03-27T09:54:18.275 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-03-27T09:54:18.275 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-03-27T09:54:18.276 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/max16064.ko 2023-03-27T09:54:18.276 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/max34440.ko 2023-03-27T09:54:18.276 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/max8688.ko 2023-03-27T09:54:18.276 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-03-27T09:54:18.276 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-03-27T09:54:18.276 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-03-27T09:54:18.277 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-03-27T09:54:18.277 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-03-27T09:54:18.277 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-03-27T09:54:18.277 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/powr1220.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sch5627.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sch5636.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sch56xx-common.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sht15.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sht21.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/shtc1.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/sis5595.ko 2023-03-27T09:54:18.278 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/smsc47b397.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/smsc47m1.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/smsc47m192.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/thmc50.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp102.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp103.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp401.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/tmp421.ko 2023-03-27T09:54:18.279 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/via-cputemp.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/via686a.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/vt1211.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/vt8231.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83627ehf.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83627hf.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83781d.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83791d.ko 2023-03-27T09:54:18.280 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83792d.ko 2023-03-27T09:54:18.281 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83793.ko 2023-03-27T09:54:18.281 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83795.ko 2023-03-27T09:54:18.281 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83l785ts.ko 2023-03-27T09:54:18.281 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/hwmon/w83l786ng.ko 2023-03-27T09:54:18.281 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c 2023-03-27T09:54:18.281 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/algos 2023-03-27T09:54:18.282 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-03-27T09:54:18.282 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-03-27T09:54:18.282 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses 2023-03-27T09:54:18.282 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-03-27T09:54:18.283 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-03-27T09:54:18.283 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-03-27T09:54:18.283 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-i801.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-isch.ko 2023-03-27T09:54:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-parport.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-03-27T09:54:18.285 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-via.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-dev.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-mux.ko 2023-03-27T09:54:18.286 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-smbus.ko 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/i2c/i2c-stub.ko 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_cm.ko 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_core.ko 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_umad.ko 2023-03-27T09:54:18.287 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/iw_cm.ko 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/rdma_cm.ko 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/cxgb4 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx4 2023-03-27T09:54:18.288 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx5 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mthca 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/ipoib 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-03-27T09:54:18.289 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/iser 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/isert 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srp 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srpt 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-03-27T09:54:18.290 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/fm801-gp.ko 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/gameport.ko 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/lightning.ko 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/gameport/ns558.ko 2023-03-27T09:54:18.291 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/joydev.ko 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/keyboard 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/keyboard/gpio_keys.ko 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/appletouch.ko 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/bcm5974.ko 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/cyapatp.ko 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/elan_i2c.ko 2023-03-27T09:54:18.292 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/sermouse.ko 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/synaptics_usb.ko 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/mouse/vsxxxaa.ko 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/rmi4 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/rmi4/rmi_core.ko 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/altera_ps2.ko 2023-03-27T09:54:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/arc_ps2.ko 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/serio/serio_raw.ko 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/input/sparse-keymap.ko 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/iommu 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/iommu/amd 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/iommu/amd/iommu_v2.ko 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds 2023-03-27T09:54:18.294 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-blinkm.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-lm3530.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-lp3944.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/leds-ss4200.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-03-27T09:54:18.295 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/bcache 2023-03-27T09:54:18.296 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/bcache/bcache.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-bio-prison.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-cache-smq.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-cache.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-crypt.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-delay.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-flakey.ko 2023-03-27T09:54:18.297 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-log-userspace.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-multipath.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-queue-length.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-raid.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-round-robin.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-service-time.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-switch.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-thin-pool.ko 2023-03-27T09:54:18.298 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/dm-verity.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/faulty.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/linear.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/multipath.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/persistent-data 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid0.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid1.ko 2023-03-27T09:54:18.299 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid10.ko 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/md/raid456.ko 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptbase.ko 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptctl.ko 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptfc.ko 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptlan.ko 2023-03-27T09:54:18.300 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptsas.ko 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptscsih.ko 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/message/fusion/mptspi.ko 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/lpc_ich.ko 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/lpc_sch.ko 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/mfd-core.ko 2023-03-27T09:54:18.301 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/sm501.ko 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/viperboard.ko 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/vx855.ko 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/mfd/wl1273-core.ko 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/altera-stapl 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/apds9802als.ko 2023-03-27T09:54:18.302 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/apds990x.ko 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/bh1770glc.ko 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/cb710 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/cb710/cb710.ko 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/at24.ko 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/eeprom.ko 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-03-27T09:54:18.303 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/eeprom/max6875.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/enclosure.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/hpilo.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/isl29003.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/isl29020.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/lis3lv02d 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-03-27T09:54:18.304 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei/mei-me.ko 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei/mei-txe.ko 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/mei/mei.ko 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-gru 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-gru/gru.ko 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp 2023-03-27T09:54:18.305 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp/xp.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp/xpc.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/tifm_7xx1.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/tifm_core.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/tsl2550.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/vmw_balloon.ko 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/vmw_vmci 2023-03-27T09:54:18.306 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/bonding 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/bonding/bonding.ko 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/b53 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/b53/b53_common.ko 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/bcm-sf2.ko 2023-03-27T09:54:18.307 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/mv88e6060.ko 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/mv88e6xxx 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/dummy.ko 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/eql.ko 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-03-27T09:54:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/8390.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-03-27T09:54:18.309 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/adaptec 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/agere 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/agere/et131x.ko 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/alteon 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/altera 2023-03-27T09:54:18.310 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/alx 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-03-27T09:54:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1c 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1e 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atlx 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom 2023-03-27T09:54:18.312 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/genet 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-03-27T09:54:18.313 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/brocade 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/brocade/bna 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-03-27T09:54:18.314 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/cisco 2023-03-27T09:54:18.315 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/cisco/enic 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-03-27T09:54:18.316 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dlink 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/dnet.ko 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/emulex 2023-03-27T09:54:18.317 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/emulex/benet 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/ethoc.ko 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/fealnx.ko 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e100.ko 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-03-27T09:54:18.318 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000e 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/fm10k 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/i40e 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/iavf 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-03-27T09:54:18.319 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igb 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igbvf 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgb 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbe 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-03-27T09:54:18.320 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbevf 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/jme.ko 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell/skge.ko 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox 2023-03-27T09:54:18.321 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx4 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx5 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/micrel 2023-03-27T09:54:18.322 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/myricom 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/myricom/myri10ge 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/natsemi 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/neterion 2023-03-27T09:54:18.323 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/nvidia 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/packetengines 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/netxen 2023-03-27T09:54:18.324 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rdc 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-03-27T09:54:18.325 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/atp.ko 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rocker 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sfc 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-03-27T09:54:18.326 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/silan 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sis 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sis/sis190.ko 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sis/sis900.ko 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-03-27T09:54:18.327 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro/stmmac 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/cassini.ko 2023-03-27T09:54:18.328 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/niu.ko 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/sungem.ko 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/tehuti 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/ti 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/ti/tlan.ko 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/via 2023-03-27T09:54:18.329 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/wiznet 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/xircom 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/geneve.ko 2023-03-27T09:54:18.330 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/hyperv 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ieee802154 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ieee802154/fakelb.ko 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ifb.ko 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ipvlan 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ipvlan/ipvlan.ko 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/macvlan.ko 2023-03-27T09:54:18.331 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/macvtap.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/mii.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/net_failover.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/netconsole.ko 2023-03-27T09:54:18.332 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/nlmon.ko 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/pcs 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/amd.ko 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-03-27T09:54:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm7xxx.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/bcm87xx.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/broadcom.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/cicada.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/davicom.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/dp83640.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/et1011c.ko 2023-03-27T09:54:18.334 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/icplus.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/lxt.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/marvell.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/micrel.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/national.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/phylink.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/qsemi.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/realtek.ko 2023-03-27T09:54:18.335 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/smsc.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/ste10Xp.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/phy/vitesse.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/bsd_comp.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_async.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_deflate.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_generic.ko 2023-03-27T09:54:18.336 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_mppe.ko 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/ppp_synctty.ko 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/pppoe.ko 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/pppox.ko 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/ppp/pptp.ko 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/slip 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/slip/slhc.ko 2023-03-27T09:54:18.337 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/slip/slip.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/sungem_phy.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/tap.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_activebackup.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_broadcast.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-03-27T09:54:18.338 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_random.ko 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/tun.ko 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/veth.ko 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/virtio_net.ko 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vmxnet3 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vxlan 2023-03-27T09:54:18.339 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/vxlan/vxlan.ko 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/xen-netback 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/xen-netback/xen-netback.ko 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/net/xen-netfront.ko 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ntb 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ntb/ntb.ko 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme/host 2023-03-27T09:54:18.340 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme/host/nvme-core.ko 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/nvme/host/nvme.ko 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport.ko 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport_cs.ko 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport_pc.ko 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/parport/parport_serial.ko 2023-03-27T09:54:18.341 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/hotplug 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/pcie 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/pcie/aer_inject.ko 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pci/xen-pcifront.ko 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia/i82092.ko 2023-03-27T09:54:18.342 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia/pd6729.ko 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pcmcia/yenta_socket.ko 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pinctrl 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pinctrl/intel 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/acer-wmi.ko 2023-03-27T09:54:18.343 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/acerhdf.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/apple-gmux.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/asus-laptop.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/asus-wmi.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/classmate-laptop.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-03-27T09:54:18.344 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/hdaps.ko 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/intel 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/intel_ips.ko 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/msi-wmi.ko 2023-03-27T09:54:18.345 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/mxm-wmi.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/samsung-laptop.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/samsung-q10.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/topstar-laptop.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/toshiba_haps.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/wmi-bmof.ko 2023-03-27T09:54:18.346 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/platform/x86/wmi.ko 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/powercap 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/powercap/intel_rapl_common.ko 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/powercap/intel_rapl_msr.ko 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients/pps-gpio.ko 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients/pps-ldisc.ko 2023-03-27T09:54:18.347 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/clients/pps_parport.ko 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/pps/pps_core.ko 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ptp 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ptp/ptp.ko 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ptp/ptp_kvm.ko 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-bq32k.ko 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-bq4802.ko 2023-03-27T09:54:18.348 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1286.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1307.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1374.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1511.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1553.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1672.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds1742.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds2404.ko 2023-03-27T09:54:18.349 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-ds3232.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-em3027.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-fm3130.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-isl12022.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-isl1208.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-m41t80.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-m48t35.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-m48t59.ko 2023-03-27T09:54:18.350 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-max6900.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-msm6242.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf2127.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf85063.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf8523.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf8563.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-pcf8583.ko 2023-03-27T09:54:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rp5c01.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rs5c372.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rx8025.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-rx8581.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/rtc/rtc-x1205.ko 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi 2023-03-27T09:54:18.352 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/3w-9xxx.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/3w-sas.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/3w-xxxx.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/BusLogic.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/a100u2w.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aacraid 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aacraid/aacraid.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/advansys.ko 2023-03-27T09:54:18.353 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aic7xxx 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/am53c974.ko 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/arcmsr 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/atp870u.ko 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/be2iscsi 2023-03-27T09:54:18.354 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bfa 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bfa/bfa.ko 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2fc 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2i 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-03-27T09:54:18.355 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ch.ko 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/csiostor 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/csiostor/csiostor.ko 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb3i 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb4i 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-03-27T09:54:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/dc395x.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/dmx3191d.ko 2023-03-27T09:54:18.357 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/esas2r 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/esas2r/esas2r.ko 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/esp_scsi.ko 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fcoe 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fcoe/fcoe.ko 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fnic 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/fnic/fnic.ko 2023-03-27T09:54:18.358 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/hpsa.ko 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/hptiop.ko 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/hv_storvsc.ko 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/initio.ko 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ipr.ko 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ips.ko 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/isci 2023-03-27T09:54:18.359 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/isci/isci.ko 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/iscsi_tcp.ko 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libfc 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libfc/libfc.ko 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libiscsi.ko 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libiscsi_tcp.ko 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libsas 2023-03-27T09:54:18.360 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/libsas/libsas.ko 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/lpfc 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/lpfc/lpfc.ko 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid.ko 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-03-27T09:54:18.361 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mpt3sas 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mvsas 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mvsas/mvsas.ko 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/mvumi.ko 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/pm8001 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/pmcraid.ko 2023-03-27T09:54:18.362 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla1280.ko 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla2xxx 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla4xxx 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/raid_class.ko 2023-03-27T09:54:18.363 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_debug.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_fc.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_sas.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_spi.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/scsi_transport_srp.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/ses.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/st.ko 2023-03-27T09:54:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/stex.ko 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/sym53c8xx_2 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/virtio_scsi.ko 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/vmw_pvscsi.ko 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/scsi/wd719x.ko 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ssb 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ssb/ssb.ko 2023-03-27T09:54:18.365 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/iscsi 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/loopback 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/loopback/tcm_loop.ko 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_file.ko 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_iblock.ko 2023-03-27T09:54:18.366 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_mod.ko 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_pscsi.ko 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/target_core_user.ko 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/tcm_fc 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal 2023-03-27T09:54:18.367 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-03-27T09:54:18.368 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-03-27T09:54:18.369 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/ipwireless 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/n_gsm.ko 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/n_hdlc.ko 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/nozomi.ko 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/8250 2023-03-27T09:54:18.370 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/arc_uart.ko 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/jsm 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/serial/jsm/jsm.ko 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/tty/synclink_gt.ko 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/core 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/core/ufshcd-core.ko 2023-03-27T09:54:18.371 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/host 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio.ko 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_aec.ko 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_cif.ko 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_pci_generic.ko 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/uio/uio_sercos3.ko 2023-03-27T09:54:18.372 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/cdc-acm.ko 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/cdc-wdm.ko 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/usblp.ko 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/class/usbtmc.ko 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/host 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/host/sl811-hcd.ko 2023-03-27T09:54:18.373 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/host/u132-hcd.ko 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/image 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/image/mdc800.ko 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/image/microtek.ko 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/adutux.ko 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/appledisplay.ko 2023-03-27T09:54:18.374 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/emi26.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/emi62.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/ezusb.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/ftdi-elan.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/idmouse.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/iowarrior.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/isight_firmware.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/ldusb.ko 2023-03-27T09:54:18.375 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/legousbtower.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/sisusbvga 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/trancevibrator.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/usb3503.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/usblcd.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/usbsevseg.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/uss720.ko 2023-03-27T09:54:18.376 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/misc/yurex.ko 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/phy 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/phy/phy-generic.ko 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/aircable.ko 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ark3116.ko 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/belkin_sa.ko 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ch341.ko 2023-03-27T09:54:18.377 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/cp210x.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/cyberjack.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/cypress_m8.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/digi_acceleport.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/empeg.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ftdi_sio.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/garmin_gps.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/io_edgeport.ko 2023-03-27T09:54:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/io_ti.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ipaq.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ipw.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ir-usb.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/keyspan.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/keyspan_pda.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/kl5kusb105.ko 2023-03-27T09:54:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/kobil_sct.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/mct_u232.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/mos7720.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/mos7840.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/navman.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/omninet.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/opticon.ko 2023-03-27T09:54:18.380 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/option.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/oti6858.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/pl2303.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/qcaux.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/qcserial.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/quatech2.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/safe_serial.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/sierra.ko 2023-03-27T09:54:18.381 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/spcp8x5.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ssu100.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/symbolserial.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/usb_debug.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/usb_wwan.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/visor.ko 2023-03-27T09:54:18.382 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/whiteheat.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/serial/xsens_mt.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/uas.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-alauda.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-cypress.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-datafab.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-03-27T09:54:18.383 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-freecom.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-isd200.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-karma.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-onetouch.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-realtek.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-sddr09.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-sddr55.ko 2023-03-27T09:54:18.384 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/ums-usbat.ko 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/storage/usb-storage.ko 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip/usbip-core.ko 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip/usbip-host.ko 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio 2023-03-27T09:54:18.385 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/pci 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/pci/vfio-pci.ko 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/vfio.ko 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost.ko 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost_iotlb.ko 2023-03-27T09:54:18.386 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost_net.ko 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/vhost/vhost_scsi.ko 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight/apple_bl.ko 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight/lcd.ko 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/video/backlight/platform_lcd.ko 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio 2023-03-27T09:54:18.387 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_balloon.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_mmio.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_pci.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/virtio/virtio_ring.ko 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1 2023-03-27T09:54:18.388 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/masters 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/masters/ds2482.ko 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/masters/ds2490.ko 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-03-27T09:54:18.389 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_smem.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/slaves/w1_therm.ko 2023-03-27T09:54:18.390 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/w1/wire.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/alim1535_wdt.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/alim7101_wdt.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/f71808e_wdt.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/hpwdt.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/i6300esb.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-03-27T09:54:18.391 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/iTCO_wdt.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/ib700wdt.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/ibmasr.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/it8712f_wdt.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/it87_wdt.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/machzwd.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/nv_tco.ko 2023-03-27T09:54:18.392 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/pcwd_pci.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/pcwd_usb.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/sch311x_wdt.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/softdog.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/sp5100_tco.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/via_wdt.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-03-27T09:54:18.393 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/w83877f_wdt.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/w83977f_wdt.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/wdt_pci.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/watchdog/xen_wdt.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-acpi-processor.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-evtchn.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-gntalloc.ko 2023-03-27T09:54:18.394 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-gntdev.ko 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-pciback 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xen-privcmd.ko 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xenfs 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/drivers/xen/xenfs/xenfs.ko 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/9p 2023-03-27T09:54:18.395 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/9p/9p.ko 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/affs 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/affs/affs.ko 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/befs 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/befs/befs.ko 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/binfmt_misc.ko 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/btrfs 2023-03-27T09:54:18.396 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/btrfs/btrfs.ko 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cachefiles 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cachefiles/cachefiles.ko 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ceph 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ceph/ceph.ko 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cifs 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cifs/cifs.ko 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/coda 2023-03-27T09:54:18.397 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/coda/coda.ko 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cramfs 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/cramfs/cramfs.ko 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/dlm 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/dlm/dlm.ko 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ecryptfs 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ecryptfs/ecryptfs.ko 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/f2fs 2023-03-27T09:54:18.398 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/f2fs/f2fs.ko 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat/fat.ko 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat/msdos.ko 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fat/vfat.ko 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fscache 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fscache/fscache.ko 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fuse 2023-03-27T09:54:18.399 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fuse/cuse.ko 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/fuse/fuse.ko 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/gfs2 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/gfs2/gfs2.ko 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfs 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfs/hfs.ko 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfsplus 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/hfsplus/hfsplus.ko 2023-03-27T09:54:18.400 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/isofs 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/isofs/isofs.ko 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/jfs 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/jfs/jfs.ko 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/lockd 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/lockd/lockd.ko 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/minix 2023-03-27T09:54:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/minix/minix.ko 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/netfs 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/netfs/netfs.ko 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/blocklayout 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/filelayout 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-03-27T09:54:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/flexfilelayout 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/nfs.ko 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/nfsv3.ko 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs/nfsv4.ko 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs_common 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs_common/grace.ko 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfs_common/nfs_acl.ko 2023-03-27T09:54:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfsd 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nfsd/nfsd.ko 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nilfs2 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nilfs2/nilfs2.ko 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-celtic.ko 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-centeuro.ko 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-croatian.ko 2023-03-27T09:54:18.404 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-cyrillic.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-gaelic.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-greek.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-iceland.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-inuit.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-roman.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-romanian.ko 2023-03-27T09:54:18.405 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/mac-turkish.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp1250.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp1251.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp1255.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp737.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp775.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp850.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp852.ko 2023-03-27T09:54:18.406 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp855.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp857.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp860.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp861.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp862.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp863.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp864.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp865.ko 2023-03-27T09:54:18.407 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp866.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp869.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp874.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp932.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp936.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp949.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_cp950.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_euc-jp.ko 2023-03-27T09:54:18.408 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-1.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-13.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-14.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-15.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-2.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-3.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-4.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-5.ko 2023-03-27T09:54:18.409 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-6.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-7.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_iso8859-9.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_koi8-r.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_koi8-ru.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_koi8-u.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/nls/nls_utf8.ko 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2 2023-03-27T09:54:18.410 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/cluster 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlm 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlmfs 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2.ko 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-03-27T09:54:18.411 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/overlayfs 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/overlayfs/overlay.ko 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/pstore 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/pstore/ramoops.ko 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/reiserfs 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/reiserfs/reiserfs.ko 2023-03-27T09:54:18.412 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/romfs 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/romfs/romfs.ko 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/smbfs_common 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/smbfs_common/cifs_arc4.ko 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/smbfs_common/cifs_md4.ko 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/squashfs 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/squashfs/squashfs.ko 2023-03-27T09:54:18.413 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/sysv 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/sysv/sysv.ko 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/udf 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/udf/udf.ko 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ufs 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/ufs/ufs.ko 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/xfs 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/fs/xfs/xfs.ko 2023-03-27T09:54:18.414 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/rcu 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/rcu/rcutorture.ko 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/torture.ko 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/trace 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/asn1_encoder.ko 2023-03-27T09:54:18.415 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crc-itu-t.ko 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crc8.ko 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crypto 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crypto/libarc4.ko 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/crypto/libdes.ko 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/libcrc32c.ko 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lru_cache.ko 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lz4 2023-03-27T09:54:18.416 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lz4/lz4_compress.ko 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/lz4/lz4hc_compress.ko 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/math 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/math/cordic.ko 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/raid6 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/raid6/raid6_pq.ko 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/reed_solomon 2023-03-27T09:54:18.417 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/reed_solomon/reed_solomon.ko 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/ts_bm.ko 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/ts_fsm.ko 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/ts_kmp.ko 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/zstd 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/lib/zstd/zstd_compress.ko 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/mm 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/mm/hwpoison-inject.ko 2023-03-27T09:54:18.418 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/6lowpan.ko 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_dest.ko 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_fragment.ko 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_hop.ko 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_ipv6.ko 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_mobility.ko 2023-03-27T09:54:18.419 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_routing.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/6lowpan/nhc_udp.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/garp.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/mrp.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/p8022.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/psnap.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/802/stp.ko 2023-03-27T09:54:18.420 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/8021q 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/8021q/8021q.ko 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet.ko 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet_fd.ko 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet_rdma.ko 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/9p/9pnet_virtio.ko 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/batman-adv 2023-03-27T09:54:18.421 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/batman-adv/batman-adv.ko 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/br_netfilter.ko 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/bridge.ko 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_among.ko 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_arp.ko 2023-03-27T09:54:18.422 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_ip.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_limit.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_log.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_mark.ko 2023-03-27T09:54:18.423 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_snat.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_stp.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-03-27T09:54:18.424 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/ebtables.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ceph 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ceph/libceph.ko 2023-03-27T09:54:18.425 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/core 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/core/failover.ko 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/core/pktgen.ko 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp.ko 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp_diag.ko 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp_ipv4.ko 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dccp/dccp_ipv6.ko 2023-03-27T09:54:18.426 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dns_resolver 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dns_resolver/dns_resolver.ko 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/dsa_core.ko 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_brcm.ko 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_dsa.ko 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_none.ko 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/dsa/tag_trailer.ko 2023-03-27T09:54:18.427 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/6lowpan 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/ieee802154.ko 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ieee802154/ieee802154_socket.ko 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ah4.ko 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/esp4.ko 2023-03-27T09:54:18.428 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/fou.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/gre.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/inet_diag.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ip_gre.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ip_tunnel.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ip_vti.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ipcomp.ko 2023-03-27T09:54:18.429 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/ipip.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/arp_tables.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-03-27T09:54:18.430 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/iptable_security.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-03-27T09:54:18.431 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_bic.ko 2023-03-27T09:54:18.432 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_dctcp.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_diag.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_highspeed.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_htcp.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_hybla.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_illinois.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_lp.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_scalable.ko 2023-03-27T09:54:18.433 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_vegas.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_veno.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_westwood.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tcp_yeah.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/tunnel4.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/udp_diag.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/udp_tunnel.ko 2023-03-27T09:54:18.434 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv4/xfrm4_tunnel.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ah6.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/esp6.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/fou6.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ip6_tunnel.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ip6_vti.ko 2023-03-27T09:54:18.435 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/ipcomp6.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-03-27T09:54:18.436 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-03-27T09:54:18.437 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-03-27T09:54:18.438 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/sit.ko 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/tunnel6.ko 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/ipv6/xfrm6_tunnel.ko 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/key 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/key/af_key.ko 2023-03-27T09:54:18.439 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_core.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_debugfs.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_eth.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_ip.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_ip6.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_netlink.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/l2tp/l2tp_ppp.ko 2023-03-27T09:54:18.440 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/llc 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/llc/llc.ko 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mac802154 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mac802154/mac802154.ko 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mpls 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/mpls/mpls_gso.ko 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset 2023-03-27T09:54:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-03-27T09:54:18.442 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-03-27T09:54:18.443 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-03-27T09:54:18.444 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-03-27T09:54:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conncount.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_h323.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_irc.ko 2023-03-27T09:54:18.446 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_sane.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_sip.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_dup_netdev.ko 2023-03-27T09:54:18.447 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_flow_table.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_flow_table_inet.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_log_syslog.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_amanda.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_ftp.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_irc.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_sip.ko 2023-03-27T09:54:18.448 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_nat_tftp.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_synproxy_core.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nf_tables.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_acct.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_log.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_osf.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nfnetlink_queue.ko 2023-03-27T09:54:18.449 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_chain_nat.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_compat.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_ct.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_dup_netdev.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_fib.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_fwd_netdev.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_hash.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_limit.ko 2023-03-27T09:54:18.450 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_log.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_masq.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_nat.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_numgen.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_queue.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_quota.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_redir.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_reject.ko 2023-03-27T09:54:18.451 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_reject_inet.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_socket.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/nft_tunnel.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_AUDIT.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CHECKSUM.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CLASSIFY.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_CT.ko 2023-03-27T09:54:18.452 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_DSCP.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_HL.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_HMARK.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_IDLETIMER.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_LED.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_LOG.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_MASQUERADE.ko 2023-03-27T09:54:18.453 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_NETMAP.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_NFLOG.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_NFQUEUE.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_RATEEST.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_REDIRECT.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_SECMARK.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TCPMSS.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-03-27T09:54:18.454 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TEE.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TPROXY.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_TRACE.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_addrtype.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_bpf.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_cgroup.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_cluster.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_comment.ko 2023-03-27T09:54:18.455 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connbytes.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connlabel.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connlimit.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_connmark.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_conntrack.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_cpu.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_dccp.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_devgroup.ko 2023-03-27T09:54:18.456 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_dscp.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_ecn.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_esp.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_hashlimit.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_helper.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_hl.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_ipcomp.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_iprange.ko 2023-03-27T09:54:18.457 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_ipvs.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_l2tp.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_length.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_limit.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_mac.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_mark.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_multiport.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_nat.ko 2023-03-27T09:54:18.458 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_nfacct.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_osf.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_owner.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_physdev.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_pkttype.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_policy.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_quota.ko 2023-03-27T09:54:18.459 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_rateest.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_realm.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_recent.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_sctp.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_set.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_socket.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_state.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_statistic.ko 2023-03-27T09:54:18.460 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_string.ko 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_tcpmss.ko 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_time.ko 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netfilter/xt_u32.ko 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netlink 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/netlink/netlink_diag.ko 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/nsh 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/nsh/nsh.ko 2023-03-27T09:54:18.461 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/openvswitch.ko 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/vport-geneve.ko 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/vport-gre.ko 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/openvswitch/vport-vxlan.ko 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/packet 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/packet/af_packet_diag.ko 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds 2023-03-27T09:54:18.462 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds/rds.ko 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds/rds_rdma.ko 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/rds/rds_tcp.ko 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_csum.ko 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_gact.ko 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_ipt.ko 2023-03-27T09:54:18.463 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_mirred.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_nat.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_pedit.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_police.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_simple.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_skbedit.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/act_vlan.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_basic.ko 2023-03-27T09:54:18.464 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_bpf.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_flow.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_fw.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_route.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/cls_u32.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_cmp.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_ipset.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_meta.ko 2023-03-27T09:54:18.465 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_nbyte.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_text.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/em_u32.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_choke.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_codel.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_drr.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_fq.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_gred.ko 2023-03-27T09:54:18.466 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_hfsc.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_hhf.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_htb.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_ingress.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_mqprio.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_mqprio_lib.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_multiq.ko 2023-03-27T09:54:18.467 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_netem.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_pie.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_plug.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_prio.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_qfq.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_red.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_sfb.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_sfq.ko 2023-03-27T09:54:18.468 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_tbf.ko 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sched/sch_teql.ko 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sctp 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sctp/sctp.ko 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sctp/sctp_diag.ko 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/auth_gss 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-03-27T09:54:18.469 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/sunrpc.ko 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/xprtrdma 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/tipc 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/tipc/diag.ko 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/tipc/tipc.ko 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/unix 2023-03-27T09:54:18.470 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/unix/unix_diag.ko 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vsock.ko 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vsock_diag.ko 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/vmw_vsock/vsock_loopback.ko 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/xfrm 2023-03-27T09:54:18.471 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/net/xfrm/xfrm_ipcomp.ko 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/encrypted-keys 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/trusted-keys 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/security/keys/trusted-keys/trusted.ko 2023-03-27T09:54:18.472 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/virt 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/virt/lib 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/kernel/virt/lib/irqbypass.ko 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.alias 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.alias.bin 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.builtin 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.builtin.bin 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.builtin.modinfo 2023-03-27T09:54:18.473 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.dep 2023-03-27T09:54:18.474 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.dep.bin 2023-03-27T09:54:18.474 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.devname 2023-03-27T09:54:18.474 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.order 2023-03-27T09:54:18.474 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.softdep 2023-03-27T09:54:18.474 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.symbols 2023-03-27T09:54:18.474 INFO:teuthology.orchestra.run.smithi191.stdout:/lib/modules/6.3.0-rc3-g1776e8f494e9/modules.symbols.bin 2023-03-27T09:54:18.475 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.475 DEBUG:teuthology.orchestra.run.smithi191:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-03-27T09:54:18.501 INFO:teuthology.orchestra.run.smithi191.stdout:postinstall scriptlet (using /bin/sh): 2023-03-27T09:54:18.501 INFO:teuthology.orchestra.run.smithi191.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 -a -r /boot/System.map-6.3.0-rc3-g1776e8f494e9 ]; then 2023-03-27T09:54:18.501 INFO:teuthology.orchestra.run.smithi191.stdout:cp /boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 /boot/.vmlinuz-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:18.501 INFO:teuthology.orchestra.run.smithi191.stdout:cp /boot/System.map-6.3.0-rc3-g1776e8f494e9 /boot/.System.map-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:rm -f /boot/vmlinuz-6.3.0-rc3-g1776e8f494e9 /boot/System.map-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:/sbin/installkernel 6.3.0-rc3-g1776e8f494e9 /boot/.vmlinuz-6.3.0-rc3-g1776e8f494e9-rpm /boot/.System.map-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:rm -f /boot/.vmlinuz-6.3.0-rc3-g1776e8f494e9-rpm /boot/.System.map-6.3.0-rc3-g1776e8f494e9-rpm 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:fi 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:preuninstall scriptlet (using /bin/sh): 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:new-kernel-pkg --remove 6.3.0-rc3-g1776e8f494e9 --rminitrd --initrdfile=/boot/initramfs-6.3.0-rc3-g1776e8f494e9.img 2023-03-27T09:54:18.502 INFO:teuthology.orchestra.run.smithi191.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-03-27T09:54:18.503 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-install remove 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.503 INFO:teuthology.orchestra.run.smithi191.stdout:fi 2023-03-27T09:54:18.503 INFO:teuthology.orchestra.run.smithi191.stdout:postuninstall scriptlet (using /bin/sh): 2023-03-27T09:54:18.503 INFO:teuthology.orchestra.run.smithi191.stdout:if [ -x /sbin/update-bootloader ]; then 2023-03-27T09:54:18.503 INFO:teuthology.orchestra.run.smithi191.stdout:/sbin/update-bootloader --remove 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.503 INFO:teuthology.orchestra.run.smithi191.stdout:fi 2023-03-27T09:54:18.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo rpm -qi grub2-tools 2023-03-27T09:54:18.582 INFO:teuthology.orchestra.run.smithi191.stdout:Name : grub2-tools 2023-03-27T09:54:18.582 INFO:teuthology.orchestra.run.smithi191.stdout:Epoch : 1 2023-03-27T09:54:18.582 INFO:teuthology.orchestra.run.smithi191.stdout:Version : 2.02 2023-03-27T09:54:18.582 INFO:teuthology.orchestra.run.smithi191.stdout:Release : 129.el8 2023-03-27T09:54:18.582 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: x86_64 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:Group : System Environment/Base 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:Size : 9265586 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:License : GPLv3+ 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-03-27T09:54:18.583 INFO:teuthology.orchestra.run.smithi191.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:Build Host : kbuilder.bsys.centos.org 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:Relocations : (not relocatable) 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:Packager : CentOS BuildSystem 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:Vendor : CentOS 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:URL : http://www.gnu.org/software/grub/ 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:Summary : Support tools for GRUB. 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout:Description : 2023-03-27T09:54:18.584 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T09:54:18.585 INFO:teuthology.orchestra.run.smithi191.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-03-27T09:54:18.585 INFO:teuthology.orchestra.run.smithi191.stdout:customizable bootloader with modular architecture. It supports a rich 2023-03-27T09:54:18.585 INFO:teuthology.orchestra.run.smithi191.stdout:variety of kernel formats, file systems, computer architectures and 2023-03-27T09:54:18.585 INFO:teuthology.orchestra.run.smithi191.stdout:hardware devices. 2023-03-27T09:54:18.585 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T09:54:18.585 INFO:teuthology.orchestra.run.smithi191.stdout:This subpackage provides tools for support of all platforms. 2023-03-27T09:54:18.587 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-03-27T09:54:18.587 INFO:teuthology.task.kernel:Updating grub on smithi191 to boot 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:18.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-03-27T09:54:21.034 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2023-03-27T09:54:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:done 2023-03-27T09:54:22.872 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-03-27T09:54:22.906 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.zTimbWh6wM 2023-03-27T09:54:22.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zTimbWh6wM 2023-03-27T09:54:22.980 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.zTimbWh6wM 2023-03-27T09:54:23.141 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.zTimbWh6wM is 6KB 2023-03-27T09:54:23.162 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.zTimbWh6wM 2023-03-27T09:54:23.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo /bin/ls /boot/loader/entries || true 2023-03-27T09:54:23.244 INFO:teuthology.orchestra.run.smithi191.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-03-27T09:54:23.244 INFO:teuthology.orchestra.run.smithi191.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-03-27T09:54:23.244 INFO:teuthology.orchestra.run.smithi191.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-03-27T09:54:23.244 INFO:teuthology.orchestra.run.smithi191.stdout:2ff282740cf84d4fa02ff60ed95fbbff-6.3.0-rc3-g1776e8f494e9.conf 2023-03-27T09:54:23.245 DEBUG:teuthology.orchestra.run.smithi191:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-6.3.0-rc3-g1776e8f494e9 2023-03-27T09:54:23.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2023-03-27T09:54:43.502 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-03-27T09:54:43.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-03-27T09:54:43.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T09:54:53.403 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-03-27T09:54:53.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-03-27T09:54:53.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T09:55:18.149 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-27T09:55:48.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-03-27T09:55:48.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T09:55:53.409 DEBUG:teuthology.orchestra.remote:timed out 2023-03-27T09:56:04.855 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-03-27T09:56:05.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-03-27T09:56:05.345 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.3.0-rc3-g1776e8f494e9"... 2023-03-27T09:56:05.345 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-03-27T09:56:05.385 INFO:teuthology.orchestra.run.smithi172.stdout:6.3.0-rc3-g1776e8f494e9 2023-03-27T09:56:05.385 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-rc3-g1776e8f494e9 vs 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:56:05.385 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-27T09:56:05.385 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-03-27T09:56:06.387 DEBUG:teuthology.parallel:result is None 2023-03-27T09:56:23.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-03-27T09:56:23.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T09:56:24.043 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-03-27T09:56:24.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-03-27T09:56:24.456 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.3.0-rc3-g1776e8f494e9"... 2023-03-27T09:56:24.456 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-03-27T09:56:24.497 INFO:teuthology.orchestra.run.smithi191.stdout:6.3.0-rc3-g1776e8f494e9 2023-03-27T09:56:24.497 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-rc3-g1776e8f494e9 vs 6.3.0-rc3-g1776e8f494e9 2023-03-27T09:56:24.497 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-03-27T09:56:24.498 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-03-27T09:56:25.498 DEBUG:teuthology.parallel:result is None 2023-03-27T09:56:25.499 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-27T09:56:25.508 INFO:teuthology.task.internal:Creating test directory... 2023-03-27T09:56:25.508 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-27T09:56:25.513 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-27T09:56:25.557 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-27T09:56:25.566 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-27T09:56:25.627 INFO:teuthology.task.internal:Creating archive directory... 2023-03-27T09:56:25.627 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-27T09:56:25.631 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-27T09:56:25.699 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-27T09:56:25.711 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-27T09:56:25.711 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-27T09:56:25.715 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-27T09:56:25.834 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-27T09:56:25.847 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-27T09:56:25.867 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-27T09:56:25.881 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-27T09:56:25.884 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-27T09:56:25.893 INFO:teuthology.task.internal:Configuring sudo... 2023-03-27T09:56:25.893 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-27T09:56:25.897 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-27T09:56:25.960 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-27T09:56:25.974 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-27T09:56:25.974 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-27T09:56:25.978 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-27T09:56:26.018 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-27T09:56:26.127 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-27T09:56:26.200 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-27T09:56:26.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-27T09:56:26.346 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T09:56:26.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-27T09:56:26.408 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-27T09:56:26.482 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-27T09:56:26.555 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-27T09:56:26.626 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-27T09:56:26.700 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T09:56:26.701 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-27T09:56:26.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-03-27T09:56:26.766 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2023-03-27T09:56:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-27T09:56:26.912 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-27T09:56:27.385 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-27T09:56:27.393 INFO:teuthology.task.internal:Starting timer... 2023-03-27T09:56:27.393 INFO:teuthology.run_tasks:Running task pcp... 2023-03-27T09:56:27.434 INFO:teuthology.run_tasks:Running task selinux... 2023-03-27T09:56:27.477 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-27T09:56:27.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2023-03-27T09:56:27.597 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2023-03-27T09:56:27.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2023-03-27T09:56:27.722 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2023-03-27T09:56:27.725 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-27T09:56:27.725 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2023-03-27T09:56:27.772 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2023-03-27T09:56:27.772 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2023-03-27T09:56:27.822 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2023-03-27T09:56:27.823 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi172.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2023-03-27T09:56:27.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-27T09:56:27.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T09:56:27.886 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-27T09:56:27.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T09:56:27.949 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-27T09:56:27.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2023-03-27T09:56:28.020 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2023-03-27T09:56:28.082 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-27T09:56:28.092 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-03-27T09:56:28.093 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-27T09:56:28.112 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-27T09:56:28.113 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi172.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-27T10:06:15.907 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi172.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2023-03-27T10:06:15.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-03-27T10:06:15.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T10:06:15.995 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-03-27T10:06:16.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-03-27T10:06:16.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-27T10:06:16.233 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-03-27T10:06:16.347 INFO:teuthology.run_tasks:Running task clock... 2023-03-27T10:06:16.358 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-27T10:06:16.359 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-27T10:06:16.360 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-27T10:06:16.364 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-27T10:06:16.364 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-27T10:06:16.430 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-27T10:06:16.457 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-27T10:06:16.460 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-27T10:06:16.487 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-27T10:06:16.549 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2023-03-27T10:06:16.574 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2023-03-27T10:06:16.575 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2023-03-27T10:06:16.600 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2023-03-27T10:06:16.603 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-27T10:06:16.630 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-27T10:06:16.632 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-27T10:06:16.658 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-27T10:06:16.718 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-03-27T10:06:16.725 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-27T10:06:16.725 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-03-27T10:06:16.725 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.726 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.726 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.726 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.736 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-03-27T10:06:16.743 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-27T10:06:16.744 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-03-27T10:06:16.744 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.744 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.744 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.744 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-27T10:06:16.746 INFO:teuthology.run_tasks:Running task install... 2023-03-27T10:06:16.754 DEBUG:teuthology.task.install:project ceph 2023-03-27T10:06:16.755 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302'}} 2023-03-27T10:06:16.755 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302'} 2023-03-27T10:06:16.756 INFO:teuthology.task.install:Using flavor: default 2023-03-27T10:06:16.770 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-27T10:06:16.771 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-27T10:06:16.772 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302', 'tag': None, 'wait_for_package': False} 2023-03-27T10:06:16.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b70fdf973c2ffa23c0d8aa6918519da05d922302 2023-03-27T10:06:16.777 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302', 'tag': None, 'wait_for_package': False} 2023-03-27T10:06:16.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b70fdf973c2ffa23c0d8aa6918519da05d922302 2023-03-27T10:06:16.915 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/ 2023-03-27T10:06:16.915 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2533.gb70fdf97 2023-03-27T10:06:16.932 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/ 2023-03-27T10:06:16.932 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2533.gb70fdf97 2023-03-27T10:06:17.028 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-27T10:06:17.029 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:06:17.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-27T10:06:17.042 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-cephman-6/b70fdf973c2ffa23c0d8aa6918519da05d922302/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-27T10:06:17.043 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:06:17.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-27T10:06:17.091 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-27T10:06:17.092 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b70fdf973c2ffa23c0d8aa6918519da05d922302/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-27T10:06:17.106 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-27T10:06:17.107 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b70fdf973c2ffa23c0d8aa6918519da05d922302/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-27T10:06:17.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-27T10:06:17.211 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-27T10:06:17.279 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-27T10:06:17.297 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-27T10:06:17.341 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2023-03-27T10:06:17.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2023-03-27T10:06:17.358 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2023-03-27T10:06:17.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2023-03-27T10:06:17.654 INFO:teuthology.orchestra.run.smithi191.stdout:71 files removed 2023-03-27T10:06:17.677 INFO:teuthology.orchestra.run.smithi172.stdout:71 files removed 2023-03-27T10:06:17.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-27T10:06:17.714 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-27T10:06:18.491 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 305 kB/s | 79 kB 00:00 2023-03-27T10:06:18.529 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 300 kB/s | 79 kB 00:00 2023-03-27T10:06:18.767 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 39 kB/s | 9.3 kB 00:00 2023-03-27T10:06:18.796 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 41 kB/s | 9.3 kB 00:00 2023-03-27T10:06:19.027 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2023-03-27T10:06:19.038 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 6.9 kB/s | 1.5 kB 00:00 2023-03-27T10:06:19.855 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - AppStream 36 MB/s | 29 MB 00:00 2023-03-27T10:06:19.916 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - AppStream 34 MB/s | 29 MB 00:00 2023-03-27T10:06:26.239 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - BaseOS 31 MB/s | 28 MB 00:00 2023-03-27T10:06:26.267 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - BaseOS 30 MB/s | 28 MB 00:00 2023-03-27T10:06:30.865 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - Extras 90 kB/s | 18 kB 00:00 2023-03-27T10:06:30.965 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - Extras 93 kB/s | 18 kB 00:00 2023-03-27T10:06:31.282 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - PowerTools 20 MB/s | 5.8 MB 00:00 2023-03-27T10:06:31.375 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-8 - PowerTools 21 MB/s | 5.8 MB 00:00 2023-03-27T10:06:32.606 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-03-27T10:06:32.742 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-03-27T10:06:34.143 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2023-03-27T10:06:34.550 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 14 MB 00:01 2023-03-27T10:06:38.175 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 208 kB/s | 24 kB 00:00 2023-03-27T10:06:38.500 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 220 kB/s | 24 kB 00:00 2023-03-27T10:06:41.815 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-27T10:06:41.816 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-27T10:06:41.828 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.39.12-1.el8.x86_64 is already installed. 2023-03-27T10:06:41.829 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-initscripts-updown-1:1.39.12-1.el8.noarch is already installed. 2023-03-27T10:06:41.829 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2023-03-27T10:06:41.830 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2023-03-27T10:06:41.831 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-27T10:06:41.833 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-27T10:06:41.835 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-27T10:06:41.836 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-27T10:06:41.976 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-03-27T10:06:41.990 INFO:teuthology.orchestra.run.smithi172.stdout:========================================================================================================= 2023-03-27T10:06:41.990 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout:========================================================================================================= 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 6.4 k 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 4.9 M 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 845 k 2023-03-27T10:06:41.991 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 165 k 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 1.5 M 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 120 k 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 1.7 M 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 7.4 M 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 47 k 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 13 M 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 45 M 2023-03-27T10:06:41.992 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 263 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 82 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 258 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 18 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2023-03-27T10:06:41.993 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 30 k 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 768 k 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 139 k 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.32.1-41.el8 CentOS-BaseOS 99 k 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 CentOS-BaseOS 3.2 M 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c CentOS-AppStream 1.6 M 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c CentOS-AppStream 903 k 2023-03-27T10:06:41.994 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c CentOS-AppStream 5.1 M 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 190 k 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 371 k 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 365 k 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 107 k 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 95 k 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.4 M 2023-03-27T10:06:41.995 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 180 k 2023-03-27T10:06:41.996 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2023-03-27T10:06:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2023-03-27T10:06:41.996 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-1.el8 CentOS-BaseOS 142 k 2023-03-27T10:06:41.996 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2023-03-27T10:06:41.997 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2023-03-27T10:06:41.997 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2023-03-27T10:06:41.997 INFO:teuthology.orchestra.run.smithi172.stdout: libblkid x86_64 2.32.1-41.el8 CentOS-BaseOS 220 k 2023-03-27T10:06:41.998 INFO:teuthology.orchestra.run.smithi172.stdout: libfdisk x86_64 2.32.1-41.el8 CentOS-BaseOS 253 k 2023-03-27T10:06:41.998 INFO:teuthology.orchestra.run.smithi172.stdout: libmount x86_64 2.32.1-41.el8 CentOS-BaseOS 236 k 2023-03-27T10:06:41.998 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.6 M 2023-03-27T10:06:41.998 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.6 M 2023-03-27T10:06:41.998 INFO:teuthology.orchestra.run.smithi172.stdout: libsmartcols x86_64 2.32.1-41.el8 CentOS-BaseOS 179 k 2023-03-27T10:06:41.999 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid x86_64 2.32.1-41.el8 CentOS-BaseOS 98 k 2023-03-27T10:06:41.999 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:1.1.1k-9.el8 CentOS-BaseOS 737 k 2023-03-27T10:06:41.999 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:1.1.1k-9.el8 CentOS-BaseOS 1.5 M 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout: util-linux x86_64 2.32.1-41.el8 CentOS-BaseOS 2.6 M 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout: util-linux-user x86_64 2.32.1-41.el8 CentOS-BaseOS 102 k 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 21 M 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 23 k 2023-03-27T10:06:42.000 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 2.3 M 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 236 k 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.9 M 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 17 M 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 15 k 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 24 k 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-03-27T10:06:42.001 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel x86_64 1.18.2-22.el8 CentOS-BaseOS 561 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 137 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-27T10:06:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 474 k 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 6.5 M 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2023-03-27T10:06:42.003 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2023-03-27T10:06:42.004 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-27T10:06:42.005 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2023-03-27T10:06:42.005 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-03-27T10:06:42.005 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-03-27T10:06:42.005 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-03-27T10:06:42.006 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 45 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 117 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-27T10:06:42.007 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-03-27T10:06:42.008 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.0.6-14.el8 CentOS-AppStream 157 k 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-27T10:06:42.009 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-03-27T10:06:42.010 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-27T10:06:42.011 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-27T10:06:42.012 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-27T10:06:42.013 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-27T10:06:42.013 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-27T10:06:42.013 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-03-27T10:06:42.013 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-27T10:06:42.013 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-03-27T10:06:42.013 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-27T10:06:42.014 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2023-03-27T10:06:42.014 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-03-27T10:06:42.014 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-19.el8 CentOS-BaseOS 58 k 2023-03-27T10:06:42.014 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling module streams: 2023-03-27T10:06:42.014 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql 10 2023-03-27T10:06:42.014 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:06:42.015 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-03-27T10:06:42.015 INFO:teuthology.orchestra.run.smithi172.stdout:========================================================================================================= 2023-03-27T10:06:42.015 INFO:teuthology.orchestra.run.smithi172.stdout:Install 127 Packages 2023-03-27T10:06:42.015 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 15 Packages 2023-03-27T10:06:42.015 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:06:42.016 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 205 M 2023-03-27T10:06:42.017 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-03-27T10:06:42.131 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-27T10:06:42.132 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-27T10:06:42.144 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.39.12-1.el8.x86_64 is already installed. 2023-03-27T10:06:42.145 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-initscripts-updown-1:1.39.12-1.el8.noarch is already installed. 2023-03-27T10:06:42.146 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2023-03-27T10:06:42.146 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2023-03-27T10:06:42.147 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-27T10:06:42.149 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-27T10:06:42.151 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-27T10:06:42.151 INFO:teuthology.orchestra.run.smithi172.stdout:(1/142): ceph-18.0.0-2533.gb70fdf97.el8.x86_64. 46 kB/s | 6.4 kB 00:00 2023-03-27T10:06:42.152 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-27T10:06:42.292 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-03-27T10:06:42.305 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================================= 2023-03-27T10:06:42.306 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-03-27T10:06:42.306 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================================= 2023-03-27T10:06:42.306 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2023-03-27T10:06:42.306 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2023-03-27T10:06:42.306 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 6.4 k 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 4.9 M 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 845 k 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 165 k 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 1.5 M 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 120 k 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 1.7 M 2023-03-27T10:06:42.307 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 7.4 M 2023-03-27T10:06:42.308 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 47 k 2023-03-27T10:06:42.308 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 13 M 2023-03-27T10:06:42.308 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 45 M 2023-03-27T10:06:42.310 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 263 k 2023-03-27T10:06:42.310 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 82 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 258 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 18 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.188-3.el8 CentOS-BaseOS 61 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 30 k 2023-03-27T10:06:42.311 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 768 k 2023-03-27T10:06:42.312 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 139 k 2023-03-27T10:06:42.312 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2023-03-27T10:06:42.312 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.32.1-41.el8 CentOS-BaseOS 99 k 2023-03-27T10:06:42.312 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 CentOS-BaseOS 3.2 M 2023-03-27T10:06:42.312 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c CentOS-AppStream 1.6 M 2023-03-27T10:06:42.313 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c CentOS-AppStream 903 k 2023-03-27T10:06:42.313 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c CentOS-AppStream 5.1 M 2023-03-27T10:06:42.313 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 190 k 2023-03-27T10:06:42.313 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 371 k 2023-03-27T10:06:42.314 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 365 k 2023-03-27T10:06:42.314 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 107 k 2023-03-27T10:06:42.314 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 95 k 2023-03-27T10:06:42.314 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.4 M 2023-03-27T10:06:42.317 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 180 k 2023-03-27T10:06:42.317 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2023-03-27T10:06:42.317 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-1.el8 CentOS-BaseOS 142 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client x86_64 0.188-3.el8 CentOS-BaseOS 75 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf x86_64 0.188-3.el8 CentOS-BaseOS 231 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs x86_64 0.188-3.el8 CentOS-BaseOS 299 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: libblkid x86_64 2.32.1-41.el8 CentOS-BaseOS 220 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: libfdisk x86_64 2.32.1-41.el8 CentOS-BaseOS 253 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: libmount x86_64 2.32.1-41.el8 CentOS-BaseOS 236 k 2023-03-27T10:06:42.318 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.6 M 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.6 M 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: libsmartcols x86_64 2.32.1-41.el8 CentOS-BaseOS 179 k 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid x86_64 2.32.1-41.el8 CentOS-BaseOS 98 k 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:1.1.1k-9.el8 CentOS-BaseOS 737 k 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:1.1.1k-9.el8 CentOS-BaseOS 1.5 M 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux x86_64 2.32.1-41.el8 CentOS-BaseOS 2.6 M 2023-03-27T10:06:42.319 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-user x86_64 2.32.1-41.el8 CentOS-BaseOS 102 k 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 21 M 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 23 k 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 2.3 M 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 236 k 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 3.9 M 2023-03-27T10:06:42.320 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 17 M 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2533.gb70fdf97.el8 ceph-noarch 15 k 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 24 k 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2023-03-27T10:06:42.321 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel x86_64 1.18.2-22.el8 CentOS-BaseOS 561 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 137 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-03-27T10:06:42.322 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 474 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 6.5 M 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2023-03-27T10:06:42.323 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2023-03-27T10:06:42.324 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 45 k 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:18.0.0-2533.gb70fdf97.el8 ceph 117 k 2023-03-27T10:06:42.325 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-27T10:06:42.326 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-03-27T10:06:42.326 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-27T10:06:42.326 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-27T10:06:42.326 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-03-27T10:06:42.327 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-03-27T10:06:42.328 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-27T10:06:42.328 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-27T10:06:42.328 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.0.6-14.el8 CentOS-AppStream 157 k 2023-03-27T10:06:42.328 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-03-27T10:06:42.328 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-03-27T10:06:42.329 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-03-27T10:06:42.330 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-03-27T10:06:42.330 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-03-27T10:06:42.330 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-03-27T10:06:42.330 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-03-27T10:06:42.330 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-27T10:06:42.330 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-27T10:06:42.331 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-03-27T10:06:42.332 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-19.el8 CentOS-BaseOS 58 k 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout:Enabling module streams: 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql 10 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:06:42.333 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-03-27T10:06:42.334 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================================= 2023-03-27T10:06:42.334 INFO:teuthology.orchestra.run.smithi191.stdout:Install 127 Packages 2023-03-27T10:06:42.334 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 15 Packages 2023-03-27T10:06:42.334 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:06:42.335 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 205 M 2023-03-27T10:06:42.335 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-03-27T10:06:42.518 INFO:teuthology.orchestra.run.smithi172.stdout:(2/142): ceph-fuse-18.0.0-2533.gb70fdf97.el8.x8 2.3 MB/s | 845 kB 00:00 2023-03-27T10:06:42.568 INFO:teuthology.orchestra.run.smithi191.stdout:(1/142): ceph-18.0.0-2533.gb70fdf97.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-03-27T10:06:42.694 INFO:teuthology.orchestra.run.smithi172.stdout:(3/142): ceph-immutable-object-cache-18.0.0-253 947 kB/s | 165 kB 00:00 2023-03-27T10:06:42.869 INFO:teuthology.orchestra.run.smithi172.stdout:(4/142): ceph-base-18.0.0-2533.gb70fdf97.el8.x8 5.7 MB/s | 4.9 MB 00:00 2023-03-27T10:06:43.336 INFO:teuthology.orchestra.run.smithi172.stdout:(5/142): ceph-mds-18.0.0-2533.gb70fdf97.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-03-27T10:06:43.369 INFO:teuthology.orchestra.run.smithi191.stdout:(2/142): ceph-fuse-18.0.0-2533.gb70fdf97.el8.x8 1.0 MB/s | 845 kB 00:00 2023-03-27T10:06:43.445 INFO:teuthology.orchestra.run.smithi172.stdout:(6/142): ceph-mgr-18.0.0-2533.gb70fdf97.el8.x86 2.7 MB/s | 1.5 MB 00:00 2023-03-27T10:06:43.477 INFO:teuthology.orchestra.run.smithi191.stdout:(3/142): ceph-immutable-object-cache-18.0.0-253 1.5 MB/s | 165 kB 00:00 2023-03-27T10:06:43.953 INFO:teuthology.orchestra.run.smithi172.stdout:(7/142): ceph-mon-18.0.0-2533.gb70fdf97.el8.x86 6.3 MB/s | 3.9 MB 00:00 2023-03-27T10:06:44.361 INFO:teuthology.orchestra.run.smithi191.stdout:(4/142): ceph-mds-18.0.0-2533.gb70fdf97.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-03-27T10:06:44.736 INFO:teuthology.orchestra.run.smithi191.stdout:(5/142): ceph-base-18.0.0-2533.gb70fdf97.el8.x8 2.0 MB/s | 4.9 MB 00:02 2023-03-27T10:06:44.945 INFO:teuthology.orchestra.run.smithi191.stdout:(6/142): ceph-mgr-18.0.0-2533.gb70fdf97.el8.x86 2.6 MB/s | 1.5 MB 00:00 2023-03-27T10:06:45.113 INFO:teuthology.orchestra.run.smithi172.stdout:(8/142): ceph-common-18.0.0-2533.gb70fdf97.el8. 6.9 MB/s | 21 MB 00:03 2023-03-27T10:06:45.212 INFO:teuthology.orchestra.run.smithi172.stdout:(9/142): ceph-selinux-18.0.0-2533.gb70fdf97.el8 244 kB/s | 24 kB 00:00 2023-03-27T10:06:45.654 INFO:teuthology.orchestra.run.smithi172.stdout:(10/142): ceph-radosgw-18.0.0-2533.gb70fdf97.el 7.7 MB/s | 13 MB 00:01 2023-03-27T10:06:45.754 INFO:teuthology.orchestra.run.smithi191.stdout:(7/142): ceph-mon-18.0.0-2533.gb70fdf97.el8.x86 3.8 MB/s | 3.9 MB 00:01 2023-03-27T10:06:45.763 INFO:teuthology.orchestra.run.smithi172.stdout:(11/142): cephfs-mirror-18.0.0-2533.gb70fdf97.e 2.3 MB/s | 258 kB 00:00 2023-03-27T10:06:45.854 INFO:teuthology.orchestra.run.smithi172.stdout:(12/142): libcephfs-devel-18.0.0-2533.gb70fdf97 334 kB/s | 30 kB 00:00 2023-03-27T10:06:46.096 INFO:teuthology.orchestra.run.smithi172.stdout:(13/142): libcephfs2-18.0.0-2533.gb70fdf97.el8. 3.1 MB/s | 768 kB 00:00 2023-03-27T10:06:46.188 INFO:teuthology.orchestra.run.smithi172.stdout:(14/142): libcephsqlite-18.0.0-2533.gb70fdf97.e 1.5 MB/s | 137 kB 00:00 2023-03-27T10:06:46.289 INFO:teuthology.orchestra.run.smithi172.stdout:(15/142): librados-devel-18.0.0-2533.gb70fdf97. 1.4 MB/s | 139 kB 00:00 2023-03-27T10:06:46.447 INFO:teuthology.orchestra.run.smithi172.stdout:(16/142): libradosstriper1-18.0.0-2533.gb70fdf9 2.9 MB/s | 474 kB 00:00 2023-03-27T10:06:47.189 INFO:teuthology.orchestra.run.smithi172.stdout:(17/142): ceph-osd-18.0.0-2533.gb70fdf97.el8.x8 4.4 MB/s | 17 MB 00:03 2023-03-27T10:06:47.273 INFO:teuthology.orchestra.run.smithi172.stdout:(18/142): python3-ceph-argparse-18.0.0-2533.gb7 538 kB/s | 45 kB 00:00 2023-03-27T10:06:47.340 INFO:teuthology.orchestra.run.smithi172.stdout:(19/142): python3-ceph-common-18.0.0-2533.gb70f 1.7 MB/s | 117 kB 00:00 2023-03-27T10:06:47.415 INFO:teuthology.orchestra.run.smithi172.stdout:(20/142): python3-cephfs-18.0.0-2533.gb70fdf97. 2.5 MB/s | 190 kB 00:00 2023-03-27T10:06:47.504 INFO:teuthology.orchestra.run.smithi191.stdout:(8/142): ceph-osd-18.0.0-2533.gb70fdf97.el8.x86 6.5 MB/s | 17 MB 00:02 2023-03-27T10:06:47.554 INFO:teuthology.orchestra.run.smithi191.stdout:(9/142): ceph-selinux-18.0.0-2533.gb70fdf97.el8 487 kB/s | 24 kB 00:00 2023-03-27T10:06:47.566 INFO:teuthology.orchestra.run.smithi172.stdout:(21/142): librgw2-18.0.0-2533.gb70fdf97.el8.x86 5.8 MB/s | 6.5 MB 00:01 2023-03-27T10:06:47.590 INFO:teuthology.orchestra.run.smithi172.stdout:(22/142): python3-rados-18.0.0-2533.gb70fdf97.e 2.1 MB/s | 371 kB 00:00 2023-03-27T10:06:47.649 INFO:teuthology.orchestra.run.smithi172.stdout:(23/142): python3-rbd-18.0.0-2533.gb70fdf97.el8 4.3 MB/s | 365 kB 00:00 2023-03-27T10:06:47.682 INFO:teuthology.orchestra.run.smithi172.stdout:(24/142): python3-rgw-18.0.0-2533.gb70fdf97.el8 1.1 MB/s | 107 kB 00:00 2023-03-27T10:06:47.733 INFO:teuthology.orchestra.run.smithi172.stdout:(25/142): rbd-fuse-18.0.0-2533.gb70fdf97.el8.x8 1.1 MB/s | 95 kB 00:00 2023-03-27T10:06:47.834 INFO:teuthology.orchestra.run.smithi172.stdout:(26/142): rbd-nbd-18.0.0-2533.gb70fdf97.el8.x86 1.8 MB/s | 180 kB 00:00 2023-03-27T10:06:47.925 INFO:teuthology.orchestra.run.smithi172.stdout:(27/142): ceph-grafana-dashboards-18.0.0-2533.g 252 kB/s | 23 kB 00:00 2023-03-27T10:06:48.017 INFO:teuthology.orchestra.run.smithi172.stdout:(28/142): ceph-mgr-cephadm-18.0.0-2533.gb70fdf9 1.3 MB/s | 120 kB 00:00 2023-03-27T10:06:48.271 INFO:teuthology.orchestra.run.smithi191.stdout:(10/142): ceph-common-18.0.0-2533.gb70fdf97.el8 3.6 MB/s | 21 MB 00:05 2023-03-27T10:06:48.317 INFO:teuthology.orchestra.run.smithi172.stdout:(29/142): ceph-mgr-dashboard-18.0.0-2533.gb70fd 5.8 MB/s | 1.7 MB 00:00 2023-03-27T10:06:48.455 INFO:teuthology.orchestra.run.smithi191.stdout:(11/142): cephfs-mirror-18.0.0-2533.gb70fdf97.e 1.4 MB/s | 258 kB 00:00 2023-03-27T10:06:48.506 INFO:teuthology.orchestra.run.smithi191.stdout:(12/142): libcephfs-devel-18.0.0-2533.gb70fdf97 614 kB/s | 30 kB 00:00 2023-03-27T10:06:48.518 INFO:teuthology.orchestra.run.smithi172.stdout:(30/142): rbd-mirror-18.0.0-2533.gb70fdf97.el8. 4.1 MB/s | 3.4 MB 00:00 2023-03-27T10:06:48.618 INFO:teuthology.orchestra.run.smithi172.stdout:(31/142): ceph-mgr-modules-core-18.0.0-2533.gb7 2.3 MB/s | 236 kB 00:00 2023-03-27T10:06:48.701 INFO:teuthology.orchestra.run.smithi172.stdout:(32/142): ceph-mgr-rook-18.0.0-2533.gb70fdf97.e 571 kB/s | 47 kB 00:00 2023-03-27T10:06:48.756 INFO:teuthology.orchestra.run.smithi191.stdout:(13/142): libcephfs2-18.0.0-2533.gb70fdf97.el8. 3.0 MB/s | 768 kB 00:00 2023-03-27T10:06:48.768 INFO:teuthology.orchestra.run.smithi172.stdout:(33/142): ceph-prometheus-alerts-18.0.0-2533.gb 218 kB/s | 15 kB 00:00 2023-03-27T10:06:48.856 INFO:teuthology.orchestra.run.smithi191.stdout:(14/142): libcephsqlite-18.0.0-2533.gb70fdf97.e 1.3 MB/s | 137 kB 00:00 2023-03-27T10:06:48.868 INFO:teuthology.orchestra.run.smithi172.stdout:(34/142): ceph-volume-18.0.0-2533.gb70fdf97.el8 2.6 MB/s | 263 kB 00:00 2023-03-27T10:06:48.952 INFO:teuthology.orchestra.run.smithi172.stdout:(35/142): cephadm-18.0.0-2533.gb70fdf97.el8.noa 990 kB/s | 82 kB 00:00 2023-03-27T10:06:48.999 INFO:teuthology.orchestra.run.smithi191.stdout:(15/142): ceph-radosgw-18.0.0-2533.gb70fdf97.el 4.0 MB/s | 13 MB 00:03 2023-03-27T10:06:49.003 INFO:teuthology.orchestra.run.smithi172.stdout:(36/142): cephfs-top-18.0.0-2533.gb70fdf97.el8. 361 kB/s | 18 kB 00:00 2023-03-27T10:06:49.024 INFO:teuthology.orchestra.run.smithi191.stdout:(16/142): librados-devel-18.0.0-2533.gb70fdf97. 831 kB/s | 139 kB 00:00 2023-03-27T10:06:49.078 INFO:teuthology.orchestra.run.smithi172.stdout:(37/142): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-03-27T10:06:49.120 INFO:teuthology.orchestra.run.smithi172.stdout:(38/142): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2023-03-27T10:06:49.157 INFO:teuthology.orchestra.run.smithi191.stdout:(17/142): libradosstriper1-18.0.0-2533.gb70fdf9 3.5 MB/s | 474 kB 00:00 2023-03-27T10:06:49.157 INFO:teuthology.orchestra.run.smithi172.stdout:(39/142): flex-2.6.1-9.el8.x86_64.rpm 9.4 MB/s | 320 kB 00:00 2023-03-27T10:06:49.180 INFO:teuthology.orchestra.run.smithi172.stdout:(40/142): jq-1.6-6.el8.x86_64.rpm 7.9 MB/s | 202 kB 00:00 2023-03-27T10:06:49.204 INFO:teuthology.orchestra.run.smithi172.stdout:(41/142): libpq-13.5-1.el8.x86_64.rpm 7.7 MB/s | 198 kB 00:00 2023-03-27T10:06:49.216 INFO:teuthology.orchestra.run.smithi191.stdout:(18/142): python3-ceph-argparse-18.0.0-2533.gb7 535 kB/s | 45 kB 00:00 2023-03-27T10:06:49.238 INFO:teuthology.orchestra.run.smithi172.stdout:(42/142): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2023-03-27T10:06:49.280 INFO:teuthology.orchestra.run.smithi172.stdout:(43/142): libtool-2.4.6-25.el8.x86_64.rpm 17 MB/s | 709 kB 00:00 2023-03-27T10:06:49.300 INFO:teuthology.orchestra.run.smithi191.stdout:(19/142): python3-ceph-common-18.0.0-2533.gb70f 1.4 MB/s | 117 kB 00:00 2023-03-27T10:06:49.314 INFO:teuthology.orchestra.run.smithi172.stdout:(44/142): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.7 MB/s | 259 kB 00:00 2023-03-27T10:06:49.331 INFO:teuthology.orchestra.run.smithi172.stdout:(45/142): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-03-27T10:06:49.392 INFO:teuthology.orchestra.run.smithi191.stdout:(20/142): python3-cephfs-18.0.0-2533.gb70fdf97. 2.0 MB/s | 190 kB 00:00 2023-03-27T10:06:49.440 INFO:teuthology.orchestra.run.smithi172.stdout:(46/142): openblas-0.3.15-4.el8.x86_64.rpm 44 MB/s | 4.7 MB 00:00 2023-03-27T10:06:49.531 INFO:teuthology.orchestra.run.smithi172.stdout:(47/142): ceph-mgr-diskprediction-local-18.0.0- 6.1 MB/s | 7.4 MB 00:01 2023-03-27T10:06:49.542 INFO:teuthology.orchestra.run.smithi191.stdout:(21/142): python3-rados-18.0.0-2533.gb70fdf97.e 2.4 MB/s | 371 kB 00:00 2023-03-27T10:06:49.649 INFO:teuthology.orchestra.run.smithi172.stdout:(48/142): openblas-threads-0.3.15-4.el8.x86_64. 23 MB/s | 4.9 MB 00:00 2023-03-27T10:06:49.684 INFO:teuthology.orchestra.run.smithi191.stdout:(22/142): python3-rbd-18.0.0-2533.gb70fdf97.el8 2.5 MB/s | 365 kB 00:00 2023-03-27T10:06:49.690 INFO:teuthology.orchestra.run.smithi172.stdout:(49/142): postgresql-10.23-1.module_el8+300+2c5 9.9 MB/s | 1.6 MB 00:00 2023-03-27T10:06:49.732 INFO:teuthology.orchestra.run.smithi172.stdout:(50/142): postgresql-contrib-10.23-1.module_el8 11 MB/s | 903 kB 00:00 2023-03-27T10:06:49.744 INFO:teuthology.orchestra.run.smithi191.stdout:(23/142): python3-rgw-18.0.0-2533.gb70fdf97.el8 1.8 MB/s | 107 kB 00:00 2023-03-27T10:06:49.819 INFO:teuthology.orchestra.run.smithi191.stdout:(24/142): rbd-fuse-18.0.0-2533.gb70fdf97.el8.x8 1.2 MB/s | 95 kB 00:00 2023-03-27T10:06:49.849 INFO:teuthology.orchestra.run.smithi172.stdout:(51/142): python3-babel-2.5.1-7.el8.noarch.rpm 41 MB/s | 4.8 MB 00:00 2023-03-27T10:06:49.892 INFO:teuthology.orchestra.run.smithi172.stdout:(52/142): python3-jinja2-2.10.1-3.el8.noarch.rp 13 MB/s | 538 kB 00:00 2023-03-27T10:06:49.917 INFO:teuthology.orchestra.run.smithi172.stdout:(53/142): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2023-03-27T10:06:49.942 INFO:teuthology.orchestra.run.smithi172.stdout:(54/142): python3-jsonpointer-1.10-11.el8.noarc 799 kB/s | 20 kB 00:00 2023-03-27T10:06:49.975 INFO:teuthology.orchestra.run.smithi172.stdout:(55/142): python3-mako-1.0.6-14.el8.noarch.rpm 4.6 MB/s | 157 kB 00:00 2023-03-27T10:06:50.001 INFO:teuthology.orchestra.run.smithi172.stdout:(56/142): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-03-27T10:06:50.076 INFO:teuthology.orchestra.run.smithi172.stdout:(57/142): postgresql-server-10.23-1.module_el8+ 13 MB/s | 5.1 MB 00:00 2023-03-27T10:06:50.110 INFO:teuthology.orchestra.run.smithi172.stdout:(58/142): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.6 MB/s | 225 kB 00:00 2023-03-27T10:06:50.135 INFO:teuthology.orchestra.run.smithi172.stdout:(59/142): python3-prettytable-0.7.2-14.el8.noar 1.7 MB/s | 44 kB 00:00 2023-03-27T10:06:50.160 INFO:teuthology.orchestra.run.smithi172.stdout:(60/142): python3-pyOpenSSL-19.0.0-1.el8.noarch 4.1 MB/s | 103 kB 00:00 2023-03-27T10:06:50.185 INFO:teuthology.orchestra.run.smithi172.stdout:(61/142): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.9 MB/s | 126 kB 00:00 2023-03-27T10:06:50.211 INFO:teuthology.orchestra.run.smithi172.stdout:(62/142): python3-pyasn1-modules-0.3.7-6.el8.no 4.3 MB/s | 110 kB 00:00 2023-03-27T10:06:50.228 INFO:teuthology.orchestra.run.smithi172.stdout:(63/142): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2023-03-27T10:06:50.277 INFO:teuthology.orchestra.run.smithi191.stdout:(25/142): librgw2-18.0.0-2533.gb70fdf97.el8.x86 5.2 MB/s | 6.5 MB 00:01 2023-03-27T10:06:50.303 INFO:teuthology.orchestra.run.smithi172.stdout:(64/142): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-03-27T10:06:50.337 INFO:teuthology.orchestra.run.smithi172.stdout:(65/142): python3-werkzeug-0.12.2-4.el8.noarch. 13 MB/s | 457 kB 00:00 2023-03-27T10:06:50.344 INFO:teuthology.orchestra.run.smithi191.stdout:(26/142): rbd-nbd-18.0.0-2533.gb70fdf97.el8.x86 2.6 MB/s | 180 kB 00:00 2023-03-27T10:06:50.379 INFO:teuthology.orchestra.run.smithi172.stdout:(66/142): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-03-27T10:06:50.404 INFO:teuthology.orchestra.run.smithi172.stdout:(67/142): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2023-03-27T10:06:50.420 INFO:teuthology.orchestra.run.smithi191.stdout:(27/142): ceph-grafana-dashboards-18.0.0-2533.g 307 kB/s | 23 kB 00:00 2023-03-27T10:06:50.429 INFO:teuthology.orchestra.run.smithi172.stdout:(68/142): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-03-27T10:06:50.455 INFO:teuthology.orchestra.run.smithi172.stdout:(69/142): elfutils-libelf-devel-0.188-3.el8.x86 2.4 MB/s | 61 kB 00:00 2023-03-27T10:06:50.488 INFO:teuthology.orchestra.run.smithi172.stdout:(70/142): fuse-2.9.7-16.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-03-27T10:06:50.512 INFO:teuthology.orchestra.run.smithi191.stdout:(28/142): rbd-mirror-18.0.0-2533.gb70fdf97.el8. 5.0 MB/s | 3.4 MB 00:00 2023-03-27T10:06:50.513 INFO:teuthology.orchestra.run.smithi172.stdout:(71/142): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2023-03-27T10:06:50.537 INFO:teuthology.orchestra.run.smithi191.stdout:(29/142): ceph-mgr-cephadm-18.0.0-2533.gb70fdf9 1.0 MB/s | 120 kB 00:00 2023-03-27T10:06:50.556 INFO:teuthology.orchestra.run.smithi172.stdout:(72/142): krb5-devel-1.18.2-22.el8.x86_64.rpm 13 MB/s | 561 kB 00:00 2023-03-27T10:06:50.581 INFO:teuthology.orchestra.run.smithi172.stdout:(73/142): libaio-devel-0.3.112-1.el8.x86_64.rpm 749 kB/s | 19 kB 00:00 2023-03-27T10:06:50.607 INFO:teuthology.orchestra.run.smithi172.stdout:(74/142): libcom_err-devel-1.45.6-5.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2023-03-27T10:06:50.656 INFO:teuthology.orchestra.run.smithi172.stdout:(75/142): libgfortran-8.5.0-18.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2023-03-27T10:06:50.698 INFO:teuthology.orchestra.run.smithi172.stdout:(76/142): libquadmath-8.5.0-18.el8.x86_64.rpm 4.0 MB/s | 172 kB 00:00 2023-03-27T10:06:50.724 INFO:teuthology.orchestra.run.smithi172.stdout:(77/142): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-03-27T10:06:50.757 INFO:teuthology.orchestra.run.smithi172.stdout:(78/142): libselinux-devel-2.9-6.el8.x86_64.rpm 5.9 MB/s | 200 kB 00:00 2023-03-27T10:06:50.791 INFO:teuthology.orchestra.run.smithi172.stdout:(79/142): libsepol-devel-2.9-3.el8.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2023-03-27T10:06:50.825 INFO:teuthology.orchestra.run.smithi172.stdout:(80/142): libuuid-devel-2.32.1-41.el8.x86_64.rp 2.9 MB/s | 99 kB 00:00 2023-03-27T10:06:50.850 INFO:teuthology.orchestra.run.smithi172.stdout:(81/142): libverto-devel-0.3.2-2.el8.x86_64.rpm 722 kB/s | 18 kB 00:00 2023-03-27T10:06:50.871 INFO:teuthology.orchestra.run.smithi191.stdout:(30/142): ceph-mgr-dashboard-18.0.0-2533.gb70fd 4.8 MB/s | 1.7 MB 00:00 2023-03-27T10:06:50.950 INFO:teuthology.orchestra.run.smithi172.stdout:(82/142): openssl-devel-1.1.1k-9.el8.x86_64.rpm 32 MB/s | 3.2 MB 00:00 2023-03-27T10:06:50.955 INFO:teuthology.orchestra.run.smithi191.stdout:(31/142): ceph-mgr-modules-core-18.0.0-2533.gb7 2.8 MB/s | 236 kB 00:00 2023-03-27T10:06:50.992 INFO:teuthology.orchestra.run.smithi172.stdout:(83/142): pcre2-devel-10.32-3.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2023-03-27T10:06:51.029 INFO:teuthology.orchestra.run.smithi172.stdout:(84/142): pcre2-utf16-10.32-3.el8.x86_64.rpm 6.7 MB/s | 229 kB 00:00 2023-03-27T10:06:51.030 INFO:teuthology.orchestra.run.smithi191.stdout:(32/142): ceph-mgr-rook-18.0.0-2533.gb70fdf97.e 632 kB/s | 47 kB 00:00 2023-03-27T10:06:51.060 INFO:teuthology.orchestra.run.smithi172.stdout:(85/142): pcre2-utf32-10.32-3.el8.x86_64.rpm 6.5 MB/s | 220 kB 00:00 2023-03-27T10:06:51.093 INFO:teuthology.orchestra.run.smithi172.stdout:(86/142): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.0 MB/s | 237 kB 00:00 2023-03-27T10:06:51.106 INFO:teuthology.orchestra.run.smithi191.stdout:(33/142): ceph-prometheus-alerts-18.0.0-2533.gb 194 kB/s | 15 kB 00:00 2023-03-27T10:06:51.182 INFO:teuthology.orchestra.run.smithi191.stdout:(34/142): ceph-volume-18.0.0-2533.gb70fdf97.el8 3.4 MB/s | 263 kB 00:00 2023-03-27T10:06:51.244 INFO:teuthology.orchestra.run.smithi172.stdout:(87/142): python3-scipy-1.0.0-21.module_el8.5.0 13 MB/s | 14 MB 00:01 2023-03-27T10:06:51.248 INFO:teuthology.orchestra.run.smithi191.stdout:(35/142): cephadm-18.0.0-2533.gb70fdf97.el8.noa 1.2 MB/s | 82 kB 00:00 2023-03-27T10:06:51.269 INFO:teuthology.orchestra.run.smithi172.stdout:(88/142): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2023-03-27T10:06:51.294 INFO:teuthology.orchestra.run.smithi172.stdout:(89/142): python3-cryptography-3.2.1-5.el8.x86_ 2.7 MB/s | 559 kB 00:00 2023-03-27T10:06:51.315 INFO:teuthology.orchestra.run.smithi191.stdout:(36/142): cephfs-top-18.0.0-2533.gb70fdf97.el8. 270 kB/s | 18 kB 00:00 2023-03-27T10:06:51.319 INFO:teuthology.orchestra.run.smithi172.stdout:(90/142): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-03-27T10:06:51.345 INFO:teuthology.orchestra.run.smithi172.stdout:(91/142): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-03-27T10:06:51.370 INFO:teuthology.orchestra.run.smithi172.stdout:(92/142): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-03-27T10:06:51.391 INFO:teuthology.orchestra.run.smithi191.stdout:(37/142): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-03-27T10:06:51.395 INFO:teuthology.orchestra.run.smithi172.stdout:(93/142): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-03-27T10:06:51.421 INFO:teuthology.orchestra.run.smithi172.stdout:(94/142): zlib-devel-1.2.11-19.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-03-27T10:06:51.424 INFO:teuthology.orchestra.run.smithi191.stdout:(38/142): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2023-03-27T10:06:51.466 INFO:teuthology.orchestra.run.smithi191.stdout:(39/142): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-03-27T10:06:51.500 INFO:teuthology.orchestra.run.smithi191.stdout:(40/142): jq-1.6-6.el8.x86_64.rpm 5.9 MB/s | 202 kB 00:00 2023-03-27T10:06:51.526 INFO:teuthology.orchestra.run.smithi191.stdout:(41/142): libpq-13.5-1.el8.x86_64.rpm 7.7 MB/s | 198 kB 00:00 2023-03-27T10:06:51.559 INFO:teuthology.orchestra.run.smithi191.stdout:(42/142): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2023-03-27T10:06:51.562 INFO:teuthology.orchestra.run.smithi172.stdout:(95/142): liboath-2.6.2-3.el8.x86_64.rpm 416 kB/s | 59 kB 00:00 2023-03-27T10:06:51.588 INFO:teuthology.orchestra.run.smithi172.stdout:(96/142): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-03-27T10:06:51.593 INFO:teuthology.orchestra.run.smithi191.stdout:(43/142): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2023-03-27T10:06:51.627 INFO:teuthology.orchestra.run.smithi191.stdout:(44/142): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.6 MB/s | 259 kB 00:00 2023-03-27T10:06:51.638 INFO:teuthology.orchestra.run.smithi172.stdout:(97/142): libunwind-1.3.1-3.el8.x86_64.rpm 994 kB/s | 75 kB 00:00 2023-03-27T10:06:51.653 INFO:teuthology.orchestra.run.smithi191.stdout:(45/142): oniguruma-6.8.2-2.el8.x86_64.rpm 7.3 MB/s | 187 kB 00:00 2023-03-27T10:06:51.680 INFO:teuthology.orchestra.run.smithi172.stdout:(98/142): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-03-27T10:06:51.739 INFO:teuthology.orchestra.run.smithi172.stdout:(99/142): python3-asyncssh-2.7.0-2.el8.noarch.r 3.1 MB/s | 476 kB 00:00 2023-03-27T10:06:51.764 INFO:teuthology.orchestra.run.smithi172.stdout:(100/142): python3-beautifulsoup4-4.6.3-2.el8.1 2.2 MB/s | 185 kB 00:00 2023-03-27T10:06:51.781 INFO:teuthology.orchestra.run.smithi172.stdout:(101/142): python3-cachetools-3.1.1-4.el8.noarc 790 kB/s | 33 kB 00:00 2023-03-27T10:06:51.794 INFO:teuthology.orchestra.run.smithi191.stdout:(46/142): openblas-0.3.15-4.el8.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-03-27T10:06:51.806 INFO:teuthology.orchestra.run.smithi172.stdout:(102/142): python3-certifi-2018.10.15-7.el8.noa 392 kB/s | 16 kB 00:00 2023-03-27T10:06:51.887 INFO:teuthology.orchestra.run.smithi191.stdout:(47/142): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-03-27T10:06:52.232 INFO:teuthology.orchestra.run.smithi172.stdout:(103/142): ceph-test-18.0.0-2533.gb70fdf97.el8. 6.4 MB/s | 45 MB 00:07 2023-03-27T10:06:52.257 INFO:teuthology.orchestra.run.smithi172.stdout:(104/142): python3-cheroot-8.5.2-1.el8.noarch.r 363 kB/s | 173 kB 00:00 2023-03-27T10:06:52.291 INFO:teuthology.orchestra.run.smithi172.stdout:(105/142): python3-cherrypy-18.4.0-1.el8.noarch 794 kB/s | 384 kB 00:00 2023-03-27T10:06:52.316 INFO:teuthology.orchestra.run.smithi172.stdout:(106/142): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-03-27T10:06:52.329 INFO:teuthology.orchestra.run.smithi191.stdout:(48/142): ceph-test-18.0.0-2533.gb70fdf97.el8.x 9.4 MB/s | 45 MB 00:04 2023-03-27T10:06:52.341 INFO:teuthology.orchestra.run.smithi172.stdout:(107/142): python3-jaraco-functools-2.0-4.el8.n 353 kB/s | 18 kB 00:00 2023-03-27T10:06:52.391 INFO:teuthology.orchestra.run.smithi172.stdout:(108/142): python3-logutils-0.3.5-11.el8.noarch 975 kB/s | 49 kB 00:00 2023-03-27T10:06:52.417 INFO:teuthology.orchestra.run.smithi172.stdout:(109/142): python3-google-auth-1.1.1-10.el8.noa 442 kB/s | 81 kB 00:00 2023-03-27T10:06:52.442 INFO:teuthology.orchestra.run.smithi172.stdout:(110/142): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-03-27T10:06:52.463 INFO:teuthology.orchestra.run.smithi191.stdout:(49/142): openblas-threads-0.3.15-4.el8.x86_64. 7.3 MB/s | 4.9 MB 00:00 2023-03-27T10:06:52.467 INFO:teuthology.orchestra.run.smithi172.stdout:(111/142): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-03-27T10:06:52.496 INFO:teuthology.orchestra.run.smithi191.stdout:(50/142): postgresql-contrib-10.23-1.module_el8 5.4 MB/s | 903 kB 00:00 2023-03-27T10:06:52.518 INFO:teuthology.orchestra.run.smithi172.stdout:(112/142): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2023-03-27T10:06:52.568 INFO:teuthology.orchestra.run.smithi172.stdout:(113/142): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-03-27T10:06:52.593 INFO:teuthology.orchestra.run.smithi172.stdout:(114/142): python3-repoze-lru-0.7-6.el8.noarch. 449 kB/s | 34 kB 00:00 2023-03-27T10:06:52.630 INFO:teuthology.orchestra.run.smithi191.stdout:(51/142): postgresql-server-10.23-1.module_el8+ 31 MB/s | 5.1 MB 00:00 2023-03-27T10:06:52.643 INFO:teuthology.orchestra.run.smithi172.stdout:(115/142): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-03-27T10:06:52.664 INFO:teuthology.orchestra.run.smithi191.stdout:(52/142): python3-jinja2-2.10.1-3.el8.noarch.rp 16 MB/s | 538 kB 00:00 2023-03-27T10:06:52.677 INFO:teuthology.orchestra.run.smithi172.stdout:(116/142): python3-kubernetes-11.0.0-6.el8.noar 3.2 MB/s | 1.2 MB 00:00 2023-03-27T10:06:52.702 INFO:teuthology.orchestra.run.smithi172.stdout:(117/142): python3-simplegeneric-0.8.1-17.el8.n 321 kB/s | 19 kB 00:00 2023-03-27T10:06:52.706 INFO:teuthology.orchestra.run.smithi191.stdout:(53/142): postgresql-10.23-1.module_el8+300+2c5 1.9 MB/s | 1.6 MB 00:00 2023-03-27T10:06:52.728 INFO:teuthology.orchestra.run.smithi172.stdout:(118/142): python3-routes-2.4.1-12.el8.noarch.r 1.2 MB/s | 196 kB 00:00 2023-03-27T10:06:52.732 INFO:teuthology.orchestra.run.smithi191.stdout:(54/142): python3-jsonpatch-1.21-2.el8.noarch.r 397 kB/s | 27 kB 00:00 2023-03-27T10:06:52.752 INFO:teuthology.orchestra.run.smithi172.stdout:(119/142): python3-singledispatch-3.4.0.3-18.el 319 kB/s | 24 kB 00:00 2023-03-27T10:06:52.757 INFO:teuthology.orchestra.run.smithi191.stdout:(55/142): python3-jsonpointer-1.10-11.el8.noarc 805 kB/s | 20 kB 00:00 2023-03-27T10:06:52.778 INFO:teuthology.orchestra.run.smithi172.stdout:(120/142): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2023-03-27T10:06:52.782 INFO:teuthology.orchestra.run.smithi191.stdout:(56/142): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-03-27T10:06:52.803 INFO:teuthology.orchestra.run.smithi172.stdout:(121/142): python3-trustme-0.6.0-4.el8.noarch.r 366 kB/s | 27 kB 00:00 2023-03-27T10:06:52.807 INFO:teuthology.orchestra.run.smithi191.stdout:(57/142): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2023-03-27T10:06:52.841 INFO:teuthology.orchestra.run.smithi191.stdout:(58/142): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.6 MB/s | 225 kB 00:00 2023-03-27T10:06:52.853 INFO:teuthology.orchestra.run.smithi172.stdout:(122/142): python3-waitress-1.2.1-2.el8.1.noarc 2.3 MB/s | 241 kB 00:00 2023-03-27T10:06:52.858 INFO:teuthology.orchestra.run.smithi191.stdout:(59/142): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-03-27T10:06:52.878 INFO:teuthology.orchestra.run.smithi172.stdout:(123/142): python3-websocket-client-0.56.0-5.el 816 kB/s | 61 kB 00:00 2023-03-27T10:06:52.884 INFO:teuthology.orchestra.run.smithi191.stdout:(60/142): python3-pyOpenSSL-19.0.0-1.el8.noarch 4.1 MB/s | 103 kB 00:00 2023-03-27T10:06:52.904 INFO:teuthology.orchestra.run.smithi172.stdout:(124/142): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2023-03-27T10:06:52.909 INFO:teuthology.orchestra.run.smithi191.stdout:(61/142): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.0 MB/s | 126 kB 00:00 2023-03-27T10:06:52.929 INFO:teuthology.orchestra.run.smithi172.stdout:(125/142): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-03-27T10:06:52.934 INFO:teuthology.orchestra.run.smithi191.stdout:(62/142): python3-pyasn1-modules-0.3.7-6.el8.no 4.3 MB/s | 110 kB 00:00 2023-03-27T10:06:52.954 INFO:teuthology.orchestra.run.smithi172.stdout:(126/142): python3-zc-lockfile-2.0-2.el8.noarch 304 kB/s | 23 kB 00:00 2023-03-27T10:06:52.960 INFO:teuthology.orchestra.run.smithi191.stdout:(63/142): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-03-27T10:06:53.102 INFO:teuthology.orchestra.run.smithi191.stdout:(64/142): python3-babel-2.5.1-7.el8.noarch.rpm 7.9 MB/s | 4.8 MB 00:00 2023-03-27T10:06:53.153 INFO:teuthology.orchestra.run.smithi191.stdout:(65/142): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-03-27T10:06:53.195 INFO:teuthology.orchestra.run.smithi191.stdout:(66/142): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-03-27T10:06:53.228 INFO:teuthology.orchestra.run.smithi191.stdout:(67/142): uuid-1.6.2-43.el8.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2023-03-27T10:06:53.271 INFO:teuthology.orchestra.run.smithi172.stdout:(127/142): librados2-18.0.0-2533.gb70fdf97.el8. 11 MB/s | 3.6 MB 00:00 2023-03-27T10:06:53.296 INFO:teuthology.orchestra.run.smithi191.stdout:(68/142): python3-numpy-1.14.3-10.el8.x86_64.rp 7.3 MB/s | 3.7 MB 00:00 2023-03-27T10:06:53.313 INFO:teuthology.orchestra.run.smithi191.stdout:(69/142): xmlstarlet-1.6.1-20.el8.x86_64.rpm 843 kB/s | 71 kB 00:00 2023-03-27T10:06:53.322 INFO:teuthology.orchestra.run.smithi172.stdout:(128/142): thrift-0.13.0-2.el8.x86_64.rpm 4.2 MB/s | 1.7 MB 00:00 2023-03-27T10:06:53.347 INFO:teuthology.orchestra.run.smithi191.stdout:(70/142): elfutils-libelf-devel-0.188-3.el8.x86 1.8 MB/s | 61 kB 00:00 2023-03-27T10:06:53.347 INFO:teuthology.orchestra.run.smithi172.stdout:(129/142): NetworkManager-initscripts-updown-1. 1.8 MB/s | 142 kB 00:00 2023-03-27T10:06:53.372 INFO:teuthology.orchestra.run.smithi191.stdout:(71/142): fuse-2.9.7-16.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-03-27T10:06:53.372 INFO:teuthology.orchestra.run.smithi172.stdout:(130/142): elfutils-debuginfod-client-0.188-3.e 1.5 MB/s | 75 kB 00:00 2023-03-27T10:06:53.397 INFO:teuthology.orchestra.run.smithi191.stdout:(72/142): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2023-03-27T10:06:53.416 INFO:teuthology.orchestra.run.smithi172.stdout:(131/142): elfutils-libelf-0.188-3.el8.x86_64.r 3.4 MB/s | 231 kB 00:00 2023-03-27T10:06:53.422 INFO:teuthology.orchestra.run.smithi191.stdout:(73/142): libaio-devel-0.3.112-1.el8.x86_64.rpm 751 kB/s | 19 kB 00:00 2023-03-27T10:06:53.448 INFO:teuthology.orchestra.run.smithi191.stdout:(74/142): libcom_err-devel-1.45.6-5.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2023-03-27T10:06:53.481 INFO:teuthology.orchestra.run.smithi172.stdout:(132/142): librbd1-18.0.0-2533.gb70fdf97.el8.x8 6.8 MB/s | 3.6 MB 00:00 2023-03-27T10:06:53.482 INFO:teuthology.orchestra.run.smithi191.stdout:(75/142): krb5-devel-1.18.2-22.el8.x86_64.rpm 5.0 MB/s | 561 kB 00:00 2023-03-27T10:06:53.515 INFO:teuthology.orchestra.run.smithi172.stdout:(133/142): elfutils-libs-0.188-3.el8.x86_64.rpm 2.1 MB/s | 299 kB 00:00 2023-03-27T10:06:53.516 INFO:teuthology.orchestra.run.smithi191.stdout:(76/142): libquadmath-8.5.0-18.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-03-27T10:06:53.549 INFO:teuthology.orchestra.run.smithi172.stdout:(134/142): libblkid-2.32.1-41.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-03-27T10:06:53.559 INFO:teuthology.orchestra.run.smithi191.stdout:(77/142): libgfortran-8.5.0-18.el8.x86_64.rpm 5.8 MB/s | 645 kB 00:00 2023-03-27T10:06:53.583 INFO:teuthology.orchestra.run.smithi191.stdout:(78/142): librabbitmq-0.9.0-3.el8.x86_64.rpm 698 kB/s | 47 kB 00:00 2023-03-27T10:06:53.608 INFO:teuthology.orchestra.run.smithi191.stdout:(79/142): libselinux-devel-2.9-6.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-03-27T10:06:53.628 INFO:teuthology.orchestra.run.smithi172.stdout:(135/142): libfdisk-2.32.1-41.el8.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2023-03-27T10:06:53.634 INFO:teuthology.orchestra.run.smithi191.stdout:(80/142): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-03-27T10:06:53.658 INFO:teuthology.orchestra.run.smithi172.stdout:(136/142): libmount-2.32.1-41.el8.x86_64.rpm 1.6 MB/s | 236 kB 00:00 2023-03-27T10:06:53.660 INFO:teuthology.orchestra.run.smithi191.stdout:(81/142): libuuid-devel-2.32.1-41.el8.x86_64.rp 1.9 MB/s | 99 kB 00:00 2023-03-27T10:06:53.683 INFO:teuthology.orchestra.run.smithi172.stdout:(137/142): libsmartcols-2.32.1-41.el8.x86_64.rp 1.3 MB/s | 179 kB 00:00 2023-03-27T10:06:53.684 INFO:teuthology.orchestra.run.smithi191.stdout:(82/142): libverto-devel-0.3.2-2.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-03-27T10:06:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:(138/142): libuuid-2.32.1-41.el8.x86_64.rpm 1.2 MB/s | 98 kB 00:00 2023-03-27T10:06:53.753 INFO:teuthology.orchestra.run.smithi191.stdout:(83/142): pcre2-devel-10.32-3.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-03-27T10:06:53.802 INFO:teuthology.orchestra.run.smithi191.stdout:(84/142): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-03-27T10:06:53.817 INFO:teuthology.orchestra.run.smithi172.stdout:(139/142): openssl-1.1.1k-9.el8.x86_64.rpm 4.5 MB/s | 737 kB 00:00 2023-03-27T10:06:53.850 INFO:teuthology.orchestra.run.smithi172.stdout:(140/142): util-linux-user-2.32.1-41.el8.x86_64 3.0 MB/s | 102 kB 00:00 2023-03-27T10:06:53.900 INFO:teuthology.orchestra.run.smithi172.stdout:(141/142): util-linux-2.32.1-41.el8.x86_64.rpm 14 MB/s | 2.6 MB 00:00 2023-03-27T10:06:53.942 INFO:teuthology.orchestra.run.smithi172.stdout:(142/142): openssl-libs-1.1.1k-9.el8.x86_64.rpm 5.7 MB/s | 1.5 MB 00:00 2023-03-27T10:06:53.944 INFO:teuthology.orchestra.run.smithi191.stdout:(85/142): python3-scipy-1.0.0-21.module_el8.5.0 14 MB/s | 14 MB 00:00 2023-03-27T10:06:53.947 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-03-27T10:06:53.947 INFO:teuthology.orchestra.run.smithi172.stdout:Total 17 MB/s | 205 MB 00:11 2023-03-27T10:06:53.973 INFO:teuthology.orchestra.run.smithi191.stdout:(86/142): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2023-03-27T10:06:53.995 INFO:teuthology.orchestra.run.smithi191.stdout:(87/142): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.7 MB/s | 237 kB 00:00 2023-03-27T10:06:54.020 INFO:teuthology.orchestra.run.smithi191.stdout:(88/142): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2023-03-27T10:06:54.045 INFO:teuthology.orchestra.run.smithi191.stdout:(89/142): python3-oauthlib-2.1.0-1.el8.noarch.r 6.0 MB/s | 155 kB 00:00 2023-03-27T10:06:54.104 INFO:teuthology.orchestra.run.smithi191.stdout:(90/142): openssl-devel-1.1.1k-9.el8.x86_64.rpm 7.2 MB/s | 3.2 MB 00:00 2023-03-27T10:06:54.129 INFO:teuthology.orchestra.run.smithi191.stdout:(91/142): python3-cryptography-3.2.1-5.el8.x86_ 3.4 MB/s | 559 kB 00:00 2023-03-27T10:06:54.155 INFO:teuthology.orchestra.run.smithi191.stdout:(92/142): python3-pycparser-2.14-14.el8.noarch. 998 kB/s | 109 kB 00:00 2023-03-27T10:06:54.180 INFO:teuthology.orchestra.run.smithi191.stdout:(93/142): python3-requests-oauthlib-1.0.0-1.el8 845 kB/s | 43 kB 00:00 2023-03-27T10:06:54.215 INFO:teuthology.orchestra.run.smithi191.stdout:(94/142): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 858 kB/s | 72 kB 00:00 2023-03-27T10:06:54.241 INFO:teuthology.orchestra.run.smithi191.stdout:(95/142): zlib-devel-1.2.11-19.el8.x86_64.rpm 687 kB/s | 58 kB 00:00 2023-03-27T10:06:54.348 INFO:teuthology.orchestra.run.smithi191.stdout:(96/142): liboath-2.6.2-3.el8.x86_64.rpm 440 kB/s | 59 kB 00:00 2023-03-27T10:06:54.374 INFO:teuthology.orchestra.run.smithi191.stdout:(97/142): libunwind-1.3.1-3.el8.x86_64.rpm 561 kB/s | 75 kB 00:00 2023-03-27T10:06:54.424 INFO:teuthology.orchestra.run.smithi191.stdout:(98/142): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-03-27T10:06:54.449 INFO:teuthology.orchestra.run.smithi191.stdout:(99/142): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 580 kB/s | 44 kB 00:00 2023-03-27T10:06:54.500 INFO:teuthology.orchestra.run.smithi191.stdout:(100/142): python3-cachetools-3.1.1-4.el8.noarc 658 kB/s | 33 kB 00:00 2023-03-27T10:06:54.528 INFO:teuthology.orchestra.run.smithi191.stdout:(101/142): python3-beautifulsoup4-4.6.3-2.el8.1 1.8 MB/s | 185 kB 00:00 2023-03-27T10:06:54.551 INFO:teuthology.orchestra.run.smithi191.stdout:(102/142): python3-asyncssh-2.7.0-2.el8.noarch. 2.3 MB/s | 476 kB 00:00 2023-03-27T10:06:54.576 INFO:teuthology.orchestra.run.smithi191.stdout:(103/142): python3-certifi-2018.10.15-7.el8.noa 215 kB/s | 16 kB 00:00 2023-03-27T10:06:54.601 INFO:teuthology.orchestra.run.smithi191.stdout:(104/142): python3-cheroot-8.5.2-1.el8.noarch.r 2.2 MB/s | 173 kB 00:00 2023-03-27T10:06:54.627 INFO:teuthology.orchestra.run.smithi191.stdout:(105/142): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-03-27T10:06:54.652 INFO:teuthology.orchestra.run.smithi191.stdout:(106/142): python3-jaraco-6.2-6.el8.noarch.rpm 219 kB/s | 11 kB 00:00 2023-03-27T10:06:54.678 INFO:teuthology.orchestra.run.smithi191.stdout:(107/142): python3-jaraco-functools-2.0-4.el8.n 348 kB/s | 18 kB 00:00 2023-03-27T10:06:54.703 INFO:teuthology.orchestra.run.smithi191.stdout:(108/142): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2023-03-27T10:06:54.728 INFO:teuthology.orchestra.run.smithi191.stdout:(109/142): python3-logutils-0.3.5-11.el8.noarch 969 kB/s | 49 kB 00:00 2023-03-27T10:06:54.762 INFO:teuthology.orchestra.run.smithi191.stdout:(110/142): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-03-27T10:06:54.788 INFO:teuthology.orchestra.run.smithi191.stdout:(111/142): python3-natsort-7.1.1-2.el8.noarch.r 1.0 MB/s | 60 kB 00:00 2023-03-27T10:06:54.838 INFO:teuthology.orchestra.run.smithi191.stdout:(112/142): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-03-27T10:06:54.896 INFO:teuthology.orchestra.run.smithi191.stdout:(113/142): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-03-27T10:06:54.930 INFO:teuthology.orchestra.run.smithi191.stdout:(114/142): python3-kubernetes-11.0.0-6.el8.noar 4.2 MB/s | 1.2 MB 00:00 2023-03-27T10:06:54.956 INFO:teuthology.orchestra.run.smithi191.stdout:(115/142): python3-repoze-lru-0.7-6.el8.noarch. 286 kB/s | 34 kB 00:00 2023-03-27T10:06:54.981 INFO:teuthology.orchestra.run.smithi191.stdout:(116/142): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2023-03-27T10:06:55.006 INFO:teuthology.orchestra.run.smithi191.stdout:(117/142): python3-rsa-4.8-1.el8.noarch.rpm 814 kB/s | 61 kB 00:00 2023-03-27T10:06:55.032 INFO:teuthology.orchestra.run.smithi191.stdout:(118/142): python3-simplegeneric-0.8.1-17.el8.n 247 kB/s | 19 kB 00:00 2023-03-27T10:06:55.082 INFO:teuthology.orchestra.run.smithi191.stdout:(119/142): python3-singledispatch-3.4.0.3-18.el 237 kB/s | 24 kB 00:00 2023-03-27T10:06:55.108 INFO:teuthology.orchestra.run.smithi191.stdout:(120/142): python3-tempora-1.14.1-5.el8.noarch. 290 kB/s | 29 kB 00:00 2023-03-27T10:06:55.133 INFO:teuthology.orchestra.run.smithi191.stdout:(121/142): python3-trustme-0.6.0-4.el8.noarch.r 274 kB/s | 27 kB 00:00 2023-03-27T10:06:55.183 INFO:teuthology.orchestra.run.smithi191.stdout:(122/142): python3-waitress-1.2.1-2.el8.1.noarc 2.3 MB/s | 241 kB 00:00 2023-03-27T10:06:55.209 INFO:teuthology.orchestra.run.smithi191.stdout:(123/142): python3-websocket-client-0.56.0-5.el 816 kB/s | 61 kB 00:00 2023-03-27T10:06:55.234 INFO:teuthology.orchestra.run.smithi191.stdout:(124/142): python3-webob-1.8.5-1.el8.1.noarch.r 2.4 MB/s | 251 kB 00:00 2023-03-27T10:06:55.259 INFO:teuthology.orchestra.run.smithi191.stdout:(125/142): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-03-27T10:06:55.285 INFO:teuthology.orchestra.run.smithi191.stdout:(126/142): python3-zc-lockfile-2.0-2.el8.noarch 303 kB/s | 23 kB 00:00 2023-03-27T10:06:55.543 INFO:teuthology.orchestra.run.smithi191.stdout:(127/142): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-03-27T10:06:55.546 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-03-27T10:06:55.577 INFO:teuthology.orchestra.run.smithi191.stdout:(128/142): NetworkManager-initscripts-updown-1. 4.2 MB/s | 142 kB 00:00 2023-03-27T10:06:55.644 INFO:teuthology.orchestra.run.smithi191.stdout:(129/142): librados2-18.0.0-2533.gb70fdf97.el8. 9.5 MB/s | 3.6 MB 00:00 2023-03-27T10:06:55.669 INFO:teuthology.orchestra.run.smithi191.stdout:(130/142): elfutils-debuginfod-client-0.188-3.e 822 kB/s | 75 kB 00:00 2023-03-27T10:06:55.703 INFO:teuthology.orchestra.run.smithi191.stdout:(131/142): elfutils-libs-0.188-3.el8.x86_64.rpm 8.8 MB/s | 299 kB 00:00 2023-03-27T10:06:55.729 INFO:teuthology.orchestra.run.smithi191.stdout:(132/142): elfutils-libelf-0.188-3.el8.x86_64.r 2.7 MB/s | 231 kB 00:00 2023-03-27T10:06:55.764 INFO:teuthology.orchestra.run.smithi191.stdout:(133/142): libblkid-2.32.1-41.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-03-27T10:06:55.796 INFO:teuthology.orchestra.run.smithi191.stdout:(134/142): libmount-2.32.1-41.el8.x86_64.rpm 6.9 MB/s | 236 kB 00:00 2023-03-27T10:06:55.822 INFO:teuthology.orchestra.run.smithi191.stdout:(135/142): libfdisk-2.32.1-41.el8.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2023-03-27T10:06:55.847 INFO:teuthology.orchestra.run.smithi191.stdout:(136/142): libsmartcols-2.32.1-41.el8.x86_64.rp 3.5 MB/s | 179 kB 00:00 2023-03-27T10:06:55.853 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-03-27T10:06:55.854 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-03-27T10:06:55.872 INFO:teuthology.orchestra.run.smithi191.stdout:(137/142): libuuid-2.32.1-41.el8.x86_64.rpm 1.9 MB/s | 98 kB 00:00 2023-03-27T10:06:55.940 INFO:teuthology.orchestra.run.smithi191.stdout:(138/142): librbd1-18.0.0-2533.gb70fdf97.el8.x8 5.4 MB/s | 3.6 MB 00:00 2023-03-27T10:06:55.981 INFO:teuthology.orchestra.run.smithi191.stdout:(139/142): openssl-1.1.1k-9.el8.x86_64.rpm 5.4 MB/s | 737 kB 00:00 2023-03-27T10:06:56.007 INFO:teuthology.orchestra.run.smithi191.stdout:(140/142): util-linux-user-2.32.1-41.el8.x86_64 4.0 MB/s | 102 kB 00:00 2023-03-27T10:06:56.074 INFO:teuthology.orchestra.run.smithi191.stdout:(141/142): util-linux-2.32.1-41.el8.x86_64.rpm 19 MB/s | 2.6 MB 00:00 2023-03-27T10:06:56.107 INFO:teuthology.orchestra.run.smithi191.stdout:(142/142): openssl-libs-1.1.1k-9.el8.x86_64.rpm 6.3 MB/s | 1.5 MB 00:00 2023-03-27T10:06:56.113 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-03-27T10:06:56.113 INFO:teuthology.orchestra.run.smithi191.stdout:Total 15 MB/s | 205 MB 00:13 2023-03-27T10:06:57.433 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-03-27T10:06:57.437 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-03-27T10:06:57.714 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-03-27T10:06:58.017 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-03-27T10:06:58.018 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-03-27T10:06:59.546 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-03-27T10:06:59.550 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-03-27T10:07:02.917 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-03-27T10:07:03.108 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 1/1 2023-03-27T10:07:03.299 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8.x86_64 1/157 2023-03-27T10:07:03.539 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 1/157 2023-03-27T10:07:03.734 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/157 2023-03-27T10:07:04.195 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libuuid-2.32.1-41.el8.x86_64 3/157 2023-03-27T10:07:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 3/157 2023-03-27T10:07:04.461 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libblkid-2.32.1-41.el8.x86_64 4/157 2023-03-27T10:07:04.576 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 4/157 2023-03-27T10:07:04.789 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/157 2023-03-27T10:07:04.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/157 2023-03-27T10:07:04.978 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-03-27T10:07:05.015 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/157 2023-03-27T10:07:05.166 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 1/1 2023-03-27T10:07:05.232 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/157 2023-03-27T10:07:05.411 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/157 2023-03-27T10:07:05.425 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8.x86_64 1/157 2023-03-27T10:07:05.675 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 1/157 2023-03-27T10:07:05.862 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/157 2023-03-27T10:07:05.880 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/157 2023-03-27T10:07:06.025 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libuuid-2.32.1-41.el8.x86_64 3/157 2023-03-27T10:07:06.069 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 9/157 2023-03-27T10:07:06.124 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 3/157 2023-03-27T10:07:06.316 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libblkid-2.32.1-41.el8.x86_64 4/157 2023-03-27T10:07:06.409 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 4/157 2023-03-27T10:07:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 9/157 2023-03-27T10:07:06.633 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/157 2023-03-27T10:07:06.694 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 10/157 2023-03-27T10:07:06.791 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/157 2023-03-27T10:07:06.843 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 10/157 2023-03-27T10:07:06.865 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/157 2023-03-27T10:07:07.020 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 11/157 2023-03-27T10:07:07.075 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/157 2023-03-27T10:07:07.138 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 11/157 2023-03-27T10:07:07.266 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/157 2023-03-27T10:07:07.361 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:18.0.0-2533.gb70fdf97.el8.x86_64 12/157 2023-03-27T10:07:07.590 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpq-13.5-1.el8.x86_64 13/157 2023-03-27T10:07:07.711 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/157 2023-03-27T10:07:07.866 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 14/157 2023-03-27T10:07:07.916 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 9/157 2023-03-27T10:07:08.077 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/157 2023-03-27T10:07:08.351 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 9/157 2023-03-27T10:07:08.502 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/157 2023-03-27T10:07:08.724 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/157 2023-03-27T10:07:08.757 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 10/157 2023-03-27T10:07:08.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 18/157 2023-03-27T10:07:08.905 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 10/157 2023-03-27T10:07:09.090 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 11/157 2023-03-27T10:07:09.203 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 18/157 2023-03-27T10:07:09.208 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 11/157 2023-03-27T10:07:09.385 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86 19/157 2023-03-27T10:07:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:18.0.0-2533.gb70fdf97.el8.x86_64 12/157 2023-03-27T10:07:09.525 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86 19/157 2023-03-27T10:07:09.642 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpq-13.5-1.el8.x86_64 13/157 2023-03-27T10:07:09.748 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/157 2023-03-27T10:07:09.888 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libelf-0.188-3.el8.x86_64 14/157 2023-03-27T10:07:09.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-19.el8.x86_64 21/157 2023-03-27T10:07:10.085 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 22/157 2023-03-27T10:07:10.087 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/157 2023-03-27T10:07:10.235 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 22/157 2023-03-27T10:07:10.385 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 23/157 2023-03-27T10:07:10.540 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/157 2023-03-27T10:07:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/157 2023-03-27T10:07:10.965 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 18/157 2023-03-27T10:07:11.062 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 23/157 2023-03-27T10:07:11.092 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 18/157 2023-03-27T10:07:11.268 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/157 2023-03-27T10:07:11.290 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86 19/157 2023-03-27T10:07:11.430 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86 19/157 2023-03-27T10:07:11.679 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/157 2023-03-27T10:07:11.883 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-19.el8.x86_64 21/157 2023-03-27T10:07:11.976 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/157 2023-03-27T10:07:12.032 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 22/157 2023-03-27T10:07:12.160 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/157 2023-03-27T10:07:12.171 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 22/157 2023-03-27T10:07:12.307 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 23/157 2023-03-27T10:07:12.966 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 23/157 2023-03-27T10:07:12.968 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/157 2023-03-27T10:07:13.181 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/157 2023-03-27T10:07:13.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/157 2023-03-27T10:07:13.543 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/157 2023-03-27T10:07:13.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/157 2023-03-27T10:07:13.865 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/157 2023-03-27T10:07:13.928 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/157 2023-03-27T10:07:14.056 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/157 2023-03-27T10:07:14.150 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:18.0.0-2533.gb70fdf97.el8. 30/157 2023-03-27T10:07:14.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:18.0.0-2533.gb70fdf97.el 31/157 2023-03-27T10:07:14.601 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:18.0.0-2533.gb70fdf97.el8.x86_6 32/157 2023-03-27T10:07:14.863 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/157 2023-03-27T10:07:15.271 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/157 2023-03-27T10:07:15.500 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/157 2023-03-27T10:07:15.629 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/157 2023-03-27T10:07:15.688 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/157 2023-03-27T10:07:15.899 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/157 2023-03-27T10:07:16.053 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/157 2023-03-27T10:07:16.138 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:18.0.0-2533.gb70fdf97.el8. 30/157 2023-03-27T10:07:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:18.0.0-2533.gb70fdf97.el 31/157 2023-03-27T10:07:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/157 2023-03-27T10:07:16.550 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/157 2023-03-27T10:07:16.570 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:18.0.0-2533.gb70fdf97.el8.x86_6 32/157 2023-03-27T10:07:17.634 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/157 2023-03-27T10:07:18.065 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/157 2023-03-27T10:07:18.424 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/157 2023-03-27T10:07:18.597 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/157 2023-03-27T10:07:18.672 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/157 2023-03-27T10:07:18.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/157 2023-03-27T10:07:19.141 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/157 2023-03-27T10:07:19.367 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/157 2023-03-27T10:07:19.545 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 40/157 2023-03-27T10:07:19.756 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 41/157 2023-03-27T10:07:19.958 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 42/157 2023-03-27T10:07:20.135 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:18.0.0-2533.gb70fdf97.el8.x86_6 43/157 2023-03-27T10:07:20.317 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libfdisk-2.32.1-41.el8.x86_64 44/157 2023-03-27T10:07:20.404 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 44/157 2023-03-27T10:07:20.575 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libmount-2.32.1-41.el8.x86_64 45/157 2023-03-27T10:07:20.654 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 45/157 2023-03-27T10:07:20.698 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/157 2023-03-27T10:07:20.852 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 46/157 2023-03-27T10:07:21.055 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 47/157 2023-03-27T10:07:21.058 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/157 2023-03-27T10:07:21.233 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libsmartcols-2.32.1-41.el8.x86_64 48/157 2023-03-27T10:07:21.271 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/157 2023-03-27T10:07:21.501 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/157 2023-03-27T10:07:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libs-0.188-3.el8.x86_64 40/157 2023-03-27T10:07:21.804 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 48/157 2023-03-27T10:07:21.951 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-debuginfod-client-0.188-3.el8.x86_64 41/157 2023-03-27T10:07:22.109 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : util-linux-2.32.1-41.el8.x86_64 49/157 2023-03-27T10:07:22.136 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: util-linux-2.32.1-41.el8.x86_64 49/157 2023-03-27T10:07:22.170 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 42/157 2023-03-27T10:07:22.332 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 50/157 2023-03-27T10:07:22.362 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:18.0.0-2533.gb70fdf97.el8.x86_6 43/157 2023-03-27T10:07:22.555 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libfdisk-2.32.1-41.el8.x86_64 44/157 2023-03-27T10:07:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 51/157 2023-03-27T10:07:22.651 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 44/157 2023-03-27T10:07:22.825 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 52/157 2023-03-27T10:07:22.855 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libmount-2.32.1-41.el8.x86_64 45/157 2023-03-27T10:07:22.927 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 45/157 2023-03-27T10:07:23.005 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 53/157 2023-03-27T10:07:23.130 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 46/157 2023-03-27T10:07:23.204 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 54/157 2023-03-27T10:07:23.351 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 47/157 2023-03-27T10:07:23.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 55/157 2023-03-27T10:07:23.537 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libsmartcols-2.32.1-41.el8.x86_64 48/157 2023-03-27T10:07:23.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 56/157 2023-03-27T10:07:23.922 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 57/157 2023-03-27T10:07:24.101 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 48/157 2023-03-27T10:07:24.162 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 58/157 2023-03-27T10:07:24.366 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 59/157 2023-03-27T10:07:24.430 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-2.32.1-41.el8.x86_64 49/157 2023-03-27T10:07:24.456 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: util-linux-2.32.1-41.el8.x86_64 49/157 2023-03-27T10:07:24.573 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 60/157 2023-03-27T10:07:24.645 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 50/157 2023-03-27T10:07:24.773 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 61/157 2023-03-27T10:07:24.922 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 51/157 2023-03-27T10:07:24.968 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-2.6-1.el8.noarch 62/157 2023-03-27T10:07:25.162 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 52/157 2023-03-27T10:07:25.178 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/157 2023-03-27T10:07:25.343 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 53/157 2023-03-27T10:07:25.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/157 2023-03-27T10:07:25.517 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 54/157 2023-03-27T10:07:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/157 2023-03-27T10:07:25.766 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 55/157 2023-03-27T10:07:25.949 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 66/157 2023-03-27T10:07:26.002 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 56/157 2023-03-27T10:07:26.234 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 57/157 2023-03-27T10:07:26.271 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 67/157 2023-03-27T10:07:26.466 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 58/157 2023-03-27T10:07:26.559 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 68/157 2023-03-27T10:07:26.670 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 59/157 2023-03-27T10:07:26.795 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 69/157 2023-03-27T10:07:26.860 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 60/157 2023-03-27T10:07:27.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 61/157 2023-03-27T10:07:27.264 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-2.6-1.el8.noarch 62/157 2023-03-27T10:07:27.482 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/157 2023-03-27T10:07:27.650 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 70/157 2023-03-27T10:07:27.731 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/157 2023-03-27T10:07:27.907 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 71/157 2023-03-27T10:07:27.992 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/157 2023-03-27T10:07:27.993 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 71/157 2023-03-27T10:07:28.244 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 66/157 2023-03-27T10:07:28.259 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 72/157 2023-03-27T10:07:28.484 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/157 2023-03-27T10:07:28.623 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 67/157 2023-03-27T10:07:28.920 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 74/157 2023-03-27T10:07:29.006 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 68/157 2023-03-27T10:07:29.180 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 75/157 2023-03-27T10:07:29.258 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 69/157 2023-03-27T10:07:29.396 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/157 2023-03-27T10:07:29.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/157 2023-03-27T10:07:29.909 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/157 2023-03-27T10:07:30.126 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 70/157 2023-03-27T10:07:30.362 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 71/157 2023-03-27T10:07:30.451 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 71/157 2023-03-27T10:07:30.713 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 72/157 2023-03-27T10:07:30.962 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/157 2023-03-27T10:07:31.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/157 2023-03-27T10:07:31.405 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 74/157 2023-03-27T10:07:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/157 2023-03-27T10:07:31.718 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 75/157 2023-03-27T10:07:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/157 2023-03-27T10:07:31.976 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/157 2023-03-27T10:07:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/157 2023-03-27T10:07:32.245 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/157 2023-03-27T10:07:32.479 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/157 2023-03-27T10:07:32.487 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/157 2023-03-27T10:07:32.743 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/157 2023-03-27T10:07:33.003 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/157 2023-03-27T10:07:33.229 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/157 2023-03-27T10:07:33.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/157 2023-03-27T10:07:33.767 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/157 2023-03-27T10:07:33.800 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/157 2023-03-27T10:07:33.998 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/157 2023-03-27T10:07:34.306 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/157 2023-03-27T10:07:34.568 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 91/157 2023-03-27T10:07:34.603 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/157 2023-03-27T10:07:34.938 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/157 2023-03-27T10:07:35.104 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/157 2023-03-27T10:07:35.246 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/157 2023-03-27T10:07:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/157 2023-03-27T10:07:35.576 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/157 2023-03-27T10:07:35.617 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/157 2023-03-27T10:07:35.775 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.7-16.el8.x86_64 95/157 2023-03-27T10:07:35.889 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/157 2023-03-27T10:07:35.984 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/157 2023-03-27T10:07:36.139 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/157 2023-03-27T10:07:36.149 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/157 2023-03-27T10:07:36.220 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/157 2023-03-27T10:07:36.364 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/157 2023-03-27T10:07:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/157 2023-03-27T10:07:36.738 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/157 2023-03-27T10:07:36.980 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/157 2023-03-27T10:07:37.178 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/157 2023-03-27T10:07:37.487 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/157 2023-03-27T10:07:37.724 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 91/157 2023-03-27T10:07:37.909 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/157 2023-03-27T10:07:38.158 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/157 2023-03-27T10:07:38.388 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/157 2023-03-27T10:07:38.638 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.7-16.el8.x86_64 95/157 2023-03-27T10:07:38.885 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/157 2023-03-27T10:07:39.093 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/157 2023-03-27T10:07:39.178 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/157 2023-03-27T10:07:39.336 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/157 2023-03-27T10:07:40.903 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 99/157 2023-03-27T10:07:41.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 99/157 2023-03-27T10:07:41.811 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 99/157 2023-03-27T10:07:42.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 100/157 2023-03-27T10:07:42.326 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 100/157 2023-03-27T10:07:42.479 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 101/157 2023-03-27T10:07:43.894 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 99/157 2023-03-27T10:07:44.185 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 99/157 2023-03-27T10:07:44.810 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 99/157 2023-03-27T10:07:45.959 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 100/157 2023-03-27T10:07:46.168 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 100/157 2023-03-27T10:07:46.350 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 101/157 2023-03-27T10:08:03.382 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 101/157 2023-03-27T10:08:03.383 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2023-03-27T10:08:03.383 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2023-03-27T10:08:03.383 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-03-27T10:08:03.384 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /run 2023-03-27T10:08:03.384 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2023-03-27T10:08:03.384 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2023-03-27T10:08:03.385 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2023-03-27T10:08:03.385 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2023-03-27T10:08:03.385 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-03-27T10:08:03.385 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:03.785 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 102/157 2023-03-27T10:08:05.362 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 102/157 2023-03-27T10:08:05.572 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 103/157 2023-03-27T10:08:05.834 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 103/157 2023-03-27T10:08:06.026 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 104/157 2023-03-27T10:08:06.464 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 104/157 2023-03-27T10:08:06.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 105/157 2023-03-27T10:08:06.713 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 105/157 2023-03-27T10:08:06.934 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/157 2023-03-27T10:08:07.130 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 101/157 2023-03-27T10:08:07.131 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2023-03-27T10:08:07.131 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2023-03-27T10:08:07.131 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-03-27T10:08:07.131 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /run 2023-03-27T10:08:07.131 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2023-03-27T10:08:07.131 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2023-03-27T10:08:07.132 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2023-03-27T10:08:07.132 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2023-03-27T10:08:07.132 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-03-27T10:08:07.132 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:07.132 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/157 2023-03-27T10:08:07.293 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 108/157 2023-03-27T10:08:07.385 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 108/157 2023-03-27T10:08:07.556 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 102/157 2023-03-27T10:08:07.668 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.6-6.el8.x86_64 109/157 2023-03-27T10:08:07.931 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.1-7.el8.noarch 110/157 2023-03-27T10:08:09.136 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 102/157 2023-03-27T10:08:09.355 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 103/157 2023-03-27T10:08:09.615 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 103/157 2023-03-27T10:08:09.855 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 104/157 2023-03-27T10:08:10.292 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 104/157 2023-03-27T10:08:10.374 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 111/157 2023-03-27T10:08:10.522 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 105/157 2023-03-27T10:08:10.533 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 111/157 2023-03-27T10:08:10.567 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 105/157 2023-03-27T10:08:10.658 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2533.gb70fdf97.e 112/157 2023-03-27T10:08:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/157 2023-03-27T10:08:10.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2533.gb70fdf97. 113/157 2023-03-27T10:08:11.026 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/157 2023-03-27T10:08:11.066 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noa 114/157 2023-03-27T10:08:11.196 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 108/157 2023-03-27T10:08:11.294 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 108/157 2023-03-27T10:08:11.327 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noa 114/157 2023-03-27T10:08:11.588 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.n 115/157 2023-03-27T10:08:11.596 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-6.el8.x86_64 109/157 2023-03-27T10:08:11.902 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.1-7.el8.noarch 110/157 2023-03-27T10:08:12.693 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.n 115/157 2023-03-27T10:08:12.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70 116/157 2023-03-27T10:08:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70 116/157 2023-03-27T10:08:13.430 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2533.gb70fdf97.el 117/157 2023-03-27T10:08:13.651 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 118/157 2023-03-27T10:08:13.711 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 118/157 2023-03-27T10:08:13.890 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 119/157 2023-03-27T10:08:13.915 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 119/157 2023-03-27T10:08:14.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:18.0.0-2533.gb70fdf97.el8.x86_64 120/157 2023-03-27T10:08:14.257 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/157 2023-03-27T10:08:14.380 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 111/157 2023-03-27T10:08:14.565 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 111/157 2023-03-27T10:08:14.701 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2533.gb70fdf97.e 112/157 2023-03-27T10:08:14.927 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2533.gb70fdf97. 113/157 2023-03-27T10:08:15.154 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noa 114/157 2023-03-27T10:08:15.410 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noa 114/157 2023-03-27T10:08:15.687 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.n 115/157 2023-03-27T10:08:16.798 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.n 115/157 2023-03-27T10:08:16.986 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70 116/157 2023-03-27T10:08:17.108 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70 116/157 2023-03-27T10:08:17.541 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2533.gb70fdf97.el 117/157 2023-03-27T10:08:17.796 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 118/157 2023-03-27T10:08:17.857 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 118/157 2023-03-27T10:08:18.045 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 119/157 2023-03-27T10:08:18.068 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 119/157 2023-03-27T10:08:18.269 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:18.0.0-2533.gb70fdf97.el8.x86_64 120/157 2023-03-27T10:08:18.462 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/157 2023-03-27T10:08:18.919 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/157 2023-03-27T10:08:20.440 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:18.0.0-2533.gb70fdf97.el8.x86_64 122/157 2023-03-27T10:08:20.683 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 123/157 2023-03-27T10:08:20.740 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 123/157 2023-03-27T10:08:20.915 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2533.gb70fd 124/157 2023-03-27T10:08:20.982 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2533.gb70fd 124/157 2023-03-27T10:08:21.189 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 125/157 2023-03-27T10:08:21.592 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 125/157 2023-03-27T10:08:21.807 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 126/157 2023-03-27T10:08:22.098 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 126/157 2023-03-27T10:08:22.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 127/157 2023-03-27T10:08:23.137 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/157 2023-03-27T10:08:23.661 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 128/157 2023-03-27T10:08:23.955 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 129/157 2023-03-27T10:08:24.136 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : util-linux-user-2.32.1-41.el8.x86_64 130/157 2023-03-27T10:08:24.336 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 131/157 2023-03-27T10:08:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:18.0.0-2533.gb70fdf97.el8.x86_ 132/157 2023-03-27T10:08:24.668 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:18.0.0-2533.gb70fdf97.el8.x86_64 122/157 2023-03-27T10:08:24.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 133/157 2023-03-27T10:08:24.928 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 123/157 2023-03-27T10:08:24.985 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 123/157 2023-03-27T10:08:25.236 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2533.gb70fd 124/157 2023-03-27T10:08:25.301 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2533.gb70fd 124/157 2023-03-27T10:08:25.519 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 125/157 2023-03-27T10:08:25.921 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 125/157 2023-03-27T10:08:26.160 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 126/157 2023-03-27T10:08:26.449 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 126/157 2023-03-27T10:08:26.806 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 127/157 2023-03-27T10:08:27.720 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 134/157 2023-03-27T10:08:28.006 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 134/157 2023-03-27T10:08:28.039 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 134/157 2023-03-27T10:08:28.086 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 128/157 2023-03-27T10:08:28.339 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:18.0.0-2533.gb70fdf97.el8.noarch 135/157 2023-03-27T10:08:28.426 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 129/157 2023-03-27T10:08:28.556 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 136/157 2023-03-27T10:08:28.656 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : util-linux-user-2.32.1-41.el8.x86_64 130/157 2023-03-27T10:08:28.848 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 131/157 2023-03-27T10:08:28.865 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 137/157 2023-03-27T10:08:29.048 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:18.0.0-2533.gb70fdf97.el8.x86_ 132/157 2023-03-27T10:08:29.116 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:1.1.1k-9.el8.x86_64 138/157 2023-03-27T10:08:29.261 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.188-3.el8.x86_64 133/157 2023-03-27T10:08:29.271 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-1.el 139/157 2023-03-27T10:08:29.297 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-1.el 139/157 2023-03-27T10:08:29.489 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 140/157 2023-03-27T10:08:29.688 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.1-9.el8.x86_64 141/157 2023-03-27T10:08:29.789 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 141/157 2023-03-27T10:08:29.982 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.0.4-10.el8.x86_64 142/157 2023-03-27T10:08:30.005 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 142/157 2023-03-27T10:08:30.215 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:1.1.1k-7.el8.x86_64 143/157 2023-03-27T10:08:30.398 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 144/157 2023-03-27T10:08:30.566 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 145/157 2023-03-27T10:08:30.567 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 146/157 2023-03-27T10:08:30.790 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 146/157 2023-03-27T10:08:30.804 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.39.12-1.el 147/157 2023-03-27T10:08:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.39.12-1.el 147/157 2023-03-27T10:08:30.919 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 148/157 2023-03-27T10:08:31.191 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 148/157 2023-03-27T10:08:31.332 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : util-linux-user-2.32.1-38.el8.x86_64 149/157 2023-03-27T10:08:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : util-linux-2.32.1-38.el8.x86_64 150/157 2023-03-27T10:08:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libfdisk-2.32.1-38.el8.x86_64 151/157 2023-03-27T10:08:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libfdisk-2.32.1-38.el8.x86_64 151/157 2023-03-27T10:08:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libmount-2.32.1-38.el8.x86_64 152/157 2023-03-27T10:08:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libmount-2.32.1-38.el8.x86_64 152/157 2023-03-27T10:08:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libblkid-2.32.1-38.el8.x86_64 153/157 2023-03-27T10:08:32.265 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 134/157 2023-03-27T10:08:32.299 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libblkid-2.32.1-38.el8.x86_64 153/157 2023-03-27T10:08:32.300 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libuuid-2.32.1-38.el8.x86_64 154/157 2023-03-27T10:08:32.524 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libuuid-2.32.1-38.el8.x86_64 154/157 2023-03-27T10:08:32.525 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libsmartcols-2.32.1-38.el8.x86_64 155/157 2023-03-27T10:08:32.585 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 134/157 2023-03-27T10:08:32.619 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 134/157 2023-03-27T10:08:32.741 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libsmartcols-2.32.1-38.el8.x86_64 155/157 2023-03-27T10:08:32.918 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:18.0.0-2533.gb70fdf97.el8.noarch 135/157 2023-03-27T10:08:32.949 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 156/157 2023-03-27T10:08:32.949 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:1.1.1k-7.el8.x86_64 157/157 2023-03-27T10:08:33.135 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 136/157 2023-03-27T10:08:33.448 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 137/157 2023-03-27T10:08:33.480 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8.x86_64 157/157 2023-03-27T10:08:33.480 INFO:teuthology.orchestra.run.smithi172.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-03-27T10:08:33.481 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:33.703 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:1.1.1k-9.el8.x86_64 138/157 2023-03-27T10:08:33.875 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-1.el 139/157 2023-03-27T10:08:33.905 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-1.el 139/157 2023-03-27T10:08:34.111 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 140/157 2023-03-27T10:08:34.154 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:18.0.0-2533.gb70fdf97.el8.x86_64 1/157 2023-03-27T10:08:34.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 2/157 2023-03-27T10:08:34.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 3/157 2023-03-27T10:08:34.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 4/157 2023-03-27T10:08:34.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2533.gb70fd 5/157 2023-03-27T10:08:34.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 6/157 2023-03-27T10:08:34.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 7/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 8/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 9/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 10/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 11/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:18.0.0-2533.gb70fdf97.el8.x86_64 12/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 13/157 2023-03-27T10:08:34.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:18.0.0-2533.gb70fdf97.el8.x86_ 14/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 15/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 16/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:18.0.0-2533.gb70fdf97.el8.x86_6 17/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86 18/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 19/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2533.gb70fdf97.el 20/157 2023-03-27T10:08:34.157 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:18.0.0-2533.gb70fdf97.el8. 21/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:18.0.0-2533.gb70fdf97.el8.x86_6 22/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:18.0.0-2533.gb70fdf97.el8.x86_64 23/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 24/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 25/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 26/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 27/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 28/157 2023-03-27T10:08:34.158 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2533.gb70fdf97. 29/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noa 30/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.n 31/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70 32/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2533.gb70fdf97.el 33/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 34/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2533.gb70fdf97.e 35/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 36/157 2023-03-27T10:08:34.159 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 37/157 2023-03-27T10:08:34.160 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:18.0.0-2533.gb70fdf97.el8.noarch 38/157 2023-03-27T10:08:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.6-6.el8.x86_64 42/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/157 2023-03-27T10:08:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/157 2023-03-27T10:08:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/157 2023-03-27T10:08:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/157 2023-03-27T10:08:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/157 2023-03-27T10:08:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 77/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 78/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/157 2023-03-27T10:08:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 84/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/157 2023-03-27T10:08:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-19.el8.x86_64 95/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/157 2023-03-27T10:08:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/157 2023-03-27T10:08:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/157 2023-03-27T10:08:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/157 2023-03-27T10:08:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 128/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 130/157 2023-03-27T10:08:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-1.el 132/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-initscripts-updown-1:1.39.12-1.el 133/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/157 2023-03-27T10:08:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 140/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libblkid-2.32.1-38.el8.x86_64 141/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 142/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libfdisk-2.32.1-38.el8.x86_64 143/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 144/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libmount-2.32.1-38.el8.x86_64 145/157 2023-03-27T10:08:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 146/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsmartcols-2.32.1-38.el8.x86_64 147/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 148/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-2.32.1-38.el8.x86_64 149/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 150/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:1.1.1k-7.el8.x86_64 151/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 152/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8.x86_64 153/157 2023-03-27T10:08:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/157 2023-03-27T10:08:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : util-linux-2.32.1-38.el8.x86_64 155/157 2023-03-27T10:08:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/157 2023-03-27T10:08:34.317 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.1-9.el8.x86_64 141/157 2023-03-27T10:08:34.423 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 141/157 2023-03-27T10:08:34.633 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.0.4-10.el8.x86_64 142/157 2023-03-27T10:08:34.659 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 142/157 2023-03-27T10:08:34.852 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:1.1.1k-7.el8.x86_64 143/157 2023-03-27T10:08:35.027 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-debuginfod-client-0.187-4.el8.x86_64 144/157 2023-03-27T10:08:35.237 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libs-0.187-4.el8.x86_64 145/157 2023-03-27T10:08:35.237 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 146/157 2023-03-27T10:08:35.494 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 146/157 2023-03-27T10:08:35.507 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.39.12-1.el 147/157 2023-03-27T10:08:35.640 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.39.12-1.el 147/157 2023-03-27T10:08:35.640 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 148/157 2023-03-27T10:08:35.911 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 148/157 2023-03-27T10:08:36.083 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-user-2.32.1-38.el8.x86_64 149/157 2023-03-27T10:08:36.265 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : util-linux-user-2.32.1-38.el8.x86_64 157/157 2023-03-27T10:08:36.266 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:36.266 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2023-03-27T10:08:36.266 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-initscripts-updown-1:1.40.16-1.el8.noarch 2023-03-27T10:08:36.266 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2023-03-27T10:08:36.266 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-0.188-3.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libs-0.188-3.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: libblkid-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: libfdisk-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: libmount-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.267 INFO:teuthology.orchestra.run.smithi172.stdout: libsmartcols-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:1.1.1k-9.el8.x86_64 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:1.1.1k-9.el8.x86_64 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: util-linux-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: util-linux-user-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.1-7.el8.noarch 2023-03-27T10:08:36.268 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.0.4-10.el8.x86_64 2023-03-27T10:08:36.269 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.269 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.269 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.269 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.269 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.1-9.el8.x86_64 2023-03-27T10:08:36.272 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.7-16.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: jq-1.6-6.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.273 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: libpq-13.5-1.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-27T10:08:36.274 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel-2.9-6.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-27T10:08:36.275 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.15-4.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-03-27T10:08:36.276 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-27T10:08:36.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-27T10:08:36.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-27T10:08:36.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-27T10:08:36.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-27T10:08:36.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-27T10:08:36.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-27T10:08:36.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.0.6-14.el8.noarch 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-27T10:08:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-2.6-1.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-27T10:08:36.282 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-27T10:08:36.283 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-27T10:08:36.284 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-27T10:08:36.285 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-27T10:08:36.286 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-27T10:08:36.286 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-27T10:08:36.286 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-27T10:08:36.286 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-19.el8.x86_64 2023-03-27T10:08:36.287 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:36.287 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-03-27T10:08:36.368 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : util-linux-2.32.1-38.el8.x86_64 150/157 2023-03-27T10:08:36.369 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libfdisk-2.32.1-38.el8.x86_64 151/157 2023-03-27T10:08:36.539 DEBUG:teuthology.parallel:result is None 2023-03-27T10:08:36.611 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libfdisk-2.32.1-38.el8.x86_64 151/157 2023-03-27T10:08:36.612 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libmount-2.32.1-38.el8.x86_64 152/157 2023-03-27T10:08:36.861 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libmount-2.32.1-38.el8.x86_64 152/157 2023-03-27T10:08:36.862 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libblkid-2.32.1-38.el8.x86_64 153/157 2023-03-27T10:08:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libblkid-2.32.1-38.el8.x86_64 153/157 2023-03-27T10:08:37.103 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libuuid-2.32.1-38.el8.x86_64 154/157 2023-03-27T10:08:37.344 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libuuid-2.32.1-38.el8.x86_64 154/157 2023-03-27T10:08:37.345 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libsmartcols-2.32.1-38.el8.x86_64 155/157 2023-03-27T10:08:37.586 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libsmartcols-2.32.1-38.el8.x86_64 155/157 2023-03-27T10:08:37.786 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libelf-0.187-4.el8.x86_64 156/157 2023-03-27T10:08:37.787 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:1.1.1k-7.el8.x86_64 157/157 2023-03-27T10:08:38.329 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8.x86_64 157/157 2023-03-27T10:08:38.329 INFO:teuthology.orchestra.run.smithi191.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-03-27T10:08:38.330 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:38.983 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:18.0.0-2533.gb70fdf97.el8.x86_64 1/157 2023-03-27T10:08:38.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 2/157 2023-03-27T10:08:38.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 3/157 2023-03-27T10:08:38.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 4/157 2023-03-27T10:08:38.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2533.gb70fd 5/157 2023-03-27T10:08:38.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 6/157 2023-03-27T10:08:38.984 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 7/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 8/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 9/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 10/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 11/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:18.0.0-2533.gb70fdf97.el8.x86_64 12/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 13/157 2023-03-27T10:08:38.985 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:18.0.0-2533.gb70fdf97.el8.x86_ 14/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 15/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 16/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:18.0.0-2533.gb70fdf97.el8.x86_6 17/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86 18/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 19/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2533.gb70fdf97.el 20/157 2023-03-27T10:08:38.986 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:18.0.0-2533.gb70fdf97.el8. 21/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:18.0.0-2533.gb70fdf97.el8.x86_6 22/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:18.0.0-2533.gb70fdf97.el8.x86_64 23/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 24/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 25/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 26/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 27/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 28/157 2023-03-27T10:08:38.987 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2533.gb70fdf97. 29/157 2023-03-27T10:08:38.997 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noa 30/157 2023-03-27T10:08:38.997 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.n 31/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70 32/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2533.gb70fdf97.el 33/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 34/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2533.gb70fdf97.e 35/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 36/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 37/157 2023-03-27T10:08:38.998 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:18.0.0-2533.gb70fdf97.el8.noarch 38/157 2023-03-27T10:08:38.999 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/157 2023-03-27T10:08:38.999 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/157 2023-03-27T10:08:38.999 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/157 2023-03-27T10:08:39.000 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-6.el8.x86_64 42/157 2023-03-27T10:08:39.001 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/157 2023-03-27T10:08:39.001 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/157 2023-03-27T10:08:39.001 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/157 2023-03-27T10:08:39.001 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/157 2023-03-27T10:08:39.001 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/157 2023-03-27T10:08:39.001 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/157 2023-03-27T10:08:39.002 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/157 2023-03-27T10:08:39.003 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/157 2023-03-27T10:08:39.003 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/157 2023-03-27T10:08:39.003 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/157 2023-03-27T10:08:39.003 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/157 2023-03-27T10:08:39.003 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/157 2023-03-27T10:08:39.003 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/157 2023-03-27T10:08:39.004 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/157 2023-03-27T10:08:39.004 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/157 2023-03-27T10:08:39.004 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/157 2023-03-27T10:08:39.004 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/157 2023-03-27T10:08:39.004 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/157 2023-03-27T10:08:39.004 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.188-3.el8.x86_64 71/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 72/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/157 2023-03-27T10:08:39.005 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 77/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 78/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 80/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/157 2023-03-27T10:08:39.006 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 84/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 85/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 86/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 87/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 88/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 89/157 2023-03-27T10:08:39.007 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 90/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 91/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 92/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 93/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 94/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-19.el8.x86_64 95/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/157 2023-03-27T10:08:39.008 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/157 2023-03-27T10:08:39.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/157 2023-03-27T10:08:39.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/157 2023-03-27T10:08:39.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/157 2023-03-27T10:08:39.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/157 2023-03-27T10:08:39.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/157 2023-03-27T10:08:39.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/157 2023-03-27T10:08:39.010 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/157 2023-03-27T10:08:39.010 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/157 2023-03-27T10:08:39.010 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/157 2023-03-27T10:08:39.010 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/157 2023-03-27T10:08:39.010 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/157 2023-03-27T10:08:39.011 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/157 2023-03-27T10:08:39.012 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 128/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 130/157 2023-03-27T10:08:39.013 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-1.el 132/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-initscripts-updown-1:1.39.12-1.el 133/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.188-3.el8.x86_64 134/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.187-4.el8.x86_64 135/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.188-3.el8.x86_64 136/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.187-4.el8.x86_64 137/157 2023-03-27T10:08:39.014 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.188-3.el8.x86_64 138/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.187-4.el8.x86_64 139/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 140/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libblkid-2.32.1-38.el8.x86_64 141/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 142/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libfdisk-2.32.1-38.el8.x86_64 143/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 144/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libmount-2.32.1-38.el8.x86_64 145/157 2023-03-27T10:08:39.015 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 146/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsmartcols-2.32.1-38.el8.x86_64 147/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 148/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-2.32.1-38.el8.x86_64 149/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 150/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:1.1.1k-7.el8.x86_64 151/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 152/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8.x86_64 153/157 2023-03-27T10:08:39.016 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/157 2023-03-27T10:08:39.017 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-2.32.1-38.el8.x86_64 155/157 2023-03-27T10:08:39.017 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/157 2023-03-27T10:08:42.068 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : util-linux-user-2.32.1-38.el8.x86_64 157/157 2023-03-27T10:08:42.068 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:42.068 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2023-03-27T10:08:42.069 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown-1:1.40.16-1.el8.noarch 2023-03-27T10:08:42.069 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client-0.188-3.el8.x86_64 2023-03-27T10:08:42.069 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-0.188-3.el8.x86_64 2023-03-27T10:08:42.070 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs-0.188-3.el8.x86_64 2023-03-27T10:08:42.070 INFO:teuthology.orchestra.run.smithi191.stdout: libblkid-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.070 INFO:teuthology.orchestra.run.smithi191.stdout: libfdisk-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.070 INFO:teuthology.orchestra.run.smithi191.stdout: libmount-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.071 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.071 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.071 INFO:teuthology.orchestra.run.smithi191.stdout: libsmartcols-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.072 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.072 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:1.1.1k-9.el8.x86_64 2023-03-27T10:08:42.072 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:1.1.1k-9.el8.x86_64 2023-03-27T10:08:42.072 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.073 INFO:teuthology.orchestra.run.smithi191.stdout: util-linux-user-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.073 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-03-27T10:08:42.073 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.1-7.el8.noarch 2023-03-27T10:08:42.073 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.0.4-10.el8.x86_64 2023-03-27T10:08:42.074 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.074 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.075 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.075 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.075 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.076 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.076 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.076 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.076 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.077 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.077 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.077 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.078 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.078 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.078 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.078 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.079 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.079 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.079 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.080 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.080 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.080 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.080 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:18.0.0-2533.gb70fdf97.el8.noarch 2023-03-27T10:08:42.081 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.188-3.el8.x86_64 2023-03-27T10:08:42.081 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.1-9.el8.x86_64 2023-03-27T10:08:42.081 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.7-16.el8.x86_64 2023-03-27T10:08:42.082 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-27T10:08:42.082 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-6.el8.x86_64 2023-03-27T10:08:42.082 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-27T10:08:42.082 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-03-27T10:08:42.083 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-27T10:08:42.083 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.083 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.083 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.084 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-03-27T10:08:42.084 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-03-27T10:08:42.084 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-27T10:08:42.085 INFO:teuthology.orchestra.run.smithi191.stdout: libpq-13.5-1.el8.x86_64 2023-03-27T10:08:42.085 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-03-27T10:08:42.085 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-27T10:08:42.085 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.086 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.086 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-27T10:08:42.086 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.087 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel-2.9-6.el8.x86_64 2023-03-27T10:08:42.087 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-27T10:08:42.087 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-27T10:08:42.088 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-27T10:08:42.088 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-03-27T10:08:42.088 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-03-27T10:08:42.089 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-27T10:08:42.089 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-27T10:08:42.089 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.15-4.el8.x86_64 2023-03-27T10:08:42.089 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-03-27T10:08:42.090 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-03-27T10:08:42.090 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-03-27T10:08:42.090 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-03-27T10:08:42.091 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-03-27T10:08:42.091 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-03-27T10:08:42.091 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-03-27T10:08:42.091 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-03-27T10:08:42.092 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-27T10:08:42.092 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-27T10:08:42.092 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-27T10:08:42.092 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-27T10:08:42.093 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-27T10:08:42.093 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.093 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.093 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.094 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-27T10:08:42.094 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-27T10:08:42.094 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-27T10:08:42.095 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-27T10:08:42.095 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-27T10:08:42.095 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-27T10:08:42.095 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-27T10:08:42.096 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-27T10:08:42.096 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-27T10:08:42.096 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-27T10:08:42.096 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-27T10:08:42.097 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-27T10:08:42.097 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-27T10:08:42.098 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-27T10:08:42.098 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.0.6-14.el8.noarch 2023-03-27T10:08:42.098 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-27T10:08:42.098 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-27T10:08:42.099 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-27T10:08:42.099 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-27T10:08:42.099 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-27T10:08:42.100 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-27T10:08:42.100 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-27T10:08:42.100 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-2.6-1.el8.noarch 2023-03-27T10:08:42.100 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-27T10:08:42.101 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-27T10:08:42.101 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-27T10:08:42.101 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-27T10:08:42.102 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-27T10:08:42.102 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-27T10:08:42.102 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.102 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.103 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-27T10:08:42.103 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-27T10:08:42.103 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.104 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-27T10:08:42.104 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-27T10:08:42.104 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-03-27T10:08:42.105 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-27T10:08:42.105 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-27T10:08:42.105 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-27T10:08:42.106 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-27T10:08:42.106 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-27T10:08:42.106 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-27T10:08:42.106 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-27T10:08:42.107 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-27T10:08:42.107 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-27T10:08:42.108 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-27T10:08:42.108 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.108 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.108 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:18.0.0-2533.gb70fdf97.el8.x86_64 2023-03-27T10:08:42.109 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-27T10:08:42.109 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-27T10:08:42.109 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-27T10:08:42.109 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-27T10:08:42.110 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-27T10:08:42.111 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-19.el8.x86_64 2023-03-27T10:08:42.111 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:42.111 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-03-27T10:08:42.340 DEBUG:teuthology.parallel:result is None 2023-03-27T10:08:42.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b70fdf973c2ffa23c0d8aa6918519da05d922302 2023-03-27T10:08:42.481 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-27T10:08:42.536 INFO:teuthology.orchestra.run.smithi172.stdout:18.0.0-2533.gb70fdf97.el8 2023-03-27T10:08:42.537 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2533.gb70fdf97.el8 2023-03-27T10:08:42.538 INFO:teuthology.task.install:The correct ceph version 18.0.0-2533.gb70fdf97 is installed. 2023-03-27T10:08:42.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b70fdf973c2ffa23c0d8aa6918519da05d922302 2023-03-27T10:08:42.683 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-27T10:08:42.734 INFO:teuthology.orchestra.run.smithi191.stdout:18.0.0-2533.gb70fdf97.el8 2023-03-27T10:08:42.734 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2533.gb70fdf97.el8 2023-03-27T10:08:42.735 INFO:teuthology.task.install:The correct ceph version 18.0.0-2533.gb70fdf97 is installed. 2023-03-27T10:08:42.735 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-27T10:08:42.736 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:42.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-27T10:08:42.807 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:42.807 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-27T10:08:42.877 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-27T10:08:42.878 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:42.879 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2023-03-27T10:08:42.945 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-27T10:08:43.049 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:43.049 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2023-03-27T10:08:43.115 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-27T10:08:43.217 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-27T10:08:43.218 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:43.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-27T10:08:43.279 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-27T10:08:43.380 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:43.381 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-27T10:08:43.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-27T10:08:43.548 INFO:teuthology.run_tasks:Running task ceph... 2023-03-27T10:08:43.625 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-27T10:08:43.626 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2023-03-27T10:08:43.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2023-03-27T10:08:43.692 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-27T10:08:43.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-27T10:08:43.697 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-27T10:08:43.758 INFO:tasks.ceph:Creating extra log directories... 2023-03-27T10:08:43.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-27T10:08:43.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-27T10:08:43.835 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-27T10:08:43.835 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-27T10:08:43.836 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-27T10:08:43.836 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:43.836 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-27T10:08:43.876 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-27T10:08:44.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-27T10:08:44.134 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:44.135 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-27T10:08:44.176 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-27T10:08:44.375 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-27T10:08:44.447 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-27T10:08:44.448 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-27T10:08:44.448 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi/7221298', 'branch': 'wip-rishabh-cephman-6', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7221298', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1776e8f494e94fd3414d7679e5782ec22e83c95f'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-03-27_06:39:30-fs-wip-rishabh-cephman-6-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-cephman-6'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'CephManager-in-CephFSTestCase', 'sha1': '342392241eddd9827618f3dbb8134df7441718a8'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 200, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'CephManager-in-CephFSTestCase', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_342392241eddd9827618f3dbb8134df7441718a8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '342392241eddd9827618f3dbb8134df7441718a8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi172.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRgxxdjWX3i5NfNprCr0CNZLbnCHWtkHDPUiBcVcGH2RZV1KlLfhJUkWUSf0AzEUCfWvpdj99CSV9oS9Bd5d2k8YfKl8CgHl+qy4W5LE9um2w4Xx5NBOwqeq9n/LshhWZmai5ViH6iCqpDndhXAjmPNqI3jpeKZfvTU1LpKkVCrnlKG84HGtoz/wYda4RHx3O3UP3ox2vk8tb+OdtHdRDTwmvhOoIYihGkcuvW/q2hkyQzPn7siaGp1tByBNkcjRrbkm47hdJn0h0HdGBnE90WQaajSzzsuV4K7gfM3JYPquhQhk6RaXYc/i6b4j0Jyw/DPQEOAwAqXfCHXhCjbyedZhodON4UZVqUnszbgEELgw8mqCcz1iUWTqm5nWw53ZEyDgV6S6gfr2Yho+uDW0uXbyPOs5TdHc0NnF3L8U+NpY2lmKv1ToUtRTzNE3cbXBwLG40LMIvLVu5nsqDNa5e4a/vX8oBt2VSAeutj12aSsIynwHv7aPMlREIaD4EEjnk=', 'smithi191.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUsACoBjqbtzKUqkO6CEtOs8Zk8l0rAEMqpHG0oVcHfDu4ZDTxjByJhcf1BdOxeA7D1GNN3eljeNotglAcmD3+Tq+z+TguTEkD2qCjUr39Y6bAjGNjwI9+GEplwYpGlU5GZQsmCLA84TDKzQTNj+iumV5ixwqEVRQodNc2C7r3Y9CJj9iNIibJs8T5OutS/0munmv6c+I2x+DQtCP0H8SsqTF4OPgHS+eqOiB5l53p54NrKv/eVGg0INjZ/KeGSL5Rz5eooWKxQkrbxPXorHPzxxr4M0fdI/BydRrB+OJ30ra8Q73KpKGPpFLyuCoxsA8L2G2rl7l90Fe9H6ItEweqM/ztZfy5kKtmeZgNIalkQeQX6LZqgbho4ANSqp5yZ+TVEq03LV5UbJjNNSd08PD/lcJJjHwl+TaN+PUqRmHR7WK42VuOFRvJ5bd3RfIHg0IXFF8n8z8WIsii/1A8ehk97FgcjCfd1EefXu/Z5h/TtCImn5N5Li2Fc0kF7TpcmrE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1776e8f494e94fd3414d7679e5782ec22e83c95f'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b70fdf973c2ffa23c0d8aa6918519da05d922302'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e3729161eecf8e6d09a4069acbb883cdcd5e9f50', 'timestamp': '2023-03-27_06:39:30', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.4538'} 2023-03-27T10:08:44.450 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-27T10:08:44.454 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-27T10:08:44.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2023-03-27T10:08:44.535 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2023-03-27T10:08:44.598 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:44.598 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2023-03-27T10:08:44.638 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-27T10:08:44.639 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2023-03-27T10:08:44.719 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-27T10:08:44.720 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:44.720 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-03-27T10:08:44.720 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:44.720 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:44.720 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-03-27 10:08:33.630277133 +0000 2023-03-27T10:08:44.721 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-03-27 10:05:31.260263258 +0000 2023-03-27T10:08:44.721 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-03-27 10:05:31.260263258 +0000 2023-03-27T10:08:44.721 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2023-03-27 10:05:31.233263873 +0000 2023-03-27T10:08:44.721 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-27T10:08:44.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-03-27T10:08:44.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-03-27T10:08:44.819 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000307632 s, 1.7 MB/s 2023-03-27T10:08:44.821 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-27T10:08:44.864 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2023-03-27T10:08:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-27T10:08:44.945 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-03-27 10:08:33.630277133 +0000 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-03-27 10:05:32.077244648 +0000 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-03-27 10:05:32.077244648 +0000 2023-03-27T10:08:44.946 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2023-03-27 10:05:32.052245217 +0000 2023-03-27T10:08:44.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-27T10:08:45.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-03-27T10:08:45.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-03-27T10:08:45.045 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000281685 s, 1.8 MB/s 2023-03-27T10:08:45.046 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-27T10:08:45.089 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2023-03-27T10:08:45.170 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-27T10:08:45.170 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-03-27T10:08:45.170 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:45.171 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:45.171 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-03-27 10:08:33.630277133 +0000 2023-03-27T10:08:45.171 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-03-27 10:05:32.887226196 +0000 2023-03-27T10:08:45.171 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-03-27 10:05:32.887226196 +0000 2023-03-27T10:08:45.171 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2023-03-27 10:05:32.865226698 +0000 2023-03-27T10:08:45.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-27T10:08:45.268 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-03-27T10:08:45.268 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-03-27T10:08:45.269 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000267208 s, 1.9 MB/s 2023-03-27T10:08:45.270 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-27T10:08:45.312 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2023-03-27T10:08:45.394 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-27T10:08:45.394 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:45.394 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-03-27T10:08:45.394 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:45.395 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:45.395 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-03-27 10:08:33.630277133 +0000 2023-03-27T10:08:45.395 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-03-27 10:05:33.697207745 +0000 2023-03-27T10:08:45.395 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-03-27 10:05:33.697207745 +0000 2023-03-27T10:08:45.395 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2023-03-27 10:05:33.674208269 +0000 2023-03-27T10:08:45.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-27T10:08:45.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-03-27T10:08:45.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-03-27T10:08:45.493 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000323309 s, 1.6 MB/s 2023-03-27T10:08:45.495 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-27T10:08:45.538 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-27T10:08:45.538 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:45.539 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2023-03-27T10:08:45.579 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-27T10:08:45.580 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2023-03-27T10:08:45.659 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-27T10:08:45.660 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:45.660 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-03-27T10:08:45.660 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:45.660 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:45.660 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-27 10:08:38.471639129 +0000 2023-03-27T10:08:45.660 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-27 10:05:30.445097729 +0000 2023-03-27T10:08:45.661 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-27 10:05:30.445097729 +0000 2023-03-27T10:08:45.661 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2023-03-27 10:05:30.420098130 +0000 2023-03-27T10:08:45.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-27T10:08:45.759 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-27T10:08:45.759 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-27T10:08:45.759 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000294335 s, 1.7 MB/s 2023-03-27T10:08:45.761 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-27T10:08:45.806 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2023-03-27T10:08:45.887 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-27T10:08:45.887 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-27 10:08:38.471639129 +0000 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-27 10:05:31.254084765 +0000 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-27 10:05:31.254084765 +0000 2023-03-27T10:08:45.888 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2023-03-27 10:05:31.232085117 +0000 2023-03-27T10:08:45.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-27T10:08:45.989 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-27T10:08:45.989 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-27T10:08:45.989 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000285058 s, 1.8 MB/s 2023-03-27T10:08:45.991 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-27T10:08:46.036 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2023-03-27T10:08:46.119 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-27T10:08:46.119 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:46.119 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-03-27T10:08:46.119 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:46.120 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:46.120 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-27 10:08:38.472639114 +0000 2023-03-27T10:08:46.120 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-27 10:05:32.038072201 +0000 2023-03-27T10:08:46.120 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-27 10:05:32.038072201 +0000 2023-03-27T10:08:46.120 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2023-03-27 10:05:32.015072569 +0000 2023-03-27T10:08:46.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-27T10:08:46.220 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-27T10:08:46.220 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-27T10:08:46.220 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000276668 s, 1.9 MB/s 2023-03-27T10:08:46.222 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-27T10:08:46.265 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2023-03-27T10:08:46.348 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-27T10:08:46.348 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-27T10:08:46.348 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-03-27T10:08:46.349 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-27T10:08:46.349 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-27T10:08:46.349 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-27 10:08:38.472639114 +0000 2023-03-27T10:08:46.349 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-27 10:05:32.837059397 +0000 2023-03-27T10:08:46.349 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-27 10:05:32.837059397 +0000 2023-03-27T10:08:46.349 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2023-03-27 10:05:32.813059781 +0000 2023-03-27T10:08:46.350 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-27T10:08:46.447 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-27T10:08:46.448 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-27T10:08:46.448 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000259522 s, 2.0 MB/s 2023-03-27T10:08:46.449 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-27T10:08:46.491 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-27T10:08:46.491 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-27T10:08:46.491 INFO:tasks.ceph:Generating config... 2023-03-27T10:08:46.493 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-27T10:08:46.493 INFO:tasks.ceph:[client] debug client = 20 2023-03-27T10:08:46.493 INFO:tasks.ceph:[client] debug ms = 1 2023-03-27T10:08:46.493 INFO:tasks.ceph:[client] pid file = 2023-03-27T10:08:46.494 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-27T10:08:46.494 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-27T10:08:46.494 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-03-27T10:08:46.494 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-27T10:08:46.494 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-27T10:08:46.495 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-27T10:08:46.495 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-27T10:08:46.495 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-27T10:08:46.495 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-27T10:08:46.495 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-27T10:08:46.496 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-27T10:08:46.496 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-27T10:08:46.496 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-27T10:08:46.496 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-27T10:08:46.497 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-27T10:08:46.497 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-27T10:08:46.497 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-27T10:08:46.497 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-27T10:08:46.498 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-27T10:08:46.498 INFO:tasks.ceph:[osd] bdev async discard = True 2023-03-27T10:08:46.498 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-03-27T10:08:46.498 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-03-27T10:08:46.498 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-03-27T10:08:46.499 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-27T10:08:46.499 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-03-27T10:08:46.499 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-03-27T10:08:46.499 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-27T10:08:46.499 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-27T10:08:46.500 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-03-27T10:08:46.500 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-27T10:08:46.500 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-27T10:08:46.501 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-27T10:08:46.501 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-27T10:08:46.501 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-27T10:08:46.501 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-27T10:08:46.502 INFO:tasks.ceph:Setting up mon.a... 2023-03-27T10:08:46.502 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-27T10:08:46.601 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.keyring 2023-03-27T10:08:46.607 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-27T10:08:46.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-27T10:08:46.761 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.172'), ('mon.b', '172.21.15.191'), ('mon.c', '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]')] 2023-03-27T10:08:46.762 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.172,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-27T10:08:46.763 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:46.763 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-27T10:08:46.804 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.172 --add b 172.21.15.191 --addv c '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:46.924 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:46.947 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: generated fsid b9fe5031-957d-4f6c-a6ac-e7da3c176686 2023-03-27T10:08:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:setting min_mon_release = pacific 2023-03-27T10:08:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:epoch 0 2023-03-27T10:08:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:fsid b9fe5031-957d-4f6c-a6ac-e7da3c176686 2023-03-27T10:08:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:last_changed 2023-03-27T10:08:46.926768+0000 2023-03-27T10:08:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:created 2023-03-27T10:08:46.926768+0000 2023-03-27T10:08:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:min_mon_release 16 (pacific) 2023-03-27T10:08:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:election_strategy: 1 2023-03-27T10:08:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:0: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.a 2023-03-27T10:08:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2023-03-27T10:08:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:2: [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] mon.c 2023-03-27T10:08:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-03-27T10:08:46.951 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-27T10:08:46.993 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b9fe5031-957d-4f6c-a6ac-e7da3c176686... 2023-03-27T10:08:46.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-27T10:08:47.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-27T10:08:47.138 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2023-03-27T10:08:47.138 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2023-03-27T10:08:47.138 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-27T10:08:47.138 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2023-03-27T10:08:47.138 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.138 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.139 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2023-03-27T10:08:47.140 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2023-03-27T10:08:47.140 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.140 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-27T10:08:47.140 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2023-03-27T10:08:47.140 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.140 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2023-03-27T10:08:47.141 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2023-03-27T10:08:47.142 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2023-03-27T10:08:47.142 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2023-03-27T10:08:47.142 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2023-03-27T10:08:47.142 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2023-03-27T10:08:47.142 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.143 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.172,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2023-03-27T10:08:47.144 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = b9fe5031-957d-4f6c-a6ac-e7da3c176686 2023-03-27T10:08:47.145 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.145 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2023-03-27T10:08:47.145 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2023-03-27T10:08:47.145 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.145 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2023-03-27T10:08:47.146 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.147 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2023-03-27T10:08:47.148 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.148 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2023-03-27T10:08:47.148 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.148 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2023-03-27T10:08:47.149 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2023-03-27T10:08:47.149 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.149 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2023-03-27T10:08:47.149 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2023-03-27T10:08:47.150 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2023-03-27T10:08:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2023-03-27T10:08:47.152 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-03-27T10:08:47.152 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.152 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2023-03-27T10:08:47.152 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2023-03-27T10:08:47.153 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2023-03-27T10:08:47.154 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2023-03-27T10:08:47.155 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.156 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2023-03-27T10:08:47.157 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-03-27T10:08:47.158 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2023-03-27T10:08:47.159 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-03-27T10:08:47.160 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-03-27T10:08:47.161 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-03-27T10:08:47.161 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-03-27T10:08:47.161 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-03-27T10:08:47.162 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-27T10:08:47.163 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-03-27T10:08:47.164 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-27T10:08:47.165 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-03-27T10:08:47.166 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.172,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on skipped message = False 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = b9fe5031-957d-4f6c-a6ac-e7da3c176686 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.167 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-03-27T10:08:47.168 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-03-27T10:08:47.169 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-03-27T10:08:47.170 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: bdev async discard = True 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: bdev enable discard = True 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore allocator = bitmap 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-03-27T10:08:47.171 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-03-27T10:08:47.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-27T10:08:47.173 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-03-27T10:08:47.174 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-03-27T10:08:47.175 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-03-27T10:08:47.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-03-27T10:08:47.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-27T10:08:47.178 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-03-27T10:08:47.179 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds balancer = 20 2023-03-27T10:08:47.180 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-03-27T10:08:47.181 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-03-27T10:08:47.183 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-27T10:08:47.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-27T10:08:47.285 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-27T10:08:47.285 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:47.286 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-27T10:08:47.326 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:47.326 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-27T10:08:47.406 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:08:47.406 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:47.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-27T10:08:47.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-27T10:08:47.530 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:08:47.531 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:47.611 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:08:47.611 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:47.612 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-27T10:08:47.612 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-27T10:08:47.700 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:08:47.701 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:47.781 INFO:tasks.ceph:Setting up mon nodes... 2023-03-27T10:08:47.781 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-27T10:08:47.782 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-03-27T10:08:47.892 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-03-27T10:08:47.897 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-27T10:08:48.020 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-27T10:08:48.026 INFO:tasks.ceph:Setting up mds nodes... 2023-03-27T10:08:48.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-27T10:08:48.137 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-27T10:08:48.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-27T10:08:48.202 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-03-27T10:08:48.310 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-03-27T10:08:48.314 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-03-27T10:08:48.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-03-27T10:08:48.486 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-03-27T10:08:48.491 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-03-27T10:08:48.554 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-03-27T10:08:48.662 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-03-27T10:08:48.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-03-27T10:08:48.729 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-27T10:08:48.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-27T10:08:48.820 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-27T10:08:48.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-03-27T10:08:48.933 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-03-27T10:08:48.960 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-03-27T10:08:49.048 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-03-27T10:08:49.075 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-03-27T10:08:49.161 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-03-27T10:08:49.188 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-27T10:08:49.188 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-27T10:08:49.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-27T10:08:49.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-27T10:08:49.252 INFO:tasks.ceph:role: osd.0 2023-03-27T10:08:49.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:08:49.253 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-27T10:08:49.321 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:08:49.321 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:08:49.322 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:08:49.756 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-03-27T10:08:49.759 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-03-27T10:08:49.760 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-27T10:08:49.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-27T10:08:50.009 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-03-27T10:08:50.071 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-27T10:08:50.071 INFO:tasks.ceph:role: osd.1 2023-03-27T10:08:50.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:08:50.072 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-27T10:08:50.141 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:08:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:08:50.141 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:08:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:08:50.142 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:08:50.142 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:08:50.142 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:08:50.143 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:08:50.143 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:08:50.143 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:08:50.549 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-03-27T10:08:50.554 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-03-27T10:08:50.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-03-27T10:08:50.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-03-27T10:08:50.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-03-27T10:08:50.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-27T10:08:50.815 INFO:tasks.ceph:role: osd.2 2023-03-27T10:08:50.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:08:50.816 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-27T10:08:50.884 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:08:50.885 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:08:50.886 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:08:50.886 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:08:51.348 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-03-27T10:08:51.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-03-27T10:08:51.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-03-27T10:08:51.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-03-27T10:08:51.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-03-27T10:08:51.656 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-27T10:08:51.657 INFO:tasks.ceph:role: osd.3 2023-03-27T10:08:51.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:08:51.658 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-27T10:08:51.728 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:08:51.728 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:08:51.728 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:08:51.728 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:08:51.728 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:08:51.729 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:08:51.729 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:08:51.729 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:08:51.729 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:08:51.729 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:08:52.156 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2023-03-27T10:08:52.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-03-27T10:08:52.161 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-03-27T10:08:52.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-03-27T10:08:52.396 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:52.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:52.509+0000 7f0aa5882580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-27T10:08:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:52.509+0000 7f0aa5882580 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-27T10:08:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:52.509+0000 7f0aa5882580 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-27T10:08:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:52.509+0000 7f0aa5882580 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-27T10:08:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:52.509+0000 7f0aa5882580 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-27T10:08:52.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:52.512+0000 7f0aa5882580 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-27T10:08:55.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-27T10:08:55.461 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:55.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:55.558+0000 7fafa7697580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-03-27T10:08:55.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:55.558+0000 7fafa7697580 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-03-27T10:08:55.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:55.558+0000 7fafa7697580 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-27T10:08:55.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:55.558+0000 7fafa7697580 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-27T10:08:55.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:55.558+0000 7fafa7697580 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-27T10:08:55.559 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:55.560+0000 7fafa7697580 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-03-27T10:08:58.433 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-03-27T10:08:58.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:08:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:58.596+0000 7f3f9f999580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-03-27T10:08:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:58.596+0000 7f3f9f999580 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-03-27T10:08:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:58.596+0000 7f3f9f999580 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-27T10:08:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:58.596+0000 7f3f9f999580 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-27T10:08:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:58.596+0000 7f3f9f999580 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-27T10:08:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:08:58.598+0000 7f3f9f999580 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-03-27T10:09:01.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-03-27T10:09:01.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:01.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:01.637+0000 7f88fb350580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-03-27T10:09:01.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:01.637+0000 7f88fb350580 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-03-27T10:09:01.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:01.637+0000 7f88fb350580 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-27T10:09:01.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:01.637+0000 7f88fb350580 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-27T10:09:01.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:01.637+0000 7f88fb350580 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-27T10:09:01.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:01.639+0000 7f88fb350580 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-03-27T10:09:04.510 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-03-27T10:09:04.574 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-03-27T10:09:04.644 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-27T10:09:04.644 INFO:tasks.ceph:role: osd.4 2023-03-27T10:09:04.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:09:04.645 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-27T10:09:04.715 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:09:04.716 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:09:04.717 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:09:04.717 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:09:05.155 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-27T10:09:05.158 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-27T10:09:05.159 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-03-27T10:09:05.359 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-03-27T10:09:05.430 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-03-27T10:09:05.493 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-27T10:09:05.494 INFO:tasks.ceph:role: osd.5 2023-03-27T10:09:05.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:09:05.495 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-27T10:09:05.564 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:09:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:09:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:09:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:09:05.565 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:09:05.565 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:09:05.566 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:09:05.566 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:09:05.567 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:09:05.567 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:09:05.989 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-27T10:09:05.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-27T10:09:05.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-03-27T10:09:06.127 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-03-27T10:09:06.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-03-27T10:09:06.257 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-27T10:09:06.257 INFO:tasks.ceph:role: osd.6 2023-03-27T10:09:06.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:09:06.258 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-27T10:09:06.327 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:09:06.327 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:09:06.327 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:09:06.327 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:09:06.328 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:09:06.328 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:09:06.328 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:09:06.328 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:09:06.328 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:09:06.328 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:09:06.769 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-27T10:09:06.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-27T10:09:06.772 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-03-27T10:09:06.943 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-03-27T10:09:07.014 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-03-27T10:09:07.076 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-27T10:09:07.077 INFO:tasks.ceph:role: osd.7 2023-03-27T10:09:07.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:09:07.077 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-27T10:09:07.146 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-27T10:09:07.146 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-27T10:09:07.146 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-27T10:09:07.146 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-27T10:09:07.147 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-27T10:09:07.147 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-27T10:09:07.147 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-27T10:09:07.147 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-27T10:09:07.147 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-27T10:09:07.147 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-27T10:09:07.575 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-27T10:09:07.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-27T10:09:07.580 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-03-27T10:09:07.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-03-27T10:09:07.832 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:07.940 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:07.942+0000 7f2d75cee580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-03-27T10:09:07.941 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:07.942+0000 7f2d75cee580 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-03-27T10:09:07.941 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:07.942+0000 7f2d75cee580 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-27T10:09:07.941 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:07.942+0000 7f2d75cee580 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-27T10:09:07.941 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:07.942+0000 7f2d75cee580 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-27T10:09:07.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:07.944+0000 7f2d75cee580 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-03-27T10:09:10.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-03-27T10:09:10.876 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:10.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:10.972+0000 7f65bb91e580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-03-27T10:09:10.970 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:10.972+0000 7f65bb91e580 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-03-27T10:09:10.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:10.972+0000 7f65bb91e580 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-27T10:09:10.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:10.972+0000 7f65bb91e580 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-27T10:09:10.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:10.972+0000 7f65bb91e580 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-27T10:09:10.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:10.973+0000 7f65bb91e580 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-03-27T10:09:13.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-03-27T10:09:13.909 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:14.004 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:14.006+0000 7f493ba1b580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-03-27T10:09:14.005 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:14.006+0000 7f493ba1b580 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-03-27T10:09:14.005 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:14.006+0000 7f493ba1b580 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-27T10:09:14.005 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:14.006+0000 7f493ba1b580 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-27T10:09:14.005 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:14.006+0000 7f493ba1b580 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-27T10:09:14.006 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:14.008+0000 7f493ba1b580 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-03-27T10:09:14.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:09:14.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:09:16.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-03-27T10:09:16.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:17.069 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:17.071+0000 7f25bd1b6580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-03-27T10:09:17.070 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:17.071+0000 7f25bd1b6580 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-03-27T10:09:17.070 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:17.071+0000 7f25bd1b6580 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-27T10:09:17.070 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:17.071+0000 7f25bd1b6580 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-27T10:09:17.070 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:17.071+0000 7f25bd1b6580 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-27T10:09:17.071 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:17.073+0000 7f25bd1b6580 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-03-27T10:09:19.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-03-27T10:09:20.005 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-27T10:09:20.006 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.006 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-03-27T10:09:20.074 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.074 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-27T10:09:20.179 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.180 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-03-27T10:09:20.282 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.282 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-27T10:09:20.384 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.384 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-03-27T10:09:20.485 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-03-27T10:09:20.587 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:20.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-03-27T10:09:20.689 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:20.690 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-27T10:09:20.755 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:20.755 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-03-27T10:09:20.856 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:20.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-03-27T10:09:20.957 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:20.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-03-27T10:09:21.059 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:21.059 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-03-27T10:09:21.160 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:21.161 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-03-27T10:09:21.261 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:21.261 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-03-27T10:09:21.362 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:21.362 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-27T10:09:21.405 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:21.406 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-03-27T10:09:21.486 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:21.487 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-03-27T10:09:21.527 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:21.527 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-03-27T10:09:21.606 INFO:tasks.ceph:Adding keys to all mons... 2023-03-27T10:09:21.607 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-27T10:09:21.611 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-27T10:09:21.667 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2023-03-27T10:09:21.667 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAvayFkJsZWNRAA7x7p80Lfd08hy867qxXypQ== 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFkv41ICBAA1b5XrjcgRt2diuwr9OR/pg== 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFkIHKgEhAAudffD5gEjBdW6cQIzyqi/A== 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA0ayFkyO5vHhAAVJ+ks5faLh3fGhC2GQl6Sw== 2023-03-27T10:09:21.668 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA3ayFkOl9dIRAAwOqqdoVcFYZcv71u57C7wQ== 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA6ayFk8rOjIxAABd44C0iZreRV7uilU0w6eg== 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA9ayFkBToVJhAAyKRWJfeSYLmcfF3WdVBDWA== 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2023-03-27T10:09:21.669 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFkhLhZARAA5ldUw+C1bq6aeI5S5B3A6A== 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFkNismHRAAuGXMmtI6LzmG1Tx/ZkzXjw== 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFk+xmnJxAAqXzUAg5y76wpMbgCcVGh0g== 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBDayFkUUItOBAAX3DOko3aJ7px9DnYDIKdRQ== 2023-03-27T10:09:21.670 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBGayFkwOb3ORAAeZWII9RlgF5055utHJ216Q== 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBKayFkeqpjABAAo9444OW4f2P6wovgr5Kcvg== 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBNayFkuvBDBBAA2iOL6HvTDkB6gXlbrYNnbg== 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2023-03-27T10:09:21.671 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFkti8HMRAA7AeQdNDyHy9eMUqsjDFmag== 2023-03-27T10:09:21.672 INFO:teuthology.orchestra.run.smithi172.stdout:[client.2] 2023-03-27T10:09:21.672 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAwayFk5erDNxAAsDyN7lh2PRAm2jq/AfA0Zw== 2023-03-27T10:09:21.672 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2023-03-27T10:09:21.672 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAxayFkEhj/AhAAivUXiPFYB+TySkhSKO4rLw== 2023-03-27T10:09:21.672 INFO:teuthology.orchestra.run.smithi172.stdout:[client.3] 2023-03-27T10:09:21.672 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAxayFk2N3GCRAAzIxcbaxKGEW2EfnmhwLE+w== 2023-03-27T10:09:21.706 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2023-03-27T10:09:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAvayFkJsZWNRAA7x7p80Lfd08hy867qxXypQ== 2023-03-27T10:09:21.706 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-03-27T10:09:21.706 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFkv41ICBAA1b5XrjcgRt2diuwr9OR/pg== 2023-03-27T10:09:21.706 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFkIHKgEhAAudffD5gEjBdW6cQIzyqi/A== 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA0ayFkyO5vHhAAVJ+ks5faLh3fGhC2GQl6Sw== 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA3ayFkOl9dIRAAwOqqdoVcFYZcv71u57C7wQ== 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2023-03-27T10:09:21.707 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA6ayFk8rOjIxAABd44C0iZreRV7uilU0w6eg== 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA9ayFkBToVJhAAyKRWJfeSYLmcfF3WdVBDWA== 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFkhLhZARAA5ldUw+C1bq6aeI5S5B3A6A== 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFkNismHRAAuGXMmtI6LzmG1Tx/ZkzXjw== 2023-03-27T10:09:21.708 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFk+xmnJxAAqXzUAg5y76wpMbgCcVGh0g== 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBDayFkUUItOBAAX3DOko3aJ7px9DnYDIKdRQ== 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBGayFkwOb3ORAAeZWII9RlgF5055utHJ216Q== 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2023-03-27T10:09:21.709 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBKayFkeqpjABAAo9444OW4f2P6wovgr5Kcvg== 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBNayFkuvBDBBAA2iOL6HvTDkB6gXlbrYNnbg== 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFkti8HMRAA7AeQdNDyHy9eMUqsjDFmag== 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout:[client.2] 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAwayFk5erDNxAAsDyN7lh2PRAm2jq/AfA0Zw== 2023-03-27T10:09:21.710 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2023-03-27T10:09:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAxayFkEhj/AhAAivUXiPFYB+TySkhSKO4rLw== 2023-03-27T10:09:21.711 INFO:teuthology.orchestra.run.smithi191.stdout:[client.3] 2023-03-27T10:09:21.711 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQAxayFk2N3GCRAAzIxcbaxKGEW2EfnmhwLE+w== 2023-03-27T10:09:21.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-27T10:09:21.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-27T10:09:21.850 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:21.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:21.955 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:21.960 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:22.061 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.269 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.376 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-27T10:09:22.480 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-27T10:09:22.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:22.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:22.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:22.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-27T10:09:22.790 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.794 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.896 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:22.999 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:23.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:23.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-27T10:09:23.199 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.417 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-27T10:09:23.625 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-27T10:09:23.626 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-27T10:09:23.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-27T10:09:23.799 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-27T10:09:23.861 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-03-27T10:09:23.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-27T10:09:24.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-03-27T10:09:24.098 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-03-27T10:09:24.160 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-27T10:09:24.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-03-27T10:09:24.334 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:24.338 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-27T10:09:24.378 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-27T10:09:24.379 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-27T10:09:24.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-27T10:09:24.420 INFO:tasks.ceph.mon.a:Started 2023-03-27T10:09:24.420 INFO:tasks.ceph.mon.b:Restarting daemon 2023-03-27T10:09:24.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-03-27T10:09:24.425 INFO:tasks.ceph.mon.b:Started 2023-03-27T10:09:24.425 INFO:tasks.ceph.mon.c:Restarting daemon 2023-03-27T10:09:24.426 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-03-27T10:09:24.429 INFO:tasks.ceph.mon.c:Started 2023-03-27T10:09:24.429 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-27T10:09:24.430 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-03-27T10:09:24.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-03-27T10:09:24.434 INFO:tasks.ceph.mgr.y:Started 2023-03-27T10:09:24.434 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-27T10:09:24.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-27T10:09:24.438 INFO:tasks.ceph.mgr.x:Started 2023-03-27T10:09:24.438 INFO:tasks.ceph:Setting crush tunables to default 2023-03-27T10:09:24.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd crush tunables default 2023-03-27T10:09:24.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.626+0000 7f26a9fff700 1 Processor -- start 2023-03-27T10:09:24.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.626+0000 7f26a9fff700 1 -- start start 2023-03-27T10:09:24.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.627+0000 7f26a9fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:24.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.627+0000 7f26a9fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 0x7f26a40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:24.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.627+0000 7f26a9fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:24.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.627+0000 7f26a9fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a406bc70 con 0x7f26a40cb400 2023-03-27T10:09:24.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.627+0000 7f26a9fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a40cc780 con 0x7f26a415c620 2023-03-27T10:09:24.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.627+0000 7f26a9fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a415c9f0 con 0x7f26a406b2b0 2023-03-27T10:09:24.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:54772/0 (socket says 172.21.15.172:54772) 2023-03-27T10:09:24.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 -- 172.21.15.172:0/1787244383 learned_addr learned my addr 172.21.15.172:0/1787244383 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:24.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 0x7f26a40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 -- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 msgr2=0x7f26a406b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-03-27T10:09:24.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 -- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 msgr2=0x7f26a406b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-27T10:09:24.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-27T10:09:24.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a37fe700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a3fff700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-27T10:09:24.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a2ffd700 1 -- 172.21.15.172:0/1787244383 >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 msgr2=0x7f26a40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-27T10:09:24.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a2ffd700 1 -- 172.21.15.172:0/1787244383 >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 msgr2=0x7f26a40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-27T10:09:24.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 0x7f26a40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-27T10:09:24.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 0x7f26a40ccc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-27T10:09:24.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a37fe700 1 -- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 msgr2=0x7f26a40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-03-27T10:09:24.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a37fe700 1 -- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 msgr2=0x7f26a40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-27T10:09:24.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a37fe700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-27T10:09:24.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.628+0000 7f26a37fe700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-27T10:09:24.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.172:3300/0 conn(0x7f26a40cb400 0x7f26a40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a37fe700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a3fff700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 -- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 msgr2=0x7f26a406b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:24.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 -- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 msgr2=0x7f26a40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:24.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 -- 172.21.15.172:0/1787244383 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40cbb70 con 0x7f26a40cb400 2023-03-27T10:09:24.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a37fe700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:24.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.829+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a40cb400 0x7f26a40ccc10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26a406d6e0 tx=0x7f2698009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4789b168245287 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:24.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a27fc700 1 -- 172.21.15.172:0/1787244383 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698004230 con 0x7f26a40cb400 2023-03-27T10:09:24.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a27fc700 1 -- 172.21.15.172:0/1787244383 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698004390 con 0x7f26a40cb400 2023-03-27T10:09:24.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a27fc700 1 -- 172.21.15.172:0/1787244383 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980038e0 con 0x7f26a40cb400 2023-03-27T10:09:24.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 -- 172.21.15.172:0/1787244383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a40cb400 msgr2=0x7f26a40ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:24.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a40cb400 0x7f26a40ccc10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f26a406d6e0 tx=0x7f2698009b80 comp rx=0 tx=0).stop 2023-03-27T10:09:24.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 -- 172.21.15.172:0/1787244383 shutdown_connections 2023-03-27T10:09:24.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a406b2b0 0x7f26a406b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 --2- 172.21.15.172:0/1787244383 >> v2:172.21.15.191:3300/0 conn(0x7f26a415c620 0x7f26a40ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 --2- 172.21.15.172:0/1787244383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a40cb400 0x7f26a40ccc10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.830+0000 7f26a9fff700 1 -- 172.21.15.172:0/1787244383 >> 172.21.15.172:0/1787244383 conn(0x7f26a4072230 msgr2=0x7f26a406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:24.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.831+0000 7f26a9fff700 1 -- 172.21.15.172:0/1787244383 shutdown_connections 2023-03-27T10:09:24.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.831+0000 7f26a9fff700 1 -- 172.21.15.172:0/1787244383 wait complete. 2023-03-27T10:09:24.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.832+0000 7f26a9fff700 1 Processor -- start 2023-03-27T10:09:24.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.832+0000 7f26a9fff700 1 -- start start 2023-03-27T10:09:24.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.833+0000 7f26a9fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 0x7f26a4153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:24.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.833+0000 7f26a9fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a40cb400 0x7f26a4154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:24.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.833+0000 7f26a9fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a415c620 0x7f26a40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:24.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.833+0000 7f26a9fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40caa90 con 0x7f26a406b2b0 2023-03-27T10:09:24.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.833+0000 7f26a9fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40ca7b0 con 0x7f26a40cb400 2023-03-27T10:09:24.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.833+0000 7f26a9fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4158630 con 0x7f26a415c620 2023-03-27T10:09:24.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 0x7f26a4153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 0x7f26a4153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48208/0 (socket says 172.21.15.172:48208) 2023-03-27T10:09:24.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 -- 172.21.15.172:0/2747713620 learned_addr learned my addr 172.21.15.172:0/2747713620 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a3fff700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a415c620 0x7f26a40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a2ffd700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a40cb400 0x7f26a4154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 -- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a415c620 msgr2=0x7f26a40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a415c620 0x7f26a40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 -- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a40cb400 msgr2=0x7f26a4154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a40cb400 0x7f26a4154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 -- 172.21.15.172:0/2747713620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269400c4e0 con 0x7f26a406b2b0 2023-03-27T10:09:24.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f26a37fe700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 0x7f26a4153ee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2694011900 tx=0x7f2694011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.834+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694015890 con 0x7f26a406b2b0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.835+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940159f0 con 0x7f26a406b2b0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.835+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2698009500 con 0x7f26a406b2b0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.835+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694015d60 con 0x7f26a406b2b0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.835+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a40cc130 con 0x7f26a406b2b0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.835+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2694025070 con 0x7f26a406b2b0 2023-03-27T10:09:24.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.835+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2694013740 con 0x7f26a406b2b0 2023-03-27T10:09:24.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.836+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a40cbe50 con 0x7f26a406b2b0 2023-03-27T10:09:24.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.838+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f269403dae0 con 0x7f26a406b2b0 2023-03-27T10:09:24.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.913+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f26a40cc410 con 0x7f26a406b2b0 2023-03-27T10:09:24.914 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.916+0000 7f268bfff700 1 -- 172.21.15.172:0/2747713620 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f269402c070 con 0x7f26a406b2b0 2023-03-27T10:09:24.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 msgr2=0x7f26a4153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:24.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 0x7f26a4153ee0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2694011900 tx=0x7f2694011c10 comp rx=0 tx=0).stop 2023-03-27T10:09:24.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 shutdown_connections 2023-03-27T10:09:24.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f26a415c620 0x7f26a40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a406b2b0 0x7f26a4153ee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 --2- 172.21.15.172:0/2747713620 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26a40cb400 0x7f26a4154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:24.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 >> 172.21.15.172:0/2747713620 conn(0x7f26a4072230 msgr2=0x7f26a40aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:24.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 shutdown_connections 2023-03-27T10:09:24.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:24.917+0000 7f26a9fff700 1 -- 172.21.15.172:0/2747713620 wait complete. 2023-03-27T10:09:24.918 INFO:teuthology.orchestra.run.smithi172.stderr:adjusted tunables profile to default 2023-03-27T10:09:24.932 INFO:tasks.ceph:check_enable_crimson: False 2023-03-27T10:09:24.932 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-27T10:09:24.932 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:24.933 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-27T10:09:24.994 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:24.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-03-27T10:09:25.096 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:25.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-03-27T10:09:25.200 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:09:25.200 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-03-27T10:09:25.302 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:25.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-03-27T10:09:25.367 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:25.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-03-27T10:09:25.473 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:25.473 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-03-27T10:09:25.578 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:09:25.578 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-03-27T10:09:25.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 96dedca0-521a-412e-b4c8-a61859522ba1 0 2023-03-27T10:09:25.906 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.907+0000 7f6467dff700 1 Processor -- start 2023-03-27T10:09:25.907 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.907+0000 7f6467dff700 1 -- start start 2023-03-27T10:09:25.907 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.908+0000 7f6467dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64600b4420 0x7f64600cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:25.908 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6467dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600cf3e0 con 0x7f64600b2020 2023-03-27T10:09:25.908 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6467dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600b47f0 con 0x7f64600d1200 2023-03-27T10:09:25.908 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6467dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600ce7d0 con 0x7f64600b4420 2023-03-27T10:09:25.909 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64600b4420 0x7f64600cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:25.909 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64600b4420 0x7f64600cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44866/0 (socket says 172.21.15.191:44866) 2023-03-27T10:09:25.909 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 -- 172.21.15.191:0/1865756847 learned_addr learned my addr 172.21.15.191:0/1865756847 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f646639c700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f64600d1200 0x7f64600b2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:58848/0 (socket says 172.21.15.191:58848) 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 -- 172.21.15.191:0/1865756847 >> v1:172.21.15.191:6789/0 conn(0x7f64600d1200 legacy=0x7f64600b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 -- 172.21.15.191:0/1865756847 >> v1:172.21.15.172:6789/0 conn(0x7f64600b2020 legacy=0x7f64600d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 -- 172.21.15.191:0/1865756847 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600ceab0 con 0x7f64600b4420 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.909+0000 7f6465b9b700 1 --2- 172.21.15.191:0/1865756847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f64600cdf30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f645c006fd0 tx=0x7f645c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a20b5e37a88255f3 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6464b99700 1 -- 172.21.15.191:0/1865756847 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c005e30 con 0x7f64600b4420 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6464b99700 1 -- 172.21.15.191:0/1865756847 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c004030 con 0x7f64600b4420 2023-03-27T10:09:25.910 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6464b99700 1 -- 172.21.15.191:0/1865756847 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0043e0 con 0x7f64600b4420 2023-03-27T10:09:25.911 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6467dff700 1 -- 172.21.15.191:0/1865756847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 msgr2=0x7f64600cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:25.911 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6467dff700 1 --2- 172.21.15.191:0/1865756847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f64600cdf30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f645c006fd0 tx=0x7f645c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6467dff700 1 -- 172.21.15.191:0/1865756847 shutdown_connections 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6467dff700 1 --2- 172.21.15.191:0/1865756847 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f64600cdf30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6467dff700 1 -- 172.21.15.191:0/1865756847 >> 172.21.15.191:0/1865756847 conn(0x7f646009c260 msgr2=0x7f64600d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.910+0000 7f6467dff700 1 -- 172.21.15.191:0/1865756847 shutdown_connections 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.911+0000 7f6467dff700 1 -- 172.21.15.191:0/1865756847 wait complete. 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.912+0000 7f6467dff700 1 Processor -- start 2023-03-27T10:09:25.912 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.912+0000 7f6467dff700 1 -- start start 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f6467dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64600b2020 0x7f64601f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f6467dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f6460158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f6467dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64600d1200 0x7f64601f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f6467dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600cb0e0 con 0x7f64600d1200 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f6467dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64601f6020 con 0x7f64600b4420 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f6467dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64601f6300 con 0x7f64600b2020 2023-03-27T10:09:25.914 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.913+0000 7f646539a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f6460158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:25.915 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64600b2020 0x7f64601f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:25.915 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f646539a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f6460158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44870/0 (socket says 172.21.15.191:44870) 2023-03-27T10:09:25.915 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f646539a700 1 -- 172.21.15.191:0/4255007737 learned_addr learned my addr 172.21.15.191:0/4255007737 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:25.915 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f646639c700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64600d1200 0x7f64601f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:25.915 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 -- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 msgr2=0x7f6460158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:25.915 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f6460158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:25.918 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 -- 172.21.15.191:0/4255007737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64600d1200 msgr2=0x7f64601f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:25.918 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64600d1200 0x7f64601f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:25.918 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 -- 172.21.15.191:0/4255007737 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009500 con 0x7f64600b2020 2023-03-27T10:09:25.918 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f646539a700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f6460158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:25.918 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f6465b9b700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64600b2020 0x7f64601f2180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f645c013000 tx=0x7f645c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:25.918 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.914+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c004580 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.915+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c011420 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.915+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600cf070 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.915+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011810 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.915+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64600ced90 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.915+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f645c02c070 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.915+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f645c025740 con 0x7f64600b2020 2023-03-27T10:09:25.919 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.916+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600ce470 con 0x7f64600b2020 2023-03-27T10:09:25.920 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:25.919+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f645c044ae0 con 0x7f64600b2020 2023-03-27T10:09:25.920 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:25.920+0000 7fbdaa90d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-27T10:09:26.033 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:26.034+0000 7fbdaa90d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-27T10:09:26.041 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.042+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96dedca0-521a-412e-b4c8-a61859522ba1", "id": 0} v 0) v1 -- 0x7f6460074300 con 0x7f64600b2020 2023-03-27T10:09:26.047 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.048+0000 7f64567fc700 1 -- 172.21.15.191:0/4255007737 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96dedca0-521a-412e-b4c8-a61859522ba1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f645c033030 con 0x7f64600b2020 2023-03-27T10:09:26.047 INFO:teuthology.orchestra.run.smithi191.stdout:0 2023-03-27T10:09:26.049 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64600b2020 msgr2=0x7f64601f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.049 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64600b2020 0x7f64601f2180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f645c013000 tx=0x7f645c004750 comp rx=0 tx=0).stop 2023-03-27T10:09:26.049 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 shutdown_connections 2023-03-27T10:09:26.049 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64600d1200 0x7f64601f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.049 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64600b2020 0x7f64601f2180 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.049 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 --2- 172.21.15.191:0/4255007737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64600b4420 0x7f6460158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.050 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 >> 172.21.15.191:0/4255007737 conn(0x7f646009c260 msgr2=0x7f64600b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.050 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 shutdown_connections 2023-03-27T10:09:26.050 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.049+0000 7f6467dff700 1 -- 172.21.15.191:0/4255007737 wait complete. 2023-03-27T10:09:26.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 9b075997-cdc8-48dc-991a-b2806a0906e3 1 2023-03-27T10:09:26.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:26.147+0000 7fbdaa90d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-27T10:09:26.217 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:26.218+0000 7f8f4e061200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-27T10:09:26.249 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.250+0000 7f3713fff700 1 Processor -- start 2023-03-27T10:09:26.250 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.250+0000 7f3713fff700 1 -- start start 2023-03-27T10:09:26.251 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.251+0000 7f3713fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.251 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.251+0000 7f3713fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f370c0d02c0 0x7f370c0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.251 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.251+0000 7f3713fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c0d0880 con 0x7f370c0b2020 2023-03-27T10:09:26.251 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.251+0000 7f3713fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370c0cd680 con 0x7f370c0d02c0 2023-03-27T10:09:26.251 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.251+0000 7f3713fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0cd960 con 0x7f370c0b1700 2023-03-27T10:09:26.251 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.252 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35766/0 (socket says 172.21.15.191:35766) 2023-03-27T10:09:26.252 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 -- 172.21.15.191:0/2404436721 learned_addr learned my addr 172.21.15.191:0/2404436721 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:26.252 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f371159a700 1 --2- 172.21.15.191:0/2404436721 >> v2:172.21.15.172:3300/0 conn(0x7f370c0d02c0 0x7f370c0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.253 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 -- 172.21.15.191:0/2404436721 >> v2:172.21.15.172:3300/0 conn(0x7f370c0d02c0 msgr2=0x7f370c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:26.253 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 --2- 172.21.15.191:0/2404436721 >> v2:172.21.15.172:3300/0 conn(0x7f370c0d02c0 0x7f370c0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.253 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 -- 172.21.15.191:0/2404436721 >> v1:172.21.15.172:6789/0 conn(0x7f370c0b2020 legacy=0x7f370c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 -- 172.21.15.191:0/2404436721 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0cdc40 con 0x7f370c0b1700 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3711d9b700 1 --2- 172.21.15.191:0/2404436721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c0d0af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3708006fd0 tx=0x7f3708009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53130618bf9fea0a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.252+0000 7f3710d99700 1 -- 172.21.15.191:0/2404436721 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708005e30 con 0x7f370c0b1700 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3710d99700 1 -- 172.21.15.191:0/2404436721 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708004030 con 0x7f370c0b1700 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3710d99700 1 -- 172.21.15.191:0/2404436721 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080043e0 con 0x7f370c0b1700 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 -- 172.21.15.191:0/2404436721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 msgr2=0x7f370c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 --2- 172.21.15.191:0/2404436721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c0d0af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3708006fd0 tx=0x7f3708009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.254 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 -- 172.21.15.191:0/2404436721 shutdown_connections 2023-03-27T10:09:26.255 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 --2- 172.21.15.191:0/2404436721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c0d0af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.255 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 --2- 172.21.15.191:0/2404436721 >> v2:172.21.15.172:3300/0 conn(0x7f370c0d02c0 0x7f370c0d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.255 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 -- 172.21.15.191:0/2404436721 >> 172.21.15.191:0/2404436721 conn(0x7f370c09c260 msgr2=0x7f370c0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.255 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 -- 172.21.15.191:0/2404436721 shutdown_connections 2023-03-27T10:09:26.255 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.253+0000 7f3713fff700 1 -- 172.21.15.191:0/2404436721 wait complete. 2023-03-27T10:09:26.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.256+0000 7f3713fff700 1 Processor -- start 2023-03-27T10:09:26.256 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.256+0000 7f3713fff700 1 -- start start 2023-03-27T10:09:26.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3713fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3713fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f370c0b2020 0x7f370c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3713fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f370c0d02c0 0x7f370c0b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.257 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3713fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c149af0 con 0x7f370c0d02c0 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3713fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c148e70 con 0x7f370c0b2020 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3713fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c149150 con 0x7f370c0b1700 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3711d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f371159a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f370c0b2020 0x7f370c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3711d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c1f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35772/0 (socket says 172.21.15.191:35772) 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f3711d9b700 1 -- 172.21.15.191:0/3629890984 learned_addr learned my addr 172.21.15.191:0/3629890984 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:26.258 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.257+0000 7f371259c700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f370c0d02c0 0x7f370c0b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371159a700 1 -- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 msgr2=0x7f370c1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371159a700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371159a700 1 -- 172.21.15.191:0/3629890984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f370c0d02c0 msgr2=0x7f370c0b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371159a700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f370c0d02c0 0x7f370c0b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371159a700 1 -- 172.21.15.191:0/3629890984 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009500 con 0x7f370c0b2020 2023-03-27T10:09:26.260 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f3711d9b700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371259c700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f370c0d02c0 0x7f370c0b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f371159a700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f370c0b2020 0x7f370c0c9870 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e900 tx=0x7f36fc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc013680 con 0x7f370c0b2020 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc0137e0 con 0x7f370c0b2020 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c0cf450 con 0x7f370c0b2020 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.258+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc013b50 con 0x7f370c0b2020 2023-03-27T10:09:26.261 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.259+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c0cdf20 con 0x7f370c0b2020 2023-03-27T10:09:26.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.259+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f36fc019030 con 0x7f370c0b2020 2023-03-27T10:09:26.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.259+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f36fc0066d0 con 0x7f370c0b2020 2023-03-27T10:09:26.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.260+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c0afb50 con 0x7f370c0b2020 2023-03-27T10:09:26.262 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.262+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f36fc03aae0 con 0x7f370c0b2020 2023-03-27T10:09:26.301 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:26.303+0000 7f8f4e061200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-27T10:09:26.348 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.348+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b075997-cdc8-48dc-991a-b2806a0906e3", "id": 1} v 0) v1 -- 0x7f370c0c9db0 con 0x7f370c0b2020 2023-03-27T10:09:26.355 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.356+0000 7f37027fc700 1 -- 172.21.15.191:0/3629890984 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b075997-cdc8-48dc-991a-b2806a0906e3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36fc029070 con 0x7f370c0b2020 2023-03-27T10:09:26.356 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-03-27T10:09:26.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f370c0b2020 msgr2=0x7f370c0c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f370c0b2020 0x7f370c0c9870 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e900 tx=0x7f36fc00ec10 comp rx=0 tx=0).stop 2023-03-27T10:09:26.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 shutdown_connections 2023-03-27T10:09:26.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f370c0d02c0 0x7f370c0b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.357 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f370c0b1700 0x7f370c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 --2- 172.21.15.191:0/3629890984 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f370c0b2020 0x7f370c0c9870 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 >> 172.21.15.191:0/3629890984 conn(0x7f370c09c260 msgr2=0x7f370c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.357+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 shutdown_connections 2023-03-27T10:09:26.358 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.358+0000 7f3713fff700 1 -- 172.21.15.191:0/3629890984 wait complete. 2023-03-27T10:09:26.374 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new b4faa64b-651e-48f4-8c49-21b64e8d7d7d 2 2023-03-27T10:09:26.378 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:26.377+0000 7fbdaa90d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-27T10:09:26.396 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:26.398+0000 7f8f4e061200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-27T10:09:26.553 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.553+0000 7f23e17ff700 1 Processor -- start 2023-03-27T10:09:26.553 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.553+0000 7f23e17ff700 1 -- start start 2023-03-27T10:09:26.557 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23e17ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 0x7f23dc0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.557 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23e17ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f23dc06b2b0 0x7f23dc06b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.557 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23e17ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc0cb940 con 0x7f23dc15c620 2023-03-27T10:09:26.558 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23e17ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc0ce6e0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.558 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23e17ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc06bc70 con 0x7f23dc0ce270 2023-03-27T10:09:26.558 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f23dc06b2b0 0x7f23dc06b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.558 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 0x7f23dc0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.559 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f23dc06b2b0 0x7f23dc06b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44894/0 (socket says 172.21.15.191:44894) 2023-03-27T10:09:26.559 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 -- 172.21.15.191:0/1552679295 learned_addr learned my addr 172.21.15.191:0/1552679295 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:26.559 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 0x7f23dc0cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35778/0 (socket says 172.21.15.191:35778) 2023-03-27T10:09:26.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 -- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 msgr2=0x7f23dc0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:26.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 --2- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 0x7f23dc0cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.560 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 -- 172.21.15.191:0/1552679295 >> v1:172.21.15.172:6789/0 conn(0x7f23dc15c620 legacy=0x7f23dc0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.561 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23db7fe700 1 -- 172.21.15.191:0/1552679295 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0cc780 con 0x7f23dc06b2b0 2023-03-27T10:09:26.561 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23da7fc700 1 -- 172.21.15.191:0/1552679295 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114324378 0 0) 0x7f23dc0cb940 con 0x7f23dc15c620 2023-03-27T10:09:26.561 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.555+0000 7f23d3fff700 1 --2- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 0x7f23dc0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:26.561 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.556+0000 7f23db7fe700 1 --2- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc06b2b0 0x7f23dc06b730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e50 tx=0x7f23d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ac940a7ba4e8fe server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:26.562 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.556+0000 7f23da7fc700 1 -- 172.21.15.191:0/1552679295 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400e070 con 0x7f23dc06b2b0 2023-03-27T10:09:26.562 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.556+0000 7f23da7fc700 1 -- 172.21.15.191:0/1552679295 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400b910 con 0x7f23dc06b2b0 2023-03-27T10:09:26.562 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.556+0000 7f23da7fc700 1 -- 172.21.15.191:0/1552679295 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400bcc0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.562 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 -- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc06b2b0 msgr2=0x7f23dc06b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.563 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 --2- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc06b2b0 0x7f23dc06b730 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e50 tx=0x7f23d400b330 comp rx=0 tx=0).stop 2023-03-27T10:09:26.563 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 -- 172.21.15.191:0/1552679295 shutdown_connections 2023-03-27T10:09:26.563 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 --2- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc06b2b0 0x7f23dc06b730 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.563 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 --2- 172.21.15.191:0/1552679295 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc0ce270 0x7f23dc0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.564 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 -- 172.21.15.191:0/1552679295 >> 172.21.15.191:0/1552679295 conn(0x7f23dc072230 msgr2=0x7f23dc06aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.564 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 -- 172.21.15.191:0/1552679295 shutdown_connections 2023-03-27T10:09:26.564 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.557+0000 7f23e17ff700 1 -- 172.21.15.191:0/1552679295 wait complete. 2023-03-27T10:09:26.567 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.558+0000 7f23e17ff700 1 Processor -- start 2023-03-27T10:09:26.567 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.559+0000 7f23e17ff700 1 -- start start 2023-03-27T10:09:26.567 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23e17ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 0x7f23dc1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.567 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23e17ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23dc0ce270 0x7f23dc156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.567 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23e17ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc15c620 0x7f23dc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.567 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23e17ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1f6790 con 0x7f23dc0ce270 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23e17ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cf400 con 0x7f23dc15c620 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23e17ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0cf6a0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 0x7f23dc1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23db7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc15c620 0x7f23dc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 0x7f23dc1f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35782/0 (socket says 172.21.15.191:35782) 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 -- 172.21.15.191:0/827978511 learned_addr learned my addr 172.21.15.191:0/827978511 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23d3fff700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23dc0ce270 0x7f23dc156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.568 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 -- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc15c620 msgr2=0x7f23dc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.569 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc15c620 0x7f23dc0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.569 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 -- 172.21.15.191:0/827978511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23dc0ce270 msgr2=0x7f23dc156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.569 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23dc0ce270 0x7f23dc156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.569 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23daffd700 1 -- 172.21.15.191:0/827978511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40094a0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.569 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.560+0000 7f23d3fff700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23dc0ce270 0x7f23dc156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:26.569 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23daffd700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 0x7f23dc1f6250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c4a0 tx=0x7f23cc00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0054e0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc0036d0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc003a80 con 0x7f23dc06b2b0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4009b30 con 0x7f23dc06b2b0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc0cbb70 con 0x7f23dc06b2b0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f23cc019030 con 0x7f23dc06b2b0 2023-03-27T10:09:26.570 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.561+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f23cc01b7d0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.571 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.562+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc15c9f0 con 0x7f23dc06b2b0 2023-03-27T10:09:26.571 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.564+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f23cc017070 con 0x7f23dc06b2b0 2023-03-27T10:09:26.622 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:26.624+0000 7f8f4e061200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-27T10:09:26.647 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.648+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4faa64b-651e-48f4-8c49-21b64e8d7d7d", "id": 2} v 0) v1 -- 0x7f23dc0cbe50 con 0x7f23dc06b2b0 2023-03-27T10:09:26.656 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.656+0000 7f23d37fe700 1 -- 172.21.15.191:0/827978511 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4faa64b-651e-48f4-8c49-21b64e8d7d7d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f23cc01c510 con 0x7f23dc06b2b0 2023-03-27T10:09:26.657 INFO:teuthology.orchestra.run.smithi191.stdout:2 2023-03-27T10:09:26.658 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 msgr2=0x7f23dc1f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.658 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 0x7f23dc1f6250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c4a0 tx=0x7f23cc00c7b0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.658 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 shutdown_connections 2023-03-27T10:09:26.658 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23dc15c620 0x7f23dc0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.659 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23dc06b2b0 0x7f23dc1f6250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.659 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 --2- 172.21.15.191:0/827978511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23dc0ce270 0x7f23dc156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.659 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 >> 172.21.15.191:0/827978511 conn(0x7f23dc072230 msgr2=0x7f23dc0cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.660 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 shutdown_connections 2023-03-27T10:09:26.660 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.657+0000 7f23e17ff700 1 -- 172.21.15.191:0/827978511 wait complete. 2023-03-27T10:09:26.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 2d66b184-a708-4d44-b64f-2eec033be78a 3 2023-03-27T10:09:26.854 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.855+0000 7f8cbadff700 1 Processor -- start 2023-03-27T10:09:26.854 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.855+0000 7f8cbadff700 1 -- start start 2023-03-27T10:09:26.856 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cbadff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8cb4159070 0x7f8cb406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.857 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cbadff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8cb406fa10 0x7f8cb40cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.857 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cbadff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40ce8a0 con 0x7f8cb40cd410 2023-03-27T10:09:26.857 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cbadff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb406c9f0 con 0x7f8cb4159070 2023-03-27T10:09:26.857 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cbadff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40c9180 con 0x7f8cb406fa10 2023-03-27T10:09:26.858 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cb3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8cb406fa10 0x7f8cb40cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.858 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cb3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8cb406fa10 0x7f8cb40cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44912/0 (socket says 172.21.15.191:44912) 2023-03-27T10:09:26.858 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cb3fff700 1 -- 172.21.15.191:0/4274286458 learned_addr learned my addr 172.21.15.191:0/4274286458 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:26.858 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.857+0000 7f8cb8b9b700 1 --2- 172.21.15.191:0/4274286458 >> v2:172.21.15.172:3300/0 conn(0x7f8cb4159070 0x7f8cb406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.859 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb3fff700 1 -- 172.21.15.191:0/4274286458 >> v2:172.21.15.172:3300/0 conn(0x7f8cb4159070 msgr2=0x7f8cb406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb3fff700 1 --2- 172.21.15.191:0/4274286458 >> v2:172.21.15.172:3300/0 conn(0x7f8cb4159070 0x7f8cb406c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb3fff700 1 -- 172.21.15.191:0/4274286458 >> v1:172.21.15.172:6789/0 conn(0x7f8cb40cd410 legacy=0x7f8cb415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb3fff700 1 -- 172.21.15.191:0/4274286458 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40cca40 con 0x7f8cb406fa10 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb3fff700 1 --2- 172.21.15.191:0/4274286458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40cced0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8cb406dda0 tx=0x7f8ca000ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da96f5a26f69446 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb37fe700 1 -- 172.21.15.191:0/4274286458 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000cb70 con 0x7f8cb406fa10 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb37fe700 1 -- 172.21.15.191:0/4274286458 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca000ccd0 con 0x7f8cb406fa10 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.858+0000 7f8cb37fe700 1 -- 172.21.15.191:0/4274286458 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0018620 con 0x7f8cb406fa10 2023-03-27T10:09:26.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 -- 172.21.15.191:0/4274286458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 msgr2=0x7f8cb40cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 --2- 172.21.15.191:0/4274286458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40cced0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8cb406dda0 tx=0x7f8ca000ad70 comp rx=0 tx=0).stop 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 -- 172.21.15.191:0/4274286458 shutdown_connections 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 --2- 172.21.15.191:0/4274286458 >> v2:172.21.15.172:3300/0 conn(0x7f8cb4159070 0x7f8cb406c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 --2- 172.21.15.191:0/4274286458 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40cced0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 -- 172.21.15.191:0/4274286458 >> 172.21.15.191:0/4274286458 conn(0x7f8cb406a1a0 msgr2=0x7f8cb406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 -- 172.21.15.191:0/4274286458 shutdown_connections 2023-03-27T10:09:26.861 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.859+0000 7f8cbadff700 1 -- 172.21.15.191:0/4274286458 wait complete. 2023-03-27T10:09:26.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.861+0000 7f8cbadff700 1 Processor -- start 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.861+0000 7f8cbadff700 1 -- start start 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb40cd410 0x7f8cb4157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb4159070 0x7f8cb40c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cbadff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4158060 con 0x7f8cb4159070 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cbadff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c8f00 con 0x7f8cb406fa10 2023-03-27T10:09:26.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cbadff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c4780 con 0x7f8cb40cd410 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb8b9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb40cd410 0x7f8cb4157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb8b9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44926/0 (socket says 172.21.15.191:44926) 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb8b9b700 1 -- 172.21.15.191:0/2541962423 learned_addr learned my addr 172.21.15.191:0/2541962423 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb939c700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb4159070 0x7f8cb40c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb3fff700 1 -- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 msgr2=0x7f8cb40c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb3fff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb3fff700 1 -- 172.21.15.191:0/2541962423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb4159070 msgr2=0x7f8cb40c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb3fff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb4159070 0x7f8cb40c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb3fff700 1 -- 172.21.15.191:0/2541962423 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca000a6f0 con 0x7f8cb40cd410 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.862+0000 7f8cb8b9b700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cb3fff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb40cd410 0x7f8cb4157b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0017000 tx=0x7f8ca00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0003ab0 con 0x7f8cb40cd410 2023-03-27T10:09:26.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0003c10 con 0x7f8cb40cd410 2023-03-27T10:09:26.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0020400 con 0x7f8cb40cd410 2023-03-27T10:09:26.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb40c96b0 con 0x7f8cb40cd410 2023-03-27T10:09:26.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb40c93d0 con 0x7f8cb40cd410 2023-03-27T10:09:26.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f8ca001e070 con 0x7f8cb40cd410 2023-03-27T10:09:26.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.863+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8ca0018930 con 0x7f8cb40cd410 2023-03-27T10:09:26.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.864+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb406feb0 con 0x7f8cb40cd410 2023-03-27T10:09:26.868 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.866+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f8ca0025070 con 0x7f8cb40cd410 2023-03-27T10:09:26.950 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.951+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d66b184-a708-4d44-b64f-2eec033be78a", "id": 3} v 0) v1 -- 0x7f8cb4074300 con 0x7f8cb40cd410 2023-03-27T10:09:26.957 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.957+0000 7f8cb17fa700 1 -- 172.21.15.191:0/2541962423 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d66b184-a708-4d44-b64f-2eec033be78a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ca000b040 con 0x7f8cb40cd410 2023-03-27T10:09:26.957 INFO:teuthology.orchestra.run.smithi191.stdout:3 2023-03-27T10:09:26.958 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.958+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb40cd410 msgr2=0x7f8cb4157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:26.959 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.958+0000 7f8cbadff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb40cd410 0x7f8cb4157b20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0017000 tx=0x7f8ca00047c0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.959 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 shutdown_connections 2023-03-27T10:09:26.959 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb4159070 0x7f8cb40c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.959 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb406fa10 0x7f8cb40c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.960 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 --2- 172.21.15.191:0/2541962423 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb40cd410 0x7f8cb4157b20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:26.960 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 >> 172.21.15.191:0/2541962423 conn(0x7f8cb406a1a0 msgr2=0x7f8cb40710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:26.960 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 shutdown_connections 2023-03-27T10:09:26.960 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:26.959+0000 7f8cbadff700 1 -- 172.21.15.191:0/2541962423 wait complete. 2023-03-27T10:09:26.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new c32fd432-27ba-44fa-b477-113622563b2e 4 2023-03-27T10:09:27.180 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.181+0000 7f5440f9d700 1 Processor -- start 2023-03-27T10:09:27.181 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.181+0000 7f5440f9d700 1 -- start start 2023-03-27T10:09:27.183 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.183+0000 7f5440f9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f543c0add50 0x7f543c070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.183 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.183+0000 7f5440f9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f543c0cd210 0x7f543c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.183 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.183+0000 7f5440f9d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c070100 con 0x7f543c06a1a0 2023-03-27T10:09:27.183 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.183+0000 7f5440f9d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c070ad0 con 0x7f543c0add50 2023-03-27T10:09:27.183 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.183+0000 7f5440f9d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0ae120 con 0x7f543c0cd210 2023-03-27T10:09:27.183 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.184+0000 7f543affd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f543c0cd210 0x7f543c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.184 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.184+0000 7f543affd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f543c0cd210 0x7f543c0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44930/0 (socket says 172.21.15.191:44930) 2023-03-27T10:09:27.184 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.184+0000 7f543affd700 1 -- 172.21.15.191:0/3738655999 learned_addr learned my addr 172.21.15.191:0/3738655999 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:27.184 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.184+0000 7f543b7fe700 1 --2- 172.21.15.191:0/3738655999 >> v2:172.21.15.172:3300/0 conn(0x7f543c0add50 0x7f543c070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.185 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.184+0000 7f543a7fc700 1 -- 172.21.15.191:0/3738655999 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351309965 0 0) 0x7f543c070100 con 0x7f543c06a1a0 2023-03-27T10:09:27.185 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.184+0000 7f543a7fc700 1 -- 172.21.15.191:0/3738655999 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54240035b0 con 0x7f543c06a1a0 2023-03-27T10:09:27.185 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543affd700 1 -- 172.21.15.191:0/3738655999 >> v2:172.21.15.172:3300/0 conn(0x7f543c0add50 msgr2=0x7f543c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:27.185 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543affd700 1 --2- 172.21.15.191:0/3738655999 >> v2:172.21.15.172:3300/0 conn(0x7f543c0add50 0x7f543c070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.185 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543affd700 1 -- 172.21.15.191:0/3738655999 >> v1:172.21.15.172:6789/0 conn(0x7f543c06a1a0 legacy=0x7f543c06cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.185 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543affd700 1 -- 172.21.15.191:0/3738655999 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c071940 con 0x7f543c0cd210 2023-03-27T10:09:27.186 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543affd700 1 --2- 172.21.15.191:0/3738655999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0cd210 0x7f543c0710f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f543c0cb3a0 tx=0x7f5430009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae94e99eaac536e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:27.186 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543a7fc700 1 -- 172.21.15.191:0/3738655999 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430011830 con 0x7f543c0cd210 2023-03-27T10:09:27.186 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.185+0000 7f543a7fc700 1 -- 172.21.15.191:0/3738655999 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430011990 con 0x7f543c0cd210 2023-03-27T10:09:27.186 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f543a7fc700 1 -- 172.21.15.191:0/3738655999 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430011d20 con 0x7f543c0cd210 2023-03-27T10:09:27.187 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f5440f9d700 1 -- 172.21.15.191:0/3738655999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0cd210 msgr2=0x7f543c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.187 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f5440f9d700 1 --2- 172.21.15.191:0/3738655999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0cd210 0x7f543c0710f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f543c0cb3a0 tx=0x7f5430009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.187 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f5440f9d700 1 -- 172.21.15.191:0/3738655999 shutdown_connections 2023-03-27T10:09:27.187 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f5440f9d700 1 --2- 172.21.15.191:0/3738655999 >> v2:172.21.15.172:3300/0 conn(0x7f543c0add50 0x7f543c070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.187 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f5440f9d700 1 --2- 172.21.15.191:0/3738655999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0cd210 0x7f543c0710f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.188 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.186+0000 7f5440f9d700 1 -- 172.21.15.191:0/3738655999 >> 172.21.15.191:0/3738655999 conn(0x7f543c0cea30 msgr2=0x7f543c0cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:27.188 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.187+0000 7f5440f9d700 1 -- 172.21.15.191:0/3738655999 shutdown_connections 2023-03-27T10:09:27.188 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.187+0000 7f5440f9d700 1 -- 172.21.15.191:0/3738655999 wait complete. 2023-03-27T10:09:27.188 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.189+0000 7f5440f9d700 1 Processor -- start 2023-03-27T10:09:27.189 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.189+0000 7f5440f9d700 1 -- start start 2023-03-27T10:09:27.190 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.191+0000 7f5440f9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 0x7f543c152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.190 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.191+0000 7f5440f9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0add50 0x7f543c151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.190 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.191+0000 7f5440f9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f543c0cd210 0x7f543c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.190 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.191+0000 7f5440f9d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c152b60 con 0x7f543c06a1a0 2023-03-27T10:09:27.191 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.191+0000 7f5440f9d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0af3f0 con 0x7f543c0add50 2023-03-27T10:09:27.191 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.191+0000 7f5440f9d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c15a9d0 con 0x7f543c0cd210 2023-03-27T10:09:27.191 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0add50 0x7f543c151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.191 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 0x7f543c152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.191 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543affd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0add50 0x7f543c151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44944/0 (socket says 172.21.15.191:44944) 2023-03-27T10:09:27.192 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 0x7f543c152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.191:51200/0 (socket says 172.21.15.191:51200) 2023-03-27T10:09:27.192 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543affd700 1 -- 172.21.15.191:0/883800267 learned_addr learned my addr 172.21.15.191:0/883800267 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:27.192 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543bfff700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f543c0cd210 0x7f543c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.193 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 -- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f543c0cd210 msgr2=0x7f543c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.193 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f543c0cd210 0x7f543c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 -- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0add50 msgr2=0x7f543c151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0add50 0x7f543c151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.192+0000 7f543b7fe700 1 -- 172.21.15.191:0/883800267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430009550 con 0x7f543c06a1a0 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.193+0000 7f543b7fe700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 0x7f543c152620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f542c00e870 tx=0x7f542c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.193+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c013680 con 0x7f543c06a1a0 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.193+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c0137e0 con 0x7f543c06a1a0 2023-03-27T10:09:27.194 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.193+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c06fab0 con 0x7f543c06a1a0 2023-03-27T10:09:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.193+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c013b70 con 0x7f543c06a1a0 2023-03-27T10:09:27.195 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.193+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c071c20 con 0x7f543c06a1a0 2023-03-27T10:09:27.205 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.195+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c06fd90 con 0x7f543c06a1a0 2023-03-27T10:09:27.206 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.206+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f542c019030 con 0x7f543c06a1a0 2023-03-27T10:09:27.206 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.206+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f542c006680 con 0x7f543c06a1a0 2023-03-27T10:09:27.208 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.208+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f542c021060 con 0x7f543c06a1a0 2023-03-27T10:09:27.292 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.293+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c32fd432-27ba-44fa-b477-113622563b2e", "id": 4} v 0) v1 -- 0x7f543c15a810 con 0x7f543c06a1a0 2023-03-27T10:09:27.298 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.298+0000 7f5423fff700 1 -- 172.21.15.191:0/883800267 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c32fd432-27ba-44fa-b477-113622563b2e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f542c017070 con 0x7f543c06a1a0 2023-03-27T10:09:27.298 INFO:teuthology.orchestra.run.smithi191.stdout:4 2023-03-27T10:09:27.299 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 msgr2=0x7f543c152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.299 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 0x7f543c152620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f542c00e870 tx=0x7f542c00eb80 comp rx=0 tx=0).stop 2023-03-27T10:09:27.299 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 shutdown_connections 2023-03-27T10:09:27.299 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f543c0cd210 0x7f543c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.300 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f543c06a1a0 0x7f543c152620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.300 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 --2- 172.21.15.191:0/883800267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f543c0add50 0x7f543c151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.300 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 >> 172.21.15.191:0/883800267 conn(0x7f543c0cea30 msgr2=0x7f543c070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:27.300 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 shutdown_connections 2023-03-27T10:09:27.300 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.300+0000 7f5440f9d700 1 -- 172.21.15.191:0/883800267 wait complete. 2023-03-27T10:09:27.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 9b8bf9d0-912b-4a79-960f-01b630c1a8cb 5 2023-03-27T10:09:27.342 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:27.343+0000 7fbdaa90d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-27T10:09:27.494 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.495+0000 7fd85d7ff700 1 Processor -- start 2023-03-27T10:09:27.495 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.495+0000 7fd85d7ff700 1 -- start start 2023-03-27T10:09:27.495 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.496+0000 7fd85d7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 0x7fd8580d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.496 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.496+0000 7fd85d7ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8580b2020 0x7fd8580d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.496 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.496+0000 7fd85d7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8580d0880 con 0x7fd8580d02c0 2023-03-27T10:09:27.496 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd85d7ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8580cd680 con 0x7fd8580b2020 2023-03-27T10:09:27.496 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd85d7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580cd960 con 0x7fd8580b1700 2023-03-27T10:09:27.498 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8577fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8580b2020 0x7fd8580d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.498 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd856ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 0x7fd8580d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.499 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd856ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 0x7fd8580d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35802/0 (socket says 172.21.15.191:35802) 2023-03-27T10:09:27.499 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8577fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8580b2020 0x7fd8580d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44950/0 (socket says 172.21.15.191:44950) 2023-03-27T10:09:27.499 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd856ffd700 1 -- 172.21.15.191:0/80232027 learned_addr learned my addr 172.21.15.191:0/80232027 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:27.499 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8577fe700 1 -- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 msgr2=0x7fd8580d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:27.500 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8577fe700 1 --2- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 0x7fd8580d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.500 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8577fe700 1 -- 172.21.15.191:0/80232027 >> v1:172.21.15.172:6789/0 conn(0x7fd8580d02c0 legacy=0x7fd858160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.500 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8567fc700 1 -- 172.21.15.191:0/80232027 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150971896 0 0) 0x7fd8580d0880 con 0x7fd8580d02c0 2023-03-27T10:09:27.500 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd8577fe700 1 -- 172.21.15.191:0/80232027 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8580cdc40 con 0x7fd8580b2020 2023-03-27T10:09:27.500 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.497+0000 7fd856ffd700 1 --2- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 0x7fd8580d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:27.501 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.498+0000 7fd8577fe700 1 --2- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8580d1030 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd850009d90 tx=0x7fd85000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5029e5369c687e14 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:27.501 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.498+0000 7fd8567fc700 1 -- 172.21.15.191:0/80232027 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85000e070 con 0x7fd8580b2020 2023-03-27T10:09:27.501 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.498+0000 7fd8567fc700 1 -- 172.21.15.191:0/80232027 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85000bb20 con 0x7fd8580b2020 2023-03-27T10:09:27.501 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.498+0000 7fd8567fc700 1 -- 172.21.15.191:0/80232027 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850012430 con 0x7fd8580b2020 2023-03-27T10:09:27.501 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.498+0000 7fd85d7ff700 1 -- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 msgr2=0x7fd8580d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.501 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.498+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8580d1030 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd850009d90 tx=0x7fd85000b330 comp rx=0 tx=0).stop 2023-03-27T10:09:27.502 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.499+0000 7fd85d7ff700 1 -- 172.21.15.191:0/80232027 shutdown_connections 2023-03-27T10:09:27.502 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.499+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8580d1030 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.502 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.499+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/80232027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580b1700 0x7fd8580d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.502 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.499+0000 7fd85d7ff700 1 -- 172.21.15.191:0/80232027 >> 172.21.15.191:0/80232027 conn(0x7fd85809c260 msgr2=0x7fd8580d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:27.502 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.499+0000 7fd85d7ff700 1 -- 172.21.15.191:0/80232027 shutdown_connections 2023-03-27T10:09:27.502 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.499+0000 7fd85d7ff700 1 -- 172.21.15.191:0/80232027 wait complete. 2023-03-27T10:09:27.504 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.500+0000 7fd85d7ff700 1 Processor -- start 2023-03-27T10:09:27.504 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.500+0000 7fd85d7ff700 1 -- start start 2023-03-27T10:09:27.504 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.501+0000 7fd85d7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8580b1700 0x7fd8580b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.501+0000 7fd85d7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8581545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.501+0000 7fd85d7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580d02c0 0x7fd858158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.501+0000 7fd85d7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8581586d0 con 0x7fd8580b1700 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.501+0000 7fd85d7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd858158970 con 0x7fd8580b2020 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.501+0000 7fd85d7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd858158c50 con 0x7fd8580d02c0 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8581545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.505 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd8577fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580d02c0 0x7fd858158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8581545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44962/0 (socket says 172.21.15.191:44962) 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 -- 172.21.15.191:0/71341762 learned_addr learned my addr 172.21.15.191:0/71341762 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd856ffd700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8580b1700 0x7fd8580b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 -- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580d02c0 msgr2=0x7fd858158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580d02c0 0x7fd858158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 -- 172.21.15.191:0/71341762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8580b1700 msgr2=0x7fd8580b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8580b1700 0x7fd8580b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.506 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 -- 172.21.15.191:0/71341762 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848009500 con 0x7fd8580b2020 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd8577fe700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580d02c0 0x7fd858158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84ffff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8581545f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8400011e0 tx=0x7fd84000ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.502+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400054e0 con 0x7fd8580b2020 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.503+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840003680 con 0x7fd8580b2020 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.503+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840003a30 con 0x7fd8580b2020 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.503+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd850009a70 con 0x7fd8580b2020 2023-03-27T10:09:27.507 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.503+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8580cf450 con 0x7fd8580b2020 2023-03-27T10:09:27.508 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.503+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fd840019030 con 0x7fd8580b2020 2023-03-27T10:09:27.508 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.503+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd84001c440 con 0x7fd8580b2020 2023-03-27T10:09:27.508 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.504+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8580cdf20 con 0x7fd8580b2020 2023-03-27T10:09:27.508 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.506+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7fd840017070 con 0x7fd8580b2020 2023-03-27T10:09:27.519 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:27.520+0000 7fbdaa90d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-27T10:09:27.553 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:27.555+0000 7f8f4e061200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-27T10:09:27.590 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.591+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b8bf9d0-912b-4a79-960f-01b630c1a8cb", "id": 5} v 0) v1 -- 0x7fd8580afb50 con 0x7fd8580b2020 2023-03-27T10:09:27.596 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.597+0000 7fd84f7fe700 1 -- 172.21.15.191:0/71341762 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b8bf9d0-912b-4a79-960f-01b630c1a8cb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd840003b90 con 0x7fd8580b2020 2023-03-27T10:09:27.597 INFO:teuthology.orchestra.run.smithi191.stdout:5 2023-03-27T10:09:27.598 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 msgr2=0x7fd8581545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.598 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8581545f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8400011e0 tx=0x7fd84000ca30 comp rx=0 tx=0).stop 2023-03-27T10:09:27.598 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 shutdown_connections 2023-03-27T10:09:27.598 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8580d02c0 0x7fd858158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.598 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8580b1700 0x7fd8580b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.598 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 --2- 172.21.15.191:0/71341762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8580b2020 0x7fd8581545f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.599 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 >> 172.21.15.191:0/71341762 conn(0x7fd85809c260 msgr2=0x7fd8580d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:27.599 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 shutdown_connections 2023-03-27T10:09:27.599 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.598+0000 7fd85d7ff700 1 -- 172.21.15.191:0/71341762 wait complete. 2023-03-27T10:09:27.613 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 7224502a-7a32-4a31-a2c5-95d3a5abed83 6 2023-03-27T10:09:27.721 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:27.722+0000 7f8f4e061200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-27T10:09:27.795 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:27.796+0000 7fbdaa90d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-27T10:09:27.842 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.843+0000 7fa02b9ff700 1 Processor -- start 2023-03-27T10:09:27.843 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.843+0000 7fa02b9ff700 1 -- start start 2023-03-27T10:09:27.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.844+0000 7fa02b9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240d02c0 0x7fa0240ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.844+0000 7fa02b9ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240d0880 con 0x7fa0240d1200 2023-03-27T10:09:27.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.844+0000 7fa02b9ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240cd680 con 0x7fa0240b1700 2023-03-27T10:09:27.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.844+0000 7fa02b9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240cd960 con 0x7fa0240d02c0 2023-03-27T10:09:27.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa02979b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fa0240b1700 0x7fa0240d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:58858/0 (socket says 172.21.15.191:58858) 2023-03-27T10:09:27.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa02979b700 1 -- 172.21.15.191:0/3442283793 learned_addr learned my addr 172.21.15.191:0/3442283793 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-03-27T10:09:27.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa029f9c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240d02c0 0x7fa0240ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa029f9c700 1 -- 172.21.15.191:0/3442283793 >> v1:172.21.15.191:6789/0 conn(0x7fa0240b1700 legacy=0x7fa0240d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa029f9c700 1 -- 172.21.15.191:0/3442283793 >> v1:172.21.15.172:6789/0 conn(0x7fa0240d1200 legacy=0x7fa0240ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa029f9c700 1 -- 172.21.15.191:0/3442283793 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240cdc40 con 0x7fa0240d02c0 2023-03-27T10:09:27.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa01bfff700 1 -- 172.21.15.191:0/3442283793 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173465840 0 0) 0x7fa0240cd680 con 0x7fa0240b1700 2023-03-27T10:09:27.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa029f9c700 1 --2- 172.21.15.191:0/3442283793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240d02c0 0x7fa0240ceb50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009dc0 tx=0x7fa01c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d724c358009c7d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.845+0000 7fa01bfff700 1 -- 172.21.15.191:0/3442283793 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00e070 con 0x7fa0240d02c0 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa01bfff700 1 -- 172.21.15.191:0/3442283793 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c00bbd0 con 0x7fa0240d02c0 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa01bfff700 1 -- 172.21.15.191:0/3442283793 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c012430 con 0x7fa0240d02c0 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 -- 172.21.15.191:0/3442283793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240d02c0 msgr2=0x7fa0240ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 --2- 172.21.15.191:0/3442283793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240d02c0 0x7fa0240ceb50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009dc0 tx=0x7fa01c00b330 comp rx=0 tx=0).stop 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 -- 172.21.15.191:0/3442283793 shutdown_connections 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 --2- 172.21.15.191:0/3442283793 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240d02c0 0x7fa0240ceb50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 -- 172.21.15.191:0/3442283793 >> 172.21.15.191:0/3442283793 conn(0x7fa02409c260 msgr2=0x7fa0240d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:27.848 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 -- 172.21.15.191:0/3442283793 shutdown_connections 2023-03-27T10:09:27.848 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.846+0000 7fa02b9ff700 1 -- 172.21.15.191:0/3442283793 wait complete. 2023-03-27T10:09:27.849 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.848+0000 7fa02b9ff700 1 Processor -- start 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.848+0000 7fa02b9ff700 1 -- start start 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02b9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 0x7fa02406be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02b9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0240d02c0 0x7fa024159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02b9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0240d1200 0x7fa02415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02b9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415fd60 con 0x7fa0240d02c0 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02b9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415f1e0 con 0x7fa0240d1200 2023-03-27T10:09:27.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02b9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415f4c0 con 0x7fa0240b1700 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02979b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 0x7fa02406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02979b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 0x7fa02406be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35818/0 (socket says 172.21.15.191:35818) 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa02979b700 1 -- 172.21.15.191:0/2544440678 learned_addr learned my addr 172.21.15.191:0/2544440678 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa029f9c700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0240d1200 0x7fa02415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.849+0000 7fa028f9a700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0240d02c0 0x7fa024159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa028f9a700 1 -- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 msgr2=0x7fa02406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa028f9a700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 0x7fa02406be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa028f9a700 1 -- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0240d1200 msgr2=0x7fa02415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa028f9a700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0240d1200 0x7fa02415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa028f9a700 1 -- 172.21.15.191:0/2544440678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c009a70 con 0x7fa0240d02c0 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa02979b700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 0x7fa02406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa029f9c700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0240d1200 0x7fa02415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa028f9a700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0240d02c0 0x7fa024159b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa014000f60 tx=0x7fa01400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140050d0 con 0x7fa0240d02c0 2023-03-27T10:09:27.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014005230 con 0x7fa0240d02c0 2023-03-27T10:09:27.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014003680 con 0x7fa0240d02c0 2023-03-27T10:09:27.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0240afb50 con 0x7fa0240d02c0 2023-03-27T10:09:27.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0240cdf20 con 0x7fa0240d02c0 2023-03-27T10:09:27.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.850+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa014019030 con 0x7fa0240d02c0 2023-03-27T10:09:27.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.851+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa014011680 con 0x7fa0240d02c0 2023-03-27T10:09:27.854 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.851+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0240d2c50 con 0x7fa0240d02c0 2023-03-27T10:09:27.854 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.854+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7fa014017070 con 0x7fa0240d02c0 2023-03-27T10:09:27.887 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:27.888+0000 7fbdaa90d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-27T10:09:27.938 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.939+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7224502a-7a32-4a31-a2c5-95d3a5abed83", "id": 6} v 0) v1 -- 0x7fa0240b1b60 con 0x7fa0240d02c0 2023-03-27T10:09:27.945 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.946+0000 7fa019ffb700 1 -- 172.21.15.191:0/2544440678 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7224502a-7a32-4a31-a2c5-95d3a5abed83", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0240b1b60 con 0x7fa0240d02c0 2023-03-27T10:09:27.945 INFO:teuthology.orchestra.run.smithi191.stdout:6 2023-03-27T10:09:27.946 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0240d02c0 msgr2=0x7fa024159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:27.946 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0240d02c0 0x7fa024159b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa014000f60 tx=0x7fa01400c730 comp rx=0 tx=0).stop 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 shutdown_connections 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0240d1200 0x7fa02415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0240b1700 0x7fa02406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 --2- 172.21.15.191:0/2544440678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0240d02c0 0x7fa024159b40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 >> 172.21.15.191:0/2544440678 conn(0x7fa02409c260 msgr2=0x7fa0240ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 shutdown_connections 2023-03-27T10:09:27.947 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:27.947+0000 7fa02b9ff700 1 -- 172.21.15.191:0/2544440678 wait complete. 2023-03-27T10:09:27.963 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 7402619e-0584-4337-a66e-c95f4fb04e27 7 2023-03-27T10:09:27.983 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:27.985+0000 7f8f4e061200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-27T10:09:28.056 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:28.056+0000 7fbdaa90d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-27T10:09:28.071 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:28.073+0000 7f8f4e061200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-27T10:09:28.142 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.143+0000 7ff27f5ff700 1 Processor -- start 2023-03-27T10:09:28.142 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.143+0000 7ff27f5ff700 1 -- start start 2023-03-27T10:09:28.143 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27f5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 0x7ff2780d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27f5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2780d02c0 0x7ff2780d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27f5ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780d0880 con 0x7ff2780b2020 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27f5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780cd680 con 0x7ff2780d02c0 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27f5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780cd960 con 0x7ff2780b1700 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27d39b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 0x7ff2780d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27d39b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 0x7ff2780d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:35830/0 (socket says 172.21.15.191:35830) 2023-03-27T10:09:28.144 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27d39b700 1 -- 172.21.15.191:0/3720527334 learned_addr learned my addr 172.21.15.191:0/3720527334 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:28.145 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.144+0000 7ff27cb9a700 1 --2- 172.21.15.191:0/3720527334 >> v2:172.21.15.172:3300/0 conn(0x7ff2780d02c0 0x7ff2780d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.146 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff27d39b700 1 -- 172.21.15.191:0/3720527334 >> v2:172.21.15.172:3300/0 conn(0x7ff2780d02c0 msgr2=0x7ff2780d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:28.146 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff27d39b700 1 --2- 172.21.15.191:0/3720527334 >> v2:172.21.15.172:3300/0 conn(0x7ff2780d02c0 0x7ff2780d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.146 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff27d39b700 1 -- 172.21.15.191:0/3720527334 >> v1:172.21.15.172:6789/0 conn(0x7ff2780b2020 legacy=0x7ff278160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.146 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff27d39b700 1 -- 172.21.15.191:0/3720527334 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780cdc40 con 0x7ff2780b1700 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff27d39b700 1 --2- 172.21.15.191:0/3720527334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 0x7ff2780d0af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff274006fd0 tx=0x7ff274009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624890398ac8ca2e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff26ffff700 1 -- 172.21.15.191:0/3720527334 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274005e30 con 0x7ff2780b1700 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff26ffff700 1 -- 172.21.15.191:0/3720527334 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274004030 con 0x7ff2780b1700 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.145+0000 7ff26ffff700 1 -- 172.21.15.191:0/3720527334 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740043e0 con 0x7ff2780b1700 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 -- 172.21.15.191:0/3720527334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 msgr2=0x7ff2780d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/3720527334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 0x7ff2780d0af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff274006fd0 tx=0x7ff274009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.147 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 -- 172.21.15.191:0/3720527334 shutdown_connections 2023-03-27T10:09:28.148 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/3720527334 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b1700 0x7ff2780d0af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.148 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/3720527334 >> v2:172.21.15.172:3300/0 conn(0x7ff2780d02c0 0x7ff2780d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.148 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 -- 172.21.15.191:0/3720527334 >> 172.21.15.191:0/3720527334 conn(0x7ff27809c260 msgr2=0x7ff2780d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:28.148 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 -- 172.21.15.191:0/3720527334 shutdown_connections 2023-03-27T10:09:28.148 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.146+0000 7ff27f5ff700 1 -- 172.21.15.191:0/3720527334 wait complete. 2023-03-27T10:09:28.150 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.148+0000 7ff27f5ff700 1 Processor -- start 2023-03-27T10:09:28.151 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.148+0000 7ff27f5ff700 1 -- start start 2023-03-27T10:09:28.151 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27f5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 0x7ff2781f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.151 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27f5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b2020 0x7ff2780c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.151 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27f5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2780d02c0 0x7ff2780b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.151 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27f5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278149af0 con 0x7ff2780b1700 2023-03-27T10:09:28.151 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27f5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278148e70 con 0x7ff2780d02c0 2023-03-27T10:09:28.152 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27f5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff278149150 con 0x7ff2780b2020 2023-03-27T10:09:28.152 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 0x7ff2781f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.152 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27db9c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2780d02c0 0x7ff2780b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.152 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27cb9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b2020 0x7ff2780c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.152 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 0x7ff2781f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.191:51242/0 (socket says 172.21.15.191:51242) 2023-03-27T10:09:28.152 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 -- 172.21.15.191:0/1832536491 learned_addr learned my addr 172.21.15.191:0/1832536491 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 -- 172.21.15.191:0/1832536491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b2020 msgr2=0x7ff2780c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b2020 0x7ff2780c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 -- 172.21.15.191:0/1832536491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2780d02c0 msgr2=0x7ff2780b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2780d02c0 0x7ff2780b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.149+0000 7ff27d39b700 1 -- 172.21.15.191:0/1832536491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009500 con 0x7ff2780b1700 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff27d39b700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 0x7ff2781f6650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff274000c00 tx=0x7ff274004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:28.153 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274003c70 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274003dd0 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2780cf450 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27401c640 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780cdf20 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ff27402c070 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.150+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff274011420 con 0x7ff2780b1700 2023-03-27T10:09:28.154 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.151+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2780afb50 con 0x7ff2780b1700 2023-03-27T10:09:28.155 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.154+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7ff27402a060 con 0x7ff2780b1700 2023-03-27T10:09:28.236 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.237+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7402619e-0584-4337-a66e-c95f4fb04e27", "id": 7} v 0) v1 -- 0x7ff278149c30 con 0x7ff2780b1700 2023-03-27T10:09:28.236 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:28.238+0000 7f8f4e061200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-27T10:09:28.243 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.243+0000 7ff26dffb700 1 -- 172.21.15.191:0/1832536491 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7402619e-0584-4337-a66e-c95f4fb04e27", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff278149c30 con 0x7ff2780b1700 2023-03-27T10:09:28.243 INFO:teuthology.orchestra.run.smithi191.stdout:7 2023-03-27T10:09:28.244 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 msgr2=0x7ff2781f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.245 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 0x7ff2781f6650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff274000c00 tx=0x7ff274004750 comp rx=0 tx=0).stop 2023-03-27T10:09:28.245 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 shutdown_connections 2023-03-27T10:09:28.245 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2780d02c0 0x7ff2780b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.245 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2780b1700 0x7ff2781f6650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.245 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 --2- 172.21.15.191:0/1832536491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff2780b2020 0x7ff2780c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.245 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 >> 172.21.15.191:0/1832536491 conn(0x7ff27809c260 msgr2=0x7ff27806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:28.246 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 shutdown_connections 2023-03-27T10:09:28.246 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-27T10:09:28.245+0000 7ff27f5ff700 1 -- 172.21.15.191:0/1832536491 wait complete. 2023-03-27T10:09:28.261 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-27T10:09:28.261 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-27T10:09:28.265 INFO:tasks.ceph.osd.0:Started 2023-03-27T10:09:28.265 INFO:tasks.ceph.osd.1:Restarting daemon 2023-03-27T10:09:28.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-03-27T10:09:28.270 INFO:tasks.ceph.osd.1:Started 2023-03-27T10:09:28.270 INFO:tasks.ceph.osd.2:Restarting daemon 2023-03-27T10:09:28.270 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-03-27T10:09:28.274 INFO:tasks.ceph.osd.2:Started 2023-03-27T10:09:28.275 INFO:tasks.ceph.osd.3:Restarting daemon 2023-03-27T10:09:28.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-03-27T10:09:28.279 INFO:tasks.ceph.osd.3:Started 2023-03-27T10:09:28.280 INFO:tasks.ceph.osd.4:Restarting daemon 2023-03-27T10:09:28.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-03-27T10:09:28.284 INFO:tasks.ceph.osd.4:Started 2023-03-27T10:09:28.284 INFO:tasks.ceph.osd.5:Restarting daemon 2023-03-27T10:09:28.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-03-27T10:09:28.288 INFO:tasks.ceph.osd.5:Started 2023-03-27T10:09:28.289 INFO:tasks.ceph.osd.6:Restarting daemon 2023-03-27T10:09:28.289 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-03-27T10:09:28.294 INFO:tasks.ceph.osd.6:Started 2023-03-27T10:09:28.295 INFO:tasks.ceph.osd.7:Restarting daemon 2023-03-27T10:09:28.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-03-27T10:09:28.299 INFO:tasks.ceph.osd.7:Started 2023-03-27T10:09:28.300 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:28.399 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:28.400+0000 7fbdaa90d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-27T10:09:28.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.542+0000 7f7eff7ff700 1 Processor -- start 2023-03-27T10:09:28.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.542+0000 7f7eff7ff700 1 -- start start 2023-03-27T10:09:28.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.543+0000 7f7eff7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7ef815a9c0 0x7f7ef80afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.543+0000 7f7eff7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef80cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.543+0000 7f7eff7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef8071df0 con 0x7f7ef815a5f0 2023-03-27T10:09:28.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.543+0000 7f7eff7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef80caa00 con 0x7f7ef815a9c0 2023-03-27T10:09:28.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.543+0000 7f7eff7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80cace0 con 0x7f7ef80b0370 2023-03-27T10:09:28.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.543+0000 7f7efcd9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7ef815a9c0 0x7f7ef80afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efd59b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7ef815a5f0 0x7f7ef815e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57480/0 (socket says 172.21.15.172:57480) 2023-03-27T10:09:28.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efd59b700 1 -- 172.21.15.172:0/1596472200 learned_addr learned my addr 172.21.15.172:0/1596472200 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:28.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efdd9c700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef80cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efcd9a700 1 -- 172.21.15.172:0/1596472200 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 msgr2=0x7f7ef80cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:28.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efcd9a700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef80cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efcd9a700 1 -- 172.21.15.172:0/1596472200 >> v1:172.21.15.172:6789/0 conn(0x7f7ef815a5f0 legacy=0x7f7ef815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efcd9a700 1 -- 172.21.15.172:0/1596472200 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80cafc0 con 0x7f7ef815a9c0 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efdd9c700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7eeffff700 1 -- 172.21.15.172:0/1596472200 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506358173 0 0) 0x7f7ef4001110 con 0x7f7ef815a5f0 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7efcd9a700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80afe30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009840 tx=0x7f7ee8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220d97304c4bea1a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.544+0000 7f7eeffff700 1 -- 172.21.15.172:0/1596472200 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8011830 con 0x7f7ef815a9c0 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eeffff700 1 -- 172.21.15.172:0/1596472200 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8011990 con 0x7f7ef815a9c0 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eeffff700 1 -- 172.21.15.172:0/1596472200 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8011d20 con 0x7f7ef815a9c0 2023-03-27T10:09:28.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 -- 172.21.15.172:0/1596472200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a9c0 msgr2=0x7f7ef80afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80afe30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009840 tx=0x7f7ee8009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 -- 172.21.15.172:0/1596472200 shutdown_connections 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/1596472200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80afe30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 -- 172.21.15.172:0/1596472200 >> 172.21.15.172:0/1596472200 conn(0x7f7ef806a1a0 msgr2=0x7f7ef806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 -- 172.21.15.172:0/1596472200 shutdown_connections 2023-03-27T10:09:28.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.545+0000 7f7eff7ff700 1 -- 172.21.15.172:0/1596472200 wait complete. 2023-03-27T10:09:28.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.548+0000 7f7eff7ff700 1 Processor -- start 2023-03-27T10:09:28.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.548+0000 7f7eff7ff700 1 -- start start 2023-03-27T10:09:28.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7eff7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef8144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7eff7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 0x7f7ef80ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7eff7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:28.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7eff7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef814fbb0 con 0x7f7ef815a5f0 2023-03-27T10:09:28.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7eff7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8152300 con 0x7f7ef815a9c0 2023-03-27T10:09:28.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7eff7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8144b70 con 0x7f7ef80b0370 2023-03-27T10:09:28.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7efcd9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 0x7f7ef80ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7efcd9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 0x7f7ef80ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46204/0 (socket says 172.21.15.172:46204) 2023-03-27T10:09:28.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7efcd9a700 1 -- 172.21.15.172:0/3318297933 learned_addr learned my addr 172.21.15.172:0/3318297933 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:28.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7efd59b700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef8144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.549+0000 7f7efdd9c700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:28.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7efcd9a700 1 -- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 msgr2=0x7f7ef8144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7efcd9a700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef8144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7efcd9a700 1 -- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ef815a9c0 msgr2=0x7f7ef80ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7efcd9a700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7efcd9a700 1 -- 172.21.15.172:0/3318297933 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80094a0 con 0x7f7ef815a5f0 2023-03-27T10:09:28.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7efcd9a700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 0x7f7ef80ce450 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8014040 tx=0x7f7ee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:28.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80036a0 con 0x7f7ef815a5f0 2023-03-27T10:09:28.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee801e070 con 0x7f7ef815a5f0 2023-03-27T10:09:28.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.550+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8003a20 con 0x7f7ef815a5f0 2023-03-27T10:09:28.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.551+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef80ca6b0 con 0x7f7ef815a5f0 2023-03-27T10:09:28.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.551+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef80cb2a0 con 0x7f7ef815a5f0 2023-03-27T10:09:28.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.551+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7ee800f050 con 0x7f7ef815a5f0 2023-03-27T10:09:28.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.551+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7ee801a420 con 0x7f7ef815a5f0 2023-03-27T10:09:28.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.552+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef80cbb50 con 0x7f7ef815a5f0 2023-03-27T10:09:28.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.554+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f7ee8020070 con 0x7f7ef815a5f0 2023-03-27T10:09:28.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.625+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ef8074290 con 0x7f7ef815a5f0 2023-03-27T10:09:28.625 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:28.625+0000 7fbdaa90d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-27T10:09:28.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.625+0000 7f7eedffb700 1 -- 172.21.15.172:0/3318297933 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7ee8015020 con 0x7f7ef815a5f0 2023-03-27T10:09:28.626 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:28.627 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":10,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:28.238841+0000","last_up_change":"0.000000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:28.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 msgr2=0x7f7ef80ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:28.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 0x7f7ef80ce450 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8014040 tx=0x7f7ee8004750 comp rx=0 tx=0).stop 2023-03-27T10:09:28.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 shutdown_connections 2023-03-27T10:09:28.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ef815a9c0 0x7f7ef80ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ef80b0370 0x7f7ef8144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 --2- 172.21.15.172:0/3318297933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef815a5f0 0x7f7ef80ce450 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:28.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 >> 172.21.15.172:0/3318297933 conn(0x7f7ef806a1a0 msgr2=0x7f7ef8156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:28.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 shutdown_connections 2023-03-27T10:09:28.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:28.627+0000 7f7eff7ff700 1 -- 172.21.15.172:0/3318297933 wait complete. 2023-03-27T10:09:28.639 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:28.640+0000 7f8f4e061200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-27T10:09:28.650 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-27T10:09:28.651 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-27T10:09:28.795 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:28.796+0000 7fbdaa90d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-27T10:09:28.863 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:28.864+0000 7f8f4e061200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-27T10:09:28.935 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:28.936+0000 7fbdaa90d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-27T10:09:28.966 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T10:09:28.967+0000 7fe3d1142580 -1 Falling back to public interface 2023-03-27T10:09:28.983 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T10:09:28.984+0000 7f12b746c580 -1 Falling back to public interface 2023-03-27T10:09:28.985 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T10:09:28.986+0000 7f3470654580 -1 Falling back to public interface 2023-03-27T10:09:28.988 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T10:09:28.989+0000 7f50bf1e7580 -1 Falling back to public interface 2023-03-27T10:09:28.989 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T10:09:28.990+0000 7feef1413580 -1 Falling back to public interface 2023-03-27T10:09:28.994 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T10:09:28.995+0000 7f0dd8e99580 -1 Falling back to public interface 2023-03-27T10:09:28.995 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T10:09:28.996+0000 7f53adb29580 -1 Falling back to public interface 2023-03-27T10:09:28.999 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T10:09:29.000+0000 7f7d43835580 -1 Falling back to public interface 2023-03-27T10:09:29.036 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:29.037+0000 7f8f4e061200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-27T10:09:29.106 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:29.107+0000 7fbdaa90d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-27T10:09:29.177 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:29.178+0000 7f8f4e061200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-27T10:09:29.201 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:29.201+0000 7fbdaa90d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-27T10:09:29.346 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:29.346+0000 7f8f4e061200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-27T10:09:29.442 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:29.442+0000 7f8f4e061200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-27T10:09:29.456 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:29.457 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:29.458+0000 7fbdaa90d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-27T10:09:29.549 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:29.550+0000 7fbdaa90d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-27T10:09:29.628 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.628+0000 7f2a2c7ff700 1 Processor -- start 2023-03-27T10:09:29.628 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.629+0000 7f2a2c7ff700 1 -- start start 2023-03-27T10:09:29.629 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a2c7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a240d1200 0x7f2a240cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:29.629 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a2c7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240cf150 con 0x7f2a240b2020 2023-03-27T10:09:29.629 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a2c7ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240ce540 con 0x7f2a240b1790 2023-03-27T10:09:29.630 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a2c7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a240ce820 con 0x7f2a240d1200 2023-03-27T10:09:29.630 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a29d9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a240d1200 0x7f2a240cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:29.630 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a2ad9c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2a240b2020 0x7f2a240afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57482/0 (socket says 172.21.15.172:57482) 2023-03-27T10:09:29.630 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a2ad9c700 1 -- 172.21.15.172:0/100099804 learned_addr learned my addr 172.21.15.172:0/100099804 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:29.630 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.630+0000 7f2a29d9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a240d1200 0x7f2a240cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46218/0 (socket says 172.21.15.172:46218) 2023-03-27T10:09:29.631 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29d9a700 1 -- 172.21.15.172:0/100099804 >> v1:172.21.15.191:6789/0 conn(0x7f2a240b1790 legacy=0x7f2a240d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:29.632 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29d9a700 1 -- 172.21.15.172:0/100099804 >> v1:172.21.15.172:6789/0 conn(0x7f2a240b2020 legacy=0x7f2a240afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:29.632 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29d9a700 1 -- 172.21.15.172:0/100099804 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240ceb00 con 0x7f2a240d1200 2023-03-27T10:09:29.632 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29599700 1 -- 172.21.15.172:0/100099804 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704116290 0 0) 0x7f2a240cf150 con 0x7f2a240b2020 2023-03-27T10:09:29.632 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29d9a700 1 --2- 172.21.15.172:0/100099804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240d1200 0x7f2a240cdf30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009840 tx=0x7f2a14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aa09afe41da0e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29599700 1 -- 172.21.15.172:0/100099804 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14011830 con 0x7f2a240d1200 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29599700 1 -- 172.21.15.172:0/100099804 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14011990 con 0x7f2a240d1200 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.631+0000 7f2a29599700 1 -- 172.21.15.172:0/100099804 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14011d20 con 0x7f2a240d1200 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/100099804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240d1200 msgr2=0x7f2a240cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 --2- 172.21.15.172:0/100099804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240d1200 0x7f2a240cdf30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009840 tx=0x7f2a14009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/100099804 shutdown_connections 2023-03-27T10:09:29.633 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 --2- 172.21.15.172:0/100099804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240d1200 0x7f2a240cdf30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:29.634 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/100099804 >> 172.21.15.172:0/100099804 conn(0x7f2a2409c260 msgr2=0x7f2a240d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:29.634 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/100099804 shutdown_connections 2023-03-27T10:09:29.634 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.632+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/100099804 wait complete. 2023-03-27T10:09:29.634 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.634+0000 7f2a2c7ff700 1 Processor -- start 2023-03-27T10:09:29.634 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.634+0000 7f2a2c7ff700 1 -- start start 2023-03-27T10:09:29.636 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.635+0000 7f2a2c7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a240b1790 0x7f2a241f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:29.636 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2c7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 0x7f2a240b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:29.636 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2c7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a240d1200 0x7f2a240b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:29.637 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2c7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240b5230 con 0x7f2a240b2020 2023-03-27T10:09:29.637 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2c7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240c9450 con 0x7f2a240d1200 2023-03-27T10:09:29.637 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2c7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240c6b80 con 0x7f2a240b1790 2023-03-27T10:09:29.637 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 0x7f2a240b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:29.637 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2a59b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a240b1790 0x7f2a241f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 0x7f2a240b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46220/0 (socket says 172.21.15.172:46220) 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 -- 172.21.15.172:0/1831012811 learned_addr learned my addr 172.21.15.172:0/1831012811 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a2ad9c700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a240d1200 0x7f2a240b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 -- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a240b1790 msgr2=0x7f2a241f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a240b1790 0x7f2a241f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 -- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a240d1200 msgr2=0x7f2a240b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a240d1200 0x7f2a240b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:29.638 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.636+0000 7f2a29d9a700 1 -- 172.21.15.172:0/1831012811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140094a0 con 0x7f2a240b2020 2023-03-27T10:09:29.639 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a29d9a700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 0x7f2a240b4690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2a14014040 tx=0x7f2a14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:29.639 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1401a7e0 con 0x7f2a240b2020 2023-03-27T10:09:29.639 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1401a940 con 0x7f2a240b2020 2023-03-27T10:09:29.639 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240b1b60 con 0x7f2a240b2020 2023-03-27T10:09:29.639 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1401acb0 con 0x7f2a240b2020 2023-03-27T10:09:29.639 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240cede0 con 0x7f2a240b2020 2023-03-27T10:09:29.640 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2a1402b030 con 0x7f2a240b2020 2023-03-27T10:09:29.640 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.637+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2a1402da80 con 0x7f2a240b2020 2023-03-27T10:09:29.640 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.638+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a240d2c50 con 0x7f2a240b2020 2023-03-27T10:09:29.640 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.640+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72400 (secure 0 0 0) 0x7f2a14029070 con 0x7f2a240b2020 2023-03-27T10:09:29.711 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:29.711+0000 7f8f4e061200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-27T10:09:29.712 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.712+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a24074290 con 0x7f2a240b2020 2023-03-27T10:09:29.713 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.713+0000 7f2a1affd700 1 -- 172.21.15.172:0/1831012811 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2a14015020 con 0x7f2a240b2020 2023-03-27T10:09:29.713 INFO:teuthology.misc.health.smithi172.stdout: 2023-03-27T10:09:29.714 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":10,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:28.238841+0000","last_up_change":"0.000000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:29.715 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 msgr2=0x7f2a240b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:29.716 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 0x7f2a240b4690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2a14014040 tx=0x7f2a14004750 comp rx=0 tx=0).stop 2023-03-27T10:09:29.716 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 shutdown_connections 2023-03-27T10:09:29.716 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a240d1200 0x7f2a240b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:29.716 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a240b1790 0x7f2a241f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:29.717 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 --2- 172.21.15.172:0/1831012811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a240b2020 0x7f2a240b4690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:29.717 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 >> 172.21.15.172:0/1831012811 conn(0x7f2a2409c260 msgr2=0x7f2a2415b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:29.717 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 shutdown_connections 2023-03-27T10:09:29.717 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:29.714+0000 7f2a2c7ff700 1 -- 172.21.15.172:0/1831012811 wait complete. 2023-03-27T10:09:29.728 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-27T10:09:29.808 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:29.808+0000 7f8f4e061200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-27T10:09:30.277 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:30.278+0000 7fbdaa90d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-27T10:09:30.544 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:30.544+0000 7f8f4e061200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-27T10:09:30.575 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:30.575+0000 7fbdaa90d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-27T10:09:30.668 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:30.669+0000 7fbdaa90d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-27T10:09:30.767 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:30.768+0000 7fbdaa90d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-27T10:09:30.844 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:30.845+0000 7f8f4e061200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-27T10:09:30.937 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:30.937+0000 7f8f4e061200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-27T10:09:30.987 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:30.987+0000 7fbdaa90d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-27T10:09:31.036 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:31.037+0000 7f8f4e061200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-27T10:09:31.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:31.072+0000 7fbdaa90d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-27T10:09:31.257 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:31.258+0000 7fbdaa90d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-27T10:09:31.260 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:31.261+0000 7f8f4e061200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-27T10:09:31.351 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:31.351+0000 7f8f4e061200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-27T10:09:31.568 INFO:tasks.ceph.mgr.y.smithi172.stderr:2023-03-27T10:09:31.569+0000 7f8f4e061200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-27T10:09:32.279 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:32.279+0000 7fbd5f5fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-03-27T10:09:32.279 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-27T10:09:32.280+0000 7fbd5f5fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-03-27T10:09:32.492 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T10:09:32.493+0000 7f3470654580 -1 osd.6 0 log_to_monitors true 2023-03-27T10:09:32.546 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T10:09:32.547+0000 7f53adb29580 -1 osd.2 0 log_to_monitors true 2023-03-27T10:09:32.563 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T10:09:32.563+0000 7f12b746c580 -1 osd.3 0 log_to_monitors true 2023-03-27T10:09:32.569 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T10:09:32.570+0000 7f0dd8e99580 -1 osd.4 0 log_to_monitors true 2023-03-27T10:09:32.570 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T10:09:32.570+0000 7f7d43835580 -1 osd.7 0 log_to_monitors true 2023-03-27T10:09:32.571 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T10:09:32.572+0000 7feef1413580 -1 osd.5 0 log_to_monitors true 2023-03-27T10:09:32.755 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T10:09:32.756+0000 7fe3d1142580 -1 osd.0 0 log_to_monitors true 2023-03-27T10:09:32.827 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T10:09:32.827+0000 7f50bf1e7580 -1 osd.1 0 log_to_monitors true 2023-03-27T10:09:36.311 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T10:09:36.312+0000 7f7d31ff6700 -1 osd.7 0 waiting for initial osdmap 2023-03-27T10:09:36.317 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T10:09:36.318+0000 7f345edf6700 -1 osd.6 0 waiting for initial osdmap 2023-03-27T10:09:36.348 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T10:09:36.348+0000 7f7d29ffb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:36.348 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T10:09:36.348+0000 7f3456dfb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:36.370 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T10:09:36.371+0000 7f50ad7f6700 -1 osd.1 0 waiting for initial osdmap 2023-03-27T10:09:36.383 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T10:09:36.383+0000 7f0dc75f6700 -1 osd.4 0 waiting for initial osdmap 2023-03-27T10:09:36.396 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T10:09:36.397+0000 7f50a57fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:36.407 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T10:09:36.408+0000 7fe3bf7f6700 -1 osd.0 0 waiting for initial osdmap 2023-03-27T10:09:36.412 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T10:09:36.413+0000 7f0dbf5fb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:36.435 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T10:09:36.436+0000 7fe3b77fb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:36.456 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T10:09:36.456+0000 7f12a5bf6700 -1 osd.3 0 waiting for initial osdmap 2023-03-27T10:09:36.487 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T10:09:36.488+0000 7f129dbfb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:36.535 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:36.699 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.700+0000 7f75309ff700 1 Processor -- start 2023-03-27T10:09:36.700 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.700+0000 7f75309ff700 1 -- start start 2023-03-27T10:09:36.701 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.701+0000 7f75309ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:36.701 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.701+0000 7f75309ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f752c0d2da0 0x7f752c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:36.701 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.701+0000 7f75309ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0cdc20 con 0x7f752c0cfc60 2023-03-27T10:09:36.701 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.701+0000 7f75309ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0cd610 con 0x7f752c0d2da0 2023-03-27T10:09:36.701 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.701+0000 7f75309ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c15cad0 con 0x7f752c15c700 2023-03-27T10:09:36.702 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f752c0d2da0 0x7f752c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:36.702 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f752c0d2da0 0x7f752c0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35244/0 (socket says 172.21.15.172:35244) 2023-03-27T10:09:36.702 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f752ad9d700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f752c0cfc60 0x7f752c0ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:32836/0 (socket says 172.21.15.172:32836) 2023-03-27T10:09:36.702 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 -- 172.21.15.172:0/4115312613 learned_addr learned my addr 172.21.15.172:0/4115312613 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:36.702 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f752a59c700 1 --2- 172.21.15.172:0/4115312613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:36.703 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 -- 172.21.15.172:0/4115312613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 msgr2=0x7f752c0d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:36.704 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 --2- 172.21.15.172:0/4115312613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.704 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 -- 172.21.15.172:0/4115312613 >> v1:172.21.15.191:6789/0 conn(0x7f752c0cfc60 legacy=0x7f752c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:36.704 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 -- 172.21.15.172:0/4115312613 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0d0450 con 0x7f752c0d2da0 2023-03-27T10:09:36.704 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f752959a700 1 -- 172.21.15.172:0/4115312613 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683000621 0 0) 0x7f752c0cdc20 con 0x7f752c0cfc60 2023-03-27T10:09:36.704 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.702+0000 7f7529d9b700 1 --2- 172.21.15.172:0/4115312613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cf720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f75200098f0 tx=0x7f7520009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2eebffbe54437a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:36.704 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f752959a700 1 -- 172.21.15.172:0/4115312613 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520011830 con 0x7f752c0d2da0 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f752959a700 1 -- 172.21.15.172:0/4115312613 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520011990 con 0x7f752c0d2da0 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f752959a700 1 -- 172.21.15.172:0/4115312613 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520011d20 con 0x7f752c0d2da0 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 -- 172.21.15.172:0/4115312613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 msgr2=0x7f752c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 --2- 172.21.15.172:0/4115312613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cf720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f75200098f0 tx=0x7f7520009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 -- 172.21.15.172:0/4115312613 shutdown_connections 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 --2- 172.21.15.172:0/4115312613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.705 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 --2- 172.21.15.172:0/4115312613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cf720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.706 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 -- 172.21.15.172:0/4115312613 >> 172.21.15.172:0/4115312613 conn(0x7f752c0721f0 msgr2=0x7f752c09c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:36.706 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 -- 172.21.15.172:0/4115312613 shutdown_connections 2023-03-27T10:09:36.706 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.703+0000 7f75309ff700 1 -- 172.21.15.172:0/4115312613 wait complete. 2023-03-27T10:09:36.708 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.705+0000 7f75309ff700 1 Processor -- start 2023-03-27T10:09:36.708 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.705+0000 7f75309ff700 1 -- start start 2023-03-27T10:09:36.708 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f75309ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 0x7f752c14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:36.708 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f75309ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:36.708 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f75309ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:36.708 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f75309ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0cb5e0 con 0x7f752c0d2da0 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f75309ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0cc440 con 0x7f752c0cfc60 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f75309ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c15b9e0 con 0x7f752c15c700 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f752a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 0x7f752c14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f7529d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f752a59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 0x7f752c14c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:37330/0 (socket says 172.21.15.172:37330) 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.706+0000 7f752a59c700 1 -- 172.21.15.172:0/2987557082 learned_addr learned my addr 172.21.15.172:0/2987557082 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:36.709 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752ad9d700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752a59c700 1 -- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 msgr2=0x7f752c0b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752a59c700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752a59c700 1 -- 172.21.15.172:0/2987557082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 msgr2=0x7f752c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752a59c700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752a59c700 1 -- 172.21.15.172:0/2987557082 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009550 con 0x7f752c0cfc60 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f752a59c700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 0x7f752c14c2c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f751c00e870 tx=0x7f751c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:36.710 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c009590 con 0x7f752c0cfc60 2023-03-27T10:09:36.711 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c013680 con 0x7f752c0cfc60 2023-03-27T10:09:36.711 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0139f0 con 0x7f752c0cfc60 2023-03-27T10:09:36.711 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.707+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c0d0730 con 0x7f752c0cfc60 2023-03-27T10:09:36.711 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.708+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c0cd8b0 con 0x7f752c0cfc60 2023-03-27T10:09:36.711 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.708+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0d3210 con 0x7f752c0cfc60 2023-03-27T10:09:36.712 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.709+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 4) v1 ==== 85073+0+0 (secure 0 0 0) 0x7f751c019030 con 0x7f752c0cfc60 2023-03-27T10:09:36.712 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.710+0000 7f751affd700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f750c066de0 0x7f750c069290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:36.712 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.710+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f751c0830a0 con 0x7f752c0cfc60 2023-03-27T10:09:36.712 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.711+0000 7f7529d9b700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f750c066de0 0x7f750c069290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:36.712 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.711+0000 7f7529d9b700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f750c066de0 0x7f750c069290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7520009c40 tx=0x7f7520008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:36.715 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.715+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f751c0511c0 con 0x7f752c0cfc60 2023-03-27T10:09:36.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.913+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f752c0cc720 con 0x7f752c0cfc60 2023-03-27T10:09:36.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.914+0000 7f751affd700 1 -- 172.21.15.172:0/2987557082 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f751c0547e0 con 0x7f752c0cfc60 2023-03-27T10:09:36.914 INFO:teuthology.misc.health.smithi172.stdout: 2023-03-27T10:09:36.914 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":12,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:34.277991+0000","last_up_change":"0.000000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:36.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f750c066de0 msgr2=0x7f750c069290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:36.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f750c066de0 0x7f750c069290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7520009c40 tx=0x7f7520008030 comp rx=0 tx=0).stop 2023-03-27T10:09:36.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 msgr2=0x7f752c14c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:36.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 0x7f752c14c2c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f751c00e870 tx=0x7f751c00eb80 comp rx=0 tx=0).stop 2023-03-27T10:09:36.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 shutdown_connections 2023-03-27T10:09:36.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f752c15c700 0x7f752c0b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f750c066de0 0x7f750c069290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752c0cfc60 0x7f752c14c2c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 --2- 172.21.15.172:0/2987557082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752c0d2da0 0x7f752c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:36.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 >> 172.21.15.172:0/2987557082 conn(0x7f752c0721f0 msgr2=0x7f752c0b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:36.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 shutdown_connections 2023-03-27T10:09:36.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:36.916+0000 7f75309ff700 1 -- 172.21.15.172:0/2987557082 wait complete. 2023-03-27T10:09:36.930 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-27T10:09:37.210 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T10:09:37.210+0000 7feedfbf6700 -1 osd.5 0 waiting for initial osdmap 2023-03-27T10:09:37.222 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T10:09:37.223+0000 7feed7bfb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:37.805 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T10:09:37.806+0000 7f539c1f6700 -1 osd.2 0 waiting for initial osdmap 2023-03-27T10:09:37.827 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T10:09:37.828+0000 7f53941fb700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-27T10:09:43.737 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:43.902 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.903+0000 7f636f5ff700 1 Processor -- start 2023-03-27T10:09:43.903 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.903+0000 7f636f5ff700 1 -- start start 2023-03-27T10:09:43.903 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636f5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f636815c700 0x7f63680d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636f5ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f63680d2da0 0x7f63680cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636f5ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63680cdc20 con 0x7f63680cfc60 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636f5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680cd610 con 0x7f636815c700 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636f5ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636815cad0 con 0x7f63680d2da0 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636d39b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f636815c700 0x7f63680d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636d39b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f636815c700 0x7f63680d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35260/0 (socket says 172.21.15.172:35260) 2023-03-27T10:09:43.904 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.904+0000 7f636d39b700 1 -- 172.21.15.172:0/192799207 learned_addr learned my addr 172.21.15.172:0/192799207 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:43.906 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636cb9a700 1 --2- 172.21.15.172:0/192799207 >> v2:172.21.15.191:3300/0 conn(0x7f63680d2da0 0x7f63680cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:43.906 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636d39b700 1 -- 172.21.15.172:0/192799207 >> v2:172.21.15.191:3300/0 conn(0x7f63680d2da0 msgr2=0x7f63680cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:43.906 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636d39b700 1 --2- 172.21.15.172:0/192799207 >> v2:172.21.15.191:3300/0 conn(0x7f63680d2da0 0x7f63680cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:43.906 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636d39b700 1 -- 172.21.15.172:0/192799207 >> v1:172.21.15.191:6789/0 conn(0x7f63680cfc60 legacy=0x7f63680ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:43.906 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636d39b700 1 -- 172.21.15.172:0/192799207 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63680d0450 con 0x7f636815c700 2023-03-27T10:09:43.907 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636cb9a700 1 --2- 172.21.15.172:0/192799207 >> v2:172.21.15.191:3300/0 conn(0x7f63680d2da0 0x7f63680cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:43.907 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f636d39b700 1 --2- 172.21.15.172:0/192799207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636815c700 0x7f63680d2860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f636808c3d0 tx=0x7f6364009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349d4218ae489f7f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:43.907 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f635ffff700 1 -- 172.21.15.172:0/192799207 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364004230 con 0x7f636815c700 2023-03-27T10:09:43.907 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f635ffff700 1 -- 172.21.15.172:0/192799207 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364004390 con 0x7f636815c700 2023-03-27T10:09:43.907 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.905+0000 7f635ffff700 1 -- 172.21.15.172:0/192799207 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640036a0 con 0x7f636815c700 2023-03-27T10:09:43.907 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 -- 172.21.15.172:0/192799207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636815c700 msgr2=0x7f63680d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:43.908 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 --2- 172.21.15.172:0/192799207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636815c700 0x7f63680d2860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f636808c3d0 tx=0x7f6364009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:43.908 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 -- 172.21.15.172:0/192799207 shutdown_connections 2023-03-27T10:09:43.908 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 --2- 172.21.15.172:0/192799207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636815c700 0x7f63680d2860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:43.908 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 --2- 172.21.15.172:0/192799207 >> v2:172.21.15.191:3300/0 conn(0x7f63680d2da0 0x7f63680cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:43.908 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 -- 172.21.15.172:0/192799207 >> 172.21.15.172:0/192799207 conn(0x7f63680721f0 msgr2=0x7f636809c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:43.908 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 -- 172.21.15.172:0/192799207 shutdown_connections 2023-03-27T10:09:43.909 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.906+0000 7f636f5ff700 1 -- 172.21.15.172:0/192799207 wait complete. 2023-03-27T10:09:43.911 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.907+0000 7f636f5ff700 1 Processor -- start 2023-03-27T10:09:43.911 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.908+0000 7f636f5ff700 1 -- start start 2023-03-27T10:09:43.911 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.908+0000 7f636f5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 0x7f63680b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:43.911 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.908+0000 7f636f5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63680d2da0 0x7f6368158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:43.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636f5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f636815c700 0x7f636809ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:43.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636f5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680b6760 con 0x7f63680cfc60 2023-03-27T10:09:43.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636f5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680b6a40 con 0x7f636815c700 2023-03-27T10:09:43.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636f5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63680b6d20 con 0x7f63680d2da0 2023-03-27T10:09:43.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 0x7f63680b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:43.912 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 0x7f63680b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35270/0 (socket says 172.21.15.172:35270) 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 -- 172.21.15.172:0/265716764 learned_addr learned my addr 172.21.15.172:0/265716764 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636cb9a700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63680d2da0 0x7f6368158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636db9c700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f636815c700 0x7f636809ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 -- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63680d2da0 msgr2=0x7f6368158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63680d2da0 0x7f6368158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 -- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f636815c700 msgr2=0x7f636809ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:43.913 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f636815c700 0x7f636809ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.909+0000 7f636d39b700 1 -- 172.21.15.172:0/265716764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6364009550 con 0x7f63680cfc60 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.910+0000 7f636d39b700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 0x7f63680b8760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6364009130 tx=0x7f6364004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.910+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364003ea0 con 0x7f63680cfc60 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.910+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364011630 con 0x7f63680cfc60 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.910+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63680d3240 con 0x7f63680cfc60 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.910+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640119e0 con 0x7f63680cfc60 2023-03-27T10:09:43.914 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.910+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63680cd8b0 con 0x7f63680cfc60 2023-03-27T10:09:43.915 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.911+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63680d0730 con 0x7f63680cfc60 2023-03-27T10:09:43.915 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.912+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f6364017020 con 0x7f63680cfc60 2023-03-27T10:09:43.915 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.912+0000 7f635dffb700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f634c066e30 0x7f634c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:43.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.913+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6364085220 con 0x7f63680cfc60 2023-03-27T10:09:43.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.913+0000 7f636cb9a700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f634c066e30 0x7f634c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:43.916 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.913+0000 7f636cb9a700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f634c066e30 0x7f634c0692e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63680b8fd0 tx=0x7f6358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:43.917 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:43.918+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f6364052910 con 0x7f63680cfc60 2023-03-27T10:09:44.108 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.108+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63680d00a0 con 0x7f63680cfc60 2023-03-27T10:09:44.109 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.109+0000 7f635dffb700 1 -- 172.21.15.172:0/265716764 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12526 (secure 0 0 0) 0x7f6364055f30 con 0x7f63680cfc60 2023-03-27T10:09:44.109 INFO:teuthology.misc.health.smithi172.stdout: 2023-03-27T10:09:44.109 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":17,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:41.339529+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:44.111 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f634c066e30 msgr2=0x7f634c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.111 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f634c066e30 0x7f634c0692e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63680b8fd0 tx=0x7f6358008040 comp rx=0 tx=0).stop 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 msgr2=0x7f63680b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 0x7f63680b8760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6364009130 tx=0x7f6364004750 comp rx=0 tx=0).stop 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 shutdown_connections 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f634c066e30 0x7f634c0692e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f636815c700 0x7f636809ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63680cfc60 0x7f63680b8760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.112 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 --2- 172.21.15.172:0/265716764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63680d2da0 0x7f6368158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.113 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 >> 172.21.15.172:0/265716764 conn(0x7f63680721f0 msgr2=0x7f63680b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:44.113 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 shutdown_connections 2023-03-27T10:09:44.113 INFO:teuthology.misc.health.smithi172.stderr:2023-03-27T10:09:44.112+0000 7f636f5ff700 1 -- 172.21.15.172:0/265716764 wait complete. 2023-03-27T10:09:44.126 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-03-27T10:09:44.127 INFO:tasks.ceph:Creating RBD pool 2023-03-27T10:09:44.127 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-27T10:09:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.306+0000 7fbbebdff700 1 Processor -- start 2023-03-27T10:09:44.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.306+0000 7fbbebdff700 1 -- start start 2023-03-27T10:09:44.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.307+0000 7fbbebdff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40d02c0 0x7fbbe40ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:44.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.307+0000 7fbbebdff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40d0880 con 0x7fbbe40b1700 2023-03-27T10:09:44.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.307+0000 7fbbebdff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40cd680 con 0x7fbbe40d1200 2023-03-27T10:09:44.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.307+0000 7fbbebdff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40cd960 con 0x7fbbe40d02c0 2023-03-27T10:09:44.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbe9b9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbbe40b1700 0x7fbbe40d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57476/0 (socket says 172.21.15.172:57476) 2023-03-27T10:09:44.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbe9b9b700 1 -- 172.21.15.172:0/2256782739 learned_addr learned my addr 172.21.15.172:0/2256782739 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:44.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbea39c700 1 --2- 172.21.15.172:0/2256782739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40d02c0 0x7fbbe40ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:44.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016084131 0 0) 0x7fbbe40d0880 con 0x7fbbe40b1700 2023-03-27T10:09:44.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd00035b0 con 0x7fbbe40b1700 2023-03-27T10:09:44.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807464242 0 0) 0x7fbbe40cd680 con 0x7fbbe40d1200 2023-03-27T10:09:44.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe40d0880 con 0x7fbbe40d1200 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbea39c700 1 -- 172.21.15.172:0/2256782739 >> v1:172.21.15.191:6789/0 conn(0x7fbbe40d1200 legacy=0x7fbbe40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbea39c700 1 -- 172.21.15.172:0/2256782739 >> v1:172.21.15.172:6789/0 conn(0x7fbbe40b1700 legacy=0x7fbbe40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.308+0000 7fbbea39c700 1 -- 172.21.15.172:0/2256782739 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40cdc40 con 0x7fbbe40d02c0 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbea39c700 1 --2- 172.21.15.172:0/2256782739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40d02c0 0x7fbbe40ceb50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009dc0 tx=0x7fbbdc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d456915c2d6b82e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00e070 con 0x7fbbe40d02c0 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00bb20 con 0x7fbbe40d02c0 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbe8b99700 1 -- 172.21.15.172:0/2256782739 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc012430 con 0x7fbbe40d02c0 2023-03-27T10:09:44.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 -- 172.21.15.172:0/2256782739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40d02c0 msgr2=0x7fbbe40ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2256782739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40d02c0 0x7fbbe40ceb50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009dc0 tx=0x7fbbdc00b330 comp rx=0 tx=0).stop 2023-03-27T10:09:44.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 -- 172.21.15.172:0/2256782739 shutdown_connections 2023-03-27T10:09:44.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2256782739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40d02c0 0x7fbbe40ceb50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 -- 172.21.15.172:0/2256782739 >> 172.21.15.172:0/2256782739 conn(0x7fbbe409c260 msgr2=0x7fbbe40d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:44.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 -- 172.21.15.172:0/2256782739 shutdown_connections 2023-03-27T10:09:44.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.309+0000 7fbbebdff700 1 -- 172.21.15.172:0/2256782739 wait complete. 2023-03-27T10:09:44.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.311+0000 7fbbebdff700 1 Processor -- start 2023-03-27T10:09:44.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.311+0000 7fbbebdff700 1 -- start start 2023-03-27T10:09:44.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbebdff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40b1700 0x7fbbe415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:44.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbebdff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 0x7fbbe40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:44.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbebdff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbe40d1200 0x7fbbe40b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbebdff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40ca990 con 0x7fbbe40d02c0 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbebdff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe415b890 con 0x7fbbe40d1200 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbebdff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40b83b0 con 0x7fbbe40b1700 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbe939a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 0x7fbbe40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbe939a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 0x7fbbe40b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35282/0 (socket says 172.21.15.172:35282) 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.312+0000 7fbbe939a700 1 -- 172.21.15.172:0/2823137926 learned_addr learned my addr 172.21.15.172:0/2823137926 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe9b9b700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40b1700 0x7fbbe415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:44.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbea39c700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbe40d1200 0x7fbbe40b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe939a700 1 -- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40b1700 msgr2=0x7fbbe415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe939a700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40b1700 0x7fbbe415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe939a700 1 -- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbe40d1200 msgr2=0x7fbbe40b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe939a700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbe40d1200 0x7fbbe40b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe939a700 1 -- 172.21.15.172:0/2823137926 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009a70 con 0x7fbbe40d02c0 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbe939a700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 0x7fbbe40b7860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c500 tx=0x7fbbd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40052d0 con 0x7fbbe40d02c0 2023-03-27T10:09:44.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4005430 con 0x7fbbe40d02c0 2023-03-27T10:09:44.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40afb50 con 0x7fbbe40d02c0 2023-03-27T10:09:44.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40038c0 con 0x7fbbe40d02c0 2023-03-27T10:09:44.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.313+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40cdf20 con 0x7fbbe40d02c0 2023-03-27T10:09:44.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.314+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe40d2c50 con 0x7fbbe40d02c0 2023-03-27T10:09:44.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.315+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fbbd4019030 con 0x7fbbe40d02c0 2023-03-27T10:09:44.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.316+0000 7fbbda7fc700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbbc8066e30 0x7fbbc80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:44.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.316+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbd4083200 con 0x7fbbe40d02c0 2023-03-27T10:09:44.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.316+0000 7fbbe9b9b700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbbc8066e30 0x7fbbc80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:44.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.317+0000 7fbbe9b9b700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbbc8066e30 0x7fbbc80692e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00010e0 tx=0x7fbbe0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:44.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.320+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fbbd40509b0 con 0x7fbbe40d02c0 2023-03-27T10:09:44.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:44.509+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbbe4074300 con 0x7fbbe40d02c0 2023-03-27T10:09:44.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:09:44.677 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:09:45.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.091+0000 7fbbda7fc700 1 -- 172.21.15.172:0/2823137926 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbbd4053fd0 con 0x7fbbe40d02c0 2023-03-27T10:09:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbbc8066e30 msgr2=0x7fbbc80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbbc8066e30 0x7fbbc80692e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00010e0 tx=0x7fbbe0009040 comp rx=0 tx=0).stop 2023-03-27T10:09:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 msgr2=0x7fbbe40b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 0x7fbbe40b7860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c500 tx=0x7fbbd400c8c0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 shutdown_connections 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbbc8066e30 0x7fbbc80692e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbe40d1200 0x7fbbe40b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbbe40b1700 0x7fbbe415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 --2- 172.21.15.172:0/2823137926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe40d02c0 0x7fbbe40b7860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.094+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 >> 172.21.15.172:0/2823137926 conn(0x7fbbe409c260 msgr2=0x7fbbe40b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.095+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 shutdown_connections 2023-03-27T10:09:45.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.095+0000 7fbbebdff700 1 -- 172.21.15.172:0/2823137926 wait complete. 2023-03-27T10:09:45.096 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'rbd' created 2023-03-27T10:09:45.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-27T10:09:45.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.295+0000 7fc90c5ff700 1 Processor -- start 2023-03-27T10:09:45.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.295+0000 7fc90c5ff700 1 -- start start 2023-03-27T10:09:45.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90c5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc90415c9c0 0x7fc9040cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:45.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90c5ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc9040cd590 0x7fc9040b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:45.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90c5ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9040ce9f0 con 0x7fc9040b2dc0 2023-03-27T10:09:45.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90c5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9040d3920 con 0x7fc90415c9c0 2023-03-27T10:09:45.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90c5ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90415cd90 con 0x7fc9040cd590 2023-03-27T10:09:45.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc90415c9c0 0x7fc9040cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:45.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc90415c9c0 0x7fc9040cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35296/0 (socket says 172.21.15.172:35296) 2023-03-27T10:09:45.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 -- 172.21.15.172:0/3733083538 learned_addr learned my addr 172.21.15.172:0/3733083538 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:45.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc909b9a700 1 --2- 172.21.15.172:0/3733083538 >> v2:172.21.15.191:3300/0 conn(0x7fc9040cd590 0x7fc9040b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:45.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 -- 172.21.15.172:0/3733083538 >> v2:172.21.15.191:3300/0 conn(0x7fc9040cd590 msgr2=0x7fc9040b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 --2- 172.21.15.172:0/3733083538 >> v2:172.21.15.191:3300/0 conn(0x7fc9040cd590 0x7fc9040b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 -- 172.21.15.172:0/3733083538 >> v1:172.21.15.191:6789/0 conn(0x7fc9040b2dc0 legacy=0x7fc9040cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc90a39b700 1 -- 172.21.15.172:0/3733083538 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040cf3c0 con 0x7fc90415c9c0 2023-03-27T10:09:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.297+0000 7fc909b9a700 1 --2- 172.21.15.172:0/3733083538 >> v2:172.21.15.191:3300/0 conn(0x7fc9040cd590 0x7fc9040b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90a39b700 1 --2- 172.21.15.172:0/3733083538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9040cee80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc90408b1f0 tx=0x7fc900009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf66c7306ba6370a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc909399700 1 -- 172.21.15.172:0/3733083538 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900005e30 con 0x7fc90415c9c0 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc909399700 1 -- 172.21.15.172:0/3733083538 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc900004030 con 0x7fc90415c9c0 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc909399700 1 -- 172.21.15.172:0/3733083538 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000043e0 con 0x7fc90415c9c0 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90c5ff700 1 -- 172.21.15.172:0/3733083538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 msgr2=0x7fc9040cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/3733083538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9040cee80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc90408b1f0 tx=0x7fc900009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90c5ff700 1 -- 172.21.15.172:0/3733083538 shutdown_connections 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/3733083538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9040cee80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/3733083538 >> v2:172.21.15.191:3300/0 conn(0x7fc9040cd590 0x7fc9040b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.298+0000 7fc90c5ff700 1 -- 172.21.15.172:0/3733083538 >> 172.21.15.172:0/3733083538 conn(0x7fc9040721f0 msgr2=0x7fc90409c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:45.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.299+0000 7fc90c5ff700 1 -- 172.21.15.172:0/3733083538 shutdown_connections 2023-03-27T10:09:45.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.299+0000 7fc90c5ff700 1 -- 172.21.15.172:0/3733083538 wait complete. 2023-03-27T10:09:45.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.301+0000 7fc90c5ff700 1 Processor -- start 2023-03-27T10:09:45.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.301+0000 7fc90c5ff700 1 -- start start 2023-03-27T10:09:45.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.302+0000 7fc90c5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9040b2dc0 0x7fc904152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:45.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.302+0000 7fc90c5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9040cd590 0x7fc9040cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.302+0000 7fc90c5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9041e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.302+0000 7fc90c5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9041e1da0 con 0x7fc90415c9c0 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.302+0000 7fc90c5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040cce30 con 0x7fc9040b2dc0 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.302+0000 7fc90c5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040ca4f0 con 0x7fc9040cd590 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9041e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9041e63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35302/0 (socket says 172.21.15.172:35302) 2023-03-27T10:09:45.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 -- 172.21.15.172:0/477229528 learned_addr learned my addr 172.21.15.172:0/477229528 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:45.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90a39b700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9040b2dc0 0x7fc904152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:45.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc909b9a700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9040cd590 0x7fc9040cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:45.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 -- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9040cd590 msgr2=0x7fc9040cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:45.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9040cd590 0x7fc9040cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 -- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9040b2dc0 msgr2=0x7fc904152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9040b2dc0 0x7fc904152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 -- 172.21.15.172:0/477229528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009500 con 0x7fc90415c9c0 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc90ab9c700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9041e63d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00cc50 tx=0x7fc8fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.303+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc00ad80 con 0x7fc90415c9c0 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.304+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc00ce50 con 0x7fc90415c9c0 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.304+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc003c40 con 0x7fc90415c9c0 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.304+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9040ce0c0 con 0x7fc90415c9c0 2023-03-27T10:09:45.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.304+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9040cdde0 con 0x7fc90415c9c0 2023-03-27T10:09:45.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.305+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9040ce3a0 con 0x7fc90415c9c0 2023-03-27T10:09:45.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.306+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc8fc010050 con 0x7fc90415c9c0 2023-03-27T10:09:45.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.306+0000 7fc8faffd700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc8e8066e30 0x7fc8e80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:45.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.307+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fc8fc083f30 con 0x7fc90415c9c0 2023-03-27T10:09:45.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.307+0000 7fc90a39b700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc8e8066e30 0x7fc8e80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:45.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.308+0000 7fc90a39b700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc8e8066e30 0x7fc8e80692e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc90408b1f0 tx=0x7fc900008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:45.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.311+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc8fc0514d0 con 0x7fc90415c9c0 2023-03-27T10:09:45.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:45.500+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc904074290 con 0x7fc90415c9c0 2023-03-27T10:09:46.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.099+0000 7fc8faffd700 1 -- 172.21.15.172:0/477229528 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc8fc054af0 con 0x7fc90415c9c0 2023-03-27T10:09:46.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc8e8066e30 msgr2=0x7fc8e80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc8e8066e30 0x7fc8e80692e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc90408b1f0 tx=0x7fc900008070 comp rx=0 tx=0).stop 2023-03-27T10:09:46.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 msgr2=0x7fc9041e63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9041e63d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00cc50 tx=0x7fc8fc00a340 comp rx=0 tx=0).stop 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 shutdown_connections 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc90415c9c0 0x7fc9041e63d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc8e8066e30 0x7fc8e80692e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9040b2dc0 0x7fc904152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 --2- 172.21.15.172:0/477229528 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9040cd590 0x7fc9040cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.102+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 >> 172.21.15.172:0/477229528 conn(0x7fc9040721f0 msgr2=0x7fc90406b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:46.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.103+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 shutdown_connections 2023-03-27T10:09:46.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.103+0000 7fc90c5ff700 1 -- 172.21.15.172:0/477229528 wait complete. 2023-03-27T10:09:46.107 INFO:teuthology.orchestra.run.smithi172.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-27T10:09:46.122 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-27T10:09:46.123 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-27T10:09:46.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-27T10:09:46.127 INFO:tasks.ceph.mds.a:Started 2023-03-27T10:09:46.127 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-27T10:09:46.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-27T10:09:46.131 INFO:tasks.ceph.mds.c:Started 2023-03-27T10:09:46.131 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-27T10:09:46.132 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-27T10:09:46.136 INFO:tasks.ceph.mds.b:Started 2023-03-27T10:09:46.137 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-27T10:09:46.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-27T10:09:46.140 INFO:tasks.ceph.mds.d:Started 2023-03-27T10:09:46.141 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-27T10:09:46.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:46.265 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2023-03-27T10:09:46.266 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2023-03-27T10:09:46.281 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-27T10:09:46.283 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-27T10:09:46.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.340+0000 7fdf7edff700 1 Processor -- start 2023-03-27T10:09:46.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.340+0000 7fdf7edff700 1 -- start start 2023-03-27T10:09:46.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7edff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdf7815a9c0 0x7fdf780afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7edff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf780cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7edff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf78071df0 con 0x7fdf7815a5f0 2023-03-27T10:09:46.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7edff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf780caa00 con 0x7fdf7815a9c0 2023-03-27T10:09:46.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7edff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf780cace0 con 0x7fdf780b0370 2023-03-27T10:09:46.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7d39c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf780cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7d39c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf780cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:47900/0 (socket says 172.21.15.172:47900) 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf7d39c700 1 -- 172.21.15.172:0/4147534348 learned_addr learned my addr 172.21.15.172:0/4147534348 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.341+0000 7fdf77fff700 1 --2- 172.21.15.172:0/4147534348 >> v2:172.21.15.191:3300/0 conn(0x7fdf7815a9c0 0x7fdf780afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf7d39c700 1 -- 172.21.15.172:0/4147534348 >> v2:172.21.15.191:3300/0 conn(0x7fdf7815a9c0 msgr2=0x7fdf780afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf7d39c700 1 --2- 172.21.15.172:0/4147534348 >> v2:172.21.15.191:3300/0 conn(0x7fdf7815a9c0 0x7fdf780afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf7d39c700 1 -- 172.21.15.172:0/4147534348 >> v1:172.21.15.191:6789/0 conn(0x7fdf7815a5f0 legacy=0x7fdf7815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf7d39c700 1 -- 172.21.15.172:0/4147534348 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780cafc0 con 0x7fdf780b0370 2023-03-27T10:09:46.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf7d39c700 1 --2- 172.21.15.172:0/4147534348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf780cb610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009e50 tx=0x7fdf7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8329e362d979740e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf777fe700 1 -- 172.21.15.172:0/4147534348 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000e070 con 0x7fdf780b0370 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf777fe700 1 -- 172.21.15.172:0/4147534348 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7000b910 con 0x7fdf780b0370 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.342+0000 7fdf777fe700 1 -- 172.21.15.172:0/4147534348 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000bcc0 con 0x7fdf780b0370 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 -- 172.21.15.172:0/4147534348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 msgr2=0x7fdf780cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 --2- 172.21.15.172:0/4147534348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf780cb610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdf70009e50 tx=0x7fdf7000b330 comp rx=0 tx=0).stop 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 -- 172.21.15.172:0/4147534348 shutdown_connections 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 --2- 172.21.15.172:0/4147534348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf780cb610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 --2- 172.21.15.172:0/4147534348 >> v2:172.21.15.191:3300/0 conn(0x7fdf7815a9c0 0x7fdf780afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 -- 172.21.15.172:0/4147534348 >> 172.21.15.172:0/4147534348 conn(0x7fdf7806a1a0 msgr2=0x7fdf7806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:46.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 -- 172.21.15.172:0/4147534348 shutdown_connections 2023-03-27T10:09:46.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.343+0000 7fdf7edff700 1 -- 172.21.15.172:0/4147534348 wait complete. 2023-03-27T10:09:46.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.345+0000 7fdf7edff700 1 Processor -- start 2023-03-27T10:09:46.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.345+0000 7fdf7edff700 1 -- start start 2023-03-27T10:09:46.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7edff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf7806c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7edff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf7815a5f0 0x7fdf78159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7edff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 0x7fdf78159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7edff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7806c2e0 con 0x7fdf7815a9c0 2023-03-27T10:09:46.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7edff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7806cc40 con 0x7fdf7815a5f0 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7edff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7806dac0 con 0x7fdf780b0370 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 0x7fdf78159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 0x7fdf78159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54870/0 (socket says 172.21.15.172:54870) 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 -- 172.21.15.172:0/2246847317 learned_addr learned my addr 172.21.15.172:0/2246847317 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7cb9b700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf7806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf77fff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf7815a5f0 0x7fdf78159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 -- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 msgr2=0x7fdf7806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf7806c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 -- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf7815a5f0 msgr2=0x7fdf78159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf7815a5f0 0x7fdf78159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.346+0000 7fdf7d39c700 1 -- 172.21.15.172:0/2246847317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70009b30 con 0x7fdf7815a9c0 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.347+0000 7fdf7d39c700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 0x7fdf78159660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b680 tx=0x7fdf70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.347+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700099b0 con 0x7fdf7815a9c0 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.347+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf780ca6b0 con 0x7fdf7815a9c0 2023-03-27T10:09:46.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.347+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf700092e0 con 0x7fdf7815a9c0 2023-03-27T10:09:46.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.347+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7001c640 con 0x7fdf7815a9c0 2023-03-27T10:09:46.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.347+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf780cb2a0 con 0x7fdf7815a9c0 2023-03-27T10:09:46.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.348+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf780cbb50 con 0x7fdf7815a9c0 2023-03-27T10:09:46.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.349+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fdf7002c070 con 0x7fdf7815a9c0 2023-03-27T10:09:46.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.351+0000 7fdf757fa700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdf5c066e30 0x7fdf5c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.351+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdf70085b90 con 0x7fdf7815a9c0 2023-03-27T10:09:46.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.351+0000 7fdf7cb9b700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdf5c066e30 0x7fdf5c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.352+0000 7fdf7cb9b700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdf5c066e30 0x7fdf5c0692e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf780c5a30 tx=0x7fdf6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:46.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.355+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fdf700530a0 con 0x7fdf7815a9c0 2023-03-27T10:09:46.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.543+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf7806c420 con 0x7fdf7815a9c0 2023-03-27T10:09:46.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.544+0000 7fdf757fa700 1 -- 172.21.15.172:0/2246847317 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14325 (secure 0 0 0) 0x7fdf7806c420 con 0x7fdf7815a9c0 2023-03-27T10:09:46.544 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:46.544 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":19,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:46.092021+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:46.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.546+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdf5c066e30 msgr2=0x7fdf5c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.546+0000 7fdf7edff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdf5c066e30 0x7fdf5c0692e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdf780c5a30 tx=0x7fdf6c009040 comp rx=0 tx=0).stop 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.546+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 msgr2=0x7fdf78159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.546+0000 7fdf7edff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 0x7fdf78159660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b680 tx=0x7fdf70004ad0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 shutdown_connections 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7815a9c0 0x7fdf78159660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdf780b0370 0x7fdf7806c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdf5c066e30 0x7fdf5c0692e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 --2- 172.21.15.172:0/2246847317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdf7815a5f0 0x7fdf78159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 >> 172.21.15.172:0/2246847317 conn(0x7fdf7806a1a0 msgr2=0x7fdf780c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:46.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 shutdown_connections 2023-03-27T10:09:46.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.547+0000 7fdf7edff700 1 -- 172.21.15.172:0/2246847317 wait complete. 2023-03-27T10:09:46.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:09:46.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:09:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.754+0000 7f8df53ff700 1 Processor -- start 2023-03-27T10:09:46.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.754+0000 7f8df53ff700 1 -- start start 2023-03-27T10:09:46.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8df53ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8df015a240 0x7f8df00d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8df53ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df00d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8df53ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df00d29d0 con 0x7f8df01604b0 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8df53ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df0161020 con 0x7f8df015a240 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8df53ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0161200 con 0x7f8df00d3a30 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8deeffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8df015a240 0x7f8df00d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8def7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8df01604b0 0x7f8df0160910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55978/0 (socket says 172.21.15.172:55978) 2023-03-27T10:09:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8deeffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8df015a240 0x7f8df00d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54874/0 (socket says 172.21.15.172:54874) 2023-03-27T10:09:46.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8def7fe700 1 -- 172.21.15.172:0/4222875601 learned_addr learned my addr 172.21.15.172:0/4222875601 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:46.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.755+0000 7f8de7fff700 1 --2- 172.21.15.172:0/4222875601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df00d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8deeffd700 1 -- 172.21.15.172:0/4222875601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 msgr2=0x7f8df00d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:46.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8deeffd700 1 --2- 172.21.15.172:0/4222875601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df00d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8deeffd700 1 -- 172.21.15.172:0/4222875601 >> v1:172.21.15.172:6789/0 conn(0x7f8df01604b0 legacy=0x7f8df0160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8deeffd700 1 -- 172.21.15.172:0/4222875601 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df015a610 con 0x7f8df015a240 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8dee7fc700 1 -- 172.21.15.172:0/4222875601 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571147244 0 0) 0x7f8df00d29d0 con 0x7f8df01604b0 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8deeffd700 1 --2- 172.21.15.172:0/4222875601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df015a240 0x7f8df00d0ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009840 tx=0x7f8de0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2613b2251618a3b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8dee7fc700 1 -- 172.21.15.172:0/4222875601 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0011830 con 0x7f8df015a240 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8dee7fc700 1 -- 172.21.15.172:0/4222875601 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0011990 con 0x7f8df015a240 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.756+0000 7f8dee7fc700 1 -- 172.21.15.172:0/4222875601 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0011d20 con 0x7f8df015a240 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 -- 172.21.15.172:0/4222875601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df015a240 msgr2=0x7f8df00d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 --2- 172.21.15.172:0/4222875601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df015a240 0x7f8df00d0ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009840 tx=0x7f8de0009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:46.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 -- 172.21.15.172:0/4222875601 shutdown_connections 2023-03-27T10:09:46.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 --2- 172.21.15.172:0/4222875601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df015a240 0x7f8df00d0ac0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 --2- 172.21.15.172:0/4222875601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df00d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 -- 172.21.15.172:0/4222875601 >> 172.21.15.172:0/4222875601 conn(0x7f8df00721f0 msgr2=0x7f8df009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:46.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 -- 172.21.15.172:0/4222875601 shutdown_connections 2023-03-27T10:09:46.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.757+0000 7f8df53ff700 1 -- 172.21.15.172:0/4222875601 wait complete. 2023-03-27T10:09:46.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.759+0000 7f8df53ff700 1 Processor -- start 2023-03-27T10:09:46.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.759+0000 7f8df53ff700 1 -- start start 2023-03-27T10:09:46.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8df53ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df0156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8df53ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8df015a240 0x7f8df00b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8df53ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df01604b0 0x7f8df00b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8df53ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0157430 con 0x7f8df01604b0 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8df53ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0156ec0 con 0x7f8df015a240 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8df53ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df015b660 con 0x7f8df00d3a30 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df01604b0 0x7f8df00b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df0156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df0156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:47924/0 (socket says 172.21.15.172:47924) 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 -- 172.21.15.172:0/2181597960 learned_addr learned my addr 172.21.15.172:0/2181597960 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df01604b0 0x7f8df00b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54882/0 (socket says 172.21.15.172:54882) 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8de7fff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8df015a240 0x7f8df00b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 -- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8df015a240 msgr2=0x7f8df00b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8df015a240 0x7f8df00b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 -- 172.21.15.172:0/2181597960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df01604b0 msgr2=0x7f8df00b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df01604b0 0x7f8df00b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.760+0000 7f8deeffd700 1 -- 172.21.15.172:0/2181597960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00094a0 con 0x7f8df00d3a30 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.761+0000 7f8deeffd700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df0156980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8de00090b0 tx=0x7f8de0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.761+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0004550 con 0x7f8df00d3a30 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.761+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de001f070 con 0x7f8df00d3a30 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.761+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df00d2f50 con 0x7f8df00d3a30 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.761+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00038e0 con 0x7f8df00d3a30 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.761+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df00d2c70 con 0x7f8df00d3a30 2023-03-27T10:09:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.762+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df00d3230 con 0x7f8df00d3a30 2023-03-27T10:09:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.763+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f8de000f050 con 0x7f8df00d3a30 2023-03-27T10:09:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.764+0000 7f8de77fe700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8dd0066e30 0x7f8dd00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.764+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8de0021070 con 0x7f8df00d3a30 2023-03-27T10:09:46.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.764+0000 7f8de7fff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8dd0066e30 0x7f8dd00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:46.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.764+0000 7f8de7fff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8dd0066e30 0x7f8dd00692e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8df00b1010 tx=0x7f8dd8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.769+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f8de0052db0 con 0x7f8df00d3a30 2023-03-27T10:09:46.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.955+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8df0074300 con 0x7f8df00d3a30 2023-03-27T10:09:46.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.956+0000 7f8de77fe700 1 -- 172.21.15.172:0/2181597960 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8de00150a0 con 0x7f8df00d3a30 2023-03-27T10:09:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:09:46.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8dd0066e30 msgr2=0x7f8dd00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8dd0066e30 0x7f8dd00692e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8df00b1010 tx=0x7f8dd8009210 comp rx=0 tx=0).stop 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 msgr2=0x7f8df0156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df0156980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8de00090b0 tx=0x7f8de0004750 comp rx=0 tx=0).stop 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 shutdown_connections 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df01604b0 0x7f8df00b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8df00d3a30 0x7f8df0156980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8dd0066e30 0x7f8dd00692e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 --2- 172.21.15.172:0/2181597960 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8df015a240 0x7f8df00b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:46.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 >> 172.21.15.172:0/2181597960 conn(0x7f8df00721f0 msgr2=0x7f8df00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:46.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 shutdown_connections 2023-03-27T10:09:46.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:46.958+0000 7f8df53ff700 1 -- 172.21.15.172:0/2181597960 wait complete. 2023-03-27T10:09:46.976 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:09:47.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.166+0000 7fedb0dff700 1 Processor -- start 2023-03-27T10:09:47.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.166+0000 7fedb0dff700 1 -- start start 2023-03-27T10:09:47.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedb0dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedb0dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fedac0d02c0 0x7fedac0ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedb0dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0d0880 con 0x7fedac0b1700 2023-03-27T10:09:47.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedb0dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac0cd680 con 0x7fedac0d02c0 2023-03-27T10:09:47.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedb0dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0cd960 con 0x7fedac0d1200 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7feda9d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7feda9d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:47940/0 (socket says 172.21.15.172:47940) 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7feda9d9b700 1 -- 172.21.15.172:0/3522621091 learned_addr learned my addr 172.21.15.172:0/3522621091 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedaad9d700 1 --2- 172.21.15.172:0/3522621091 >> v2:172.21.15.191:3300/0 conn(0x7fedac0d02c0 0x7fedac0ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.167+0000 7fedaa59c700 1 --1- 172.21.15.172:0/3522621091 >> v1:172.21.15.191:6789/0 conn(0x7fedac0b1700 0x7fedac0d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:59904/0 (socket says 172.21.15.172:59904) 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda9d9b700 1 -- 172.21.15.172:0/3522621091 >> v2:172.21.15.191:3300/0 conn(0x7fedac0d02c0 msgr2=0x7fedac0ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda9d9b700 1 --2- 172.21.15.172:0/3522621091 >> v2:172.21.15.191:3300/0 conn(0x7fedac0d02c0 0x7fedac0ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda9d9b700 1 -- 172.21.15.172:0/3522621091 >> v1:172.21.15.191:6789/0 conn(0x7fedac0b1700 legacy=0x7fedac0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda9d9b700 1 -- 172.21.15.172:0/3522621091 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0cdc40 con 0x7fedac0d1200 2023-03-27T10:09:47.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda9d9b700 1 --2- 172.21.15.172:0/3522621091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0ce440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feda00098f0 tx=0x7feda0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4852440f009caa1e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:47.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda959a700 1 -- 172.21.15.172:0/3522621091 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0011830 con 0x7fedac0d1200 2023-03-27T10:09:47.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda959a700 1 -- 172.21.15.172:0/3522621091 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0011990 con 0x7fedac0d1200 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.168+0000 7feda959a700 1 -- 172.21.15.172:0/3522621091 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0011d20 con 0x7fedac0d1200 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 -- 172.21.15.172:0/3522621091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 msgr2=0x7fedac0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 --2- 172.21.15.172:0/3522621091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0ce440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feda00098f0 tx=0x7feda0009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 -- 172.21.15.172:0/3522621091 shutdown_connections 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 --2- 172.21.15.172:0/3522621091 >> v2:172.21.15.191:3300/0 conn(0x7fedac0d02c0 0x7fedac0ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 --2- 172.21.15.172:0/3522621091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0ce440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 -- 172.21.15.172:0/3522621091 >> 172.21.15.172:0/3522621091 conn(0x7fedac09c260 msgr2=0x7fedac0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:47.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 -- 172.21.15.172:0/3522621091 shutdown_connections 2023-03-27T10:09:47.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.169+0000 7fedb0dff700 1 -- 172.21.15.172:0/3522621091 wait complete. 2023-03-27T10:09:47.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.171+0000 7fedb0dff700 1 Processor -- start 2023-03-27T10:09:47.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.171+0000 7fedb0dff700 1 -- start start 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedb0dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedac0b1700 0x7fedac1f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedb0dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedac0d02c0 0x7fedac0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedb0dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedb0dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1f2280 con 0x7fedac0d02c0 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedb0dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0ccc90 con 0x7fedac0b1700 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedb0dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0b68f0 con 0x7fedac0d1200 2023-03-27T10:09:47.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7feda9d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedac0d02c0 0x7fedac0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaa59c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedac0b1700 0x7fedac1f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaad9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7feda9d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedac0d02c0 0x7fedac0cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54884/0 (socket says 172.21.15.172:54884) 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7feda9d9b700 1 -- 172.21.15.172:0/4085464222 learned_addr learned my addr 172.21.15.172:0/4085464222 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaad9d700 1 -- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedac0b1700 msgr2=0x7fedac1f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaad9d700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedac0b1700 0x7fedac1f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaad9d700 1 -- 172.21.15.172:0/4085464222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedac0d02c0 msgr2=0x7fedac0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaad9d700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedac0d02c0 0x7fedac0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.172+0000 7fedaad9d700 1 -- 172.21.15.172:0/4085464222 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0009550 con 0x7fedac0d1200 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.173+0000 7fedaad9d700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0cc750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feda400efc0 tx=0x7feda400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.173+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda400cc90 con 0x7fedac0d1200 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.173+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda400f040 con 0x7fedac0d1200 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.173+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40146c0 con 0x7fedac0d1200 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.173+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0afb50 con 0x7fedac0d1200 2023-03-27T10:09:47.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.173+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac0cdf20 con 0x7fedac0d1200 2023-03-27T10:09:47.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.174+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac0d2c50 con 0x7fedac0d1200 2023-03-27T10:09:47.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.175+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7feda4014820 con 0x7fedac0d1200 2023-03-27T10:09:47.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.176+0000 7fed9affd700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fed8c066e30 0x7fed8c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.176+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feda4084bc0 con 0x7fedac0d1200 2023-03-27T10:09:47.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.176+0000 7fedaa59c700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fed8c066e30 0x7fed8c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.177+0000 7fedaa59c700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fed8c066e30 0x7fed8c0692e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000fb0 tx=0x7fed9c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:47.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.180+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7feda4052150 con 0x7fedac0d1200 2023-03-27T10:09:47.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.369+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fedac074300 con 0x7fedac0d1200 2023-03-27T10:09:47.369 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.371+0000 7fed9affd700 1 -- 172.21.15.172:0/4085464222 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7feda4009e60 con 0x7fedac0d1200 2023-03-27T10:09:47.370 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:09:47.372 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fed8c066e30 msgr2=0x7fed8c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.373 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fed8c066e30 0x7fed8c0692e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000fb0 tx=0x7fed9c007ec0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.373 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 msgr2=0x7fedac0cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0cc750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feda400efc0 tx=0x7feda400c3a0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 shutdown_connections 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fedac0d1200 0x7fedac0cc750 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fed8c066e30 0x7fed8c0692e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fedac0b1700 0x7fedac1f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 --2- 172.21.15.172:0/4085464222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedac0d02c0 0x7fedac0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 >> 172.21.15.172:0/4085464222 conn(0x7fedac09c260 msgr2=0x7fedac0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 shutdown_connections 2023-03-27T10:09:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.372+0000 7fedb0dff700 1 -- 172.21.15.172:0/4085464222 wait complete. 2023-03-27T10:09:47.389 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:09:47.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.572+0000 7f1ad1bff700 1 Processor -- start 2023-03-27T10:09:47.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.572+0000 7f1ad1bff700 1 -- start start 2023-03-27T10:09:47.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.573+0000 7f1ad1bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1acc0cd760 0x7f1acc0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.573+0000 7f1ad1bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1acc15c8f0 0x7f1acc06f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.573+0000 7f1ad1bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc0b27d0 0x7f1acc0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.573+0000 7f1ad1bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0cb3a0 con 0x7f1acc0cd760 2023-03-27T10:09:47.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.573+0000 7f1ad1bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc06b9a0 con 0x7f1acc15c8f0 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.573+0000 7f1ad1bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc070220 con 0x7f1acc0b27d0 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1acc0cd760 0x7f1acc0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1acc0cd760 0x7f1acc0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54900/0 (socket says 172.21.15.172:54900) 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 -- 172.21.15.172:0/3549238253 learned_addr learned my addr 172.21.15.172:0/3549238253 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acbfff700 1 --2- 172.21.15.172:0/3549238253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc0b27d0 0x7f1acc0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acaffd700 1 --2- 172.21.15.172:0/3549238253 >> v2:172.21.15.191:3300/0 conn(0x7f1acc15c8f0 0x7f1acc06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 -- 172.21.15.172:0/3549238253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc0b27d0 msgr2=0x7f1acc0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:47.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 --2- 172.21.15.172:0/3549238253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc0b27d0 0x7f1acc0b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 -- 172.21.15.172:0/3549238253 >> v2:172.21.15.191:3300/0 conn(0x7f1acc15c8f0 msgr2=0x7f1acc06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:47.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 --2- 172.21.15.172:0/3549238253 >> v2:172.21.15.191:3300/0 conn(0x7f1acc15c8f0 0x7f1acc06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 -- 172.21.15.172:0/3549238253 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0ce070 con 0x7f1acc0cd760 2023-03-27T10:09:47.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.574+0000 7f1acb7fe700 1 --2- 172.21.15.172:0/3549238253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc0cdb30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0ce420 tx=0x7f1abc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4600498e61ba3b72 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:47.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1aca7fc700 1 -- 172.21.15.172:0/3549238253 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc011830 con 0x7f1acc0cd760 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1aca7fc700 1 -- 172.21.15.172:0/3549238253 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc011990 con 0x7f1acc0cd760 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1aca7fc700 1 -- 172.21.15.172:0/3549238253 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc011d20 con 0x7f1acc0cd760 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3549238253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 msgr2=0x7f1acc0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3549238253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc0cdb30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0ce420 tx=0x7f1abc009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3549238253 shutdown_connections 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3549238253 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc0b27d0 0x7f1acc0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3549238253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc0cdb30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3549238253 >> v2:172.21.15.191:3300/0 conn(0x7f1acc15c8f0 0x7f1acc06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3549238253 >> 172.21.15.172:0/3549238253 conn(0x7f1acc06dd60 msgr2=0x7f1acc06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:47.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3549238253 shutdown_connections 2023-03-27T10:09:47.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.575+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3549238253 wait complete. 2023-03-27T10:09:47.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.577+0000 7f1ad1bff700 1 Processor -- start 2023-03-27T10:09:47.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.577+0000 7f1ad1bff700 1 -- start start 2023-03-27T10:09:47.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1ad1bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1acc0b27d0 0x7f1acc1e82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1ad1bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1ad1bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc15c8f0 0x7f1acc152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1ad1bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1e7240 con 0x7f1acc0cd760 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1ad1bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1e7520 con 0x7f1acc0b27d0 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1ad1bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1e7800 con 0x7f1acc15c8f0 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1acaffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1acaffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54904/0 (socket says 172.21.15.172:54904) 2023-03-27T10:09:47.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1acaffd700 1 -- 172.21.15.172:0/3040331343 learned_addr learned my addr 172.21.15.172:0/3040331343 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1acb7fe700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1acc0b27d0 0x7f1acc1e82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.578+0000 7f1acbfff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc15c8f0 0x7f1acc152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1acaffd700 1 -- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc15c8f0 msgr2=0x7f1acc152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1acaffd700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc15c8f0 0x7f1acc152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1acaffd700 1 -- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1acc0b27d0 msgr2=0x7f1acc1e82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1acaffd700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1acc0b27d0 0x7f1acc1e82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1acaffd700 1 -- 172.21.15.172:0/3040331343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009550 con 0x7f1acc0cd760 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1acaffd700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc151cf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000e980 tx=0x7f1ac000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0009710 con 0x7f1acc0cd760 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac000c690 con 0x7f1acc0cd760 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc0d0a90 con 0x7f1acc0cd760 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000ca40 con 0x7f1acc0cd760 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.579+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc0d07b0 con 0x7f1acc0cd760 2023-03-27T10:09:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.581+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc06b350 con 0x7f1acc0cd760 2023-03-27T10:09:47.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.581+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f1ac0019030 con 0x7f1acc0cd760 2023-03-27T10:09:47.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.583+0000 7f1ab3fff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1ab8066e30 0x7f1ab80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:47.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.583+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1ac0083dc0 con 0x7f1acc0cd760 2023-03-27T10:09:47.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.583+0000 7f1acb7fe700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1ab8066e30 0x7f1ab80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:47.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.584+0000 7f1acb7fe700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1ab8066e30 0x7f1ab80692e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1abc014040 tx=0x7f1abc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:47.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.587+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f1ac0051350 con 0x7f1acc0cd760 2023-03-27T10:09:47.820 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.821+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1acc074290 con 0x7f1acc0cd760 2023-03-27T10:09:47.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.822+0000 7f1ab3fff700 1 -- 172.21.15.172:0/3040331343 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7f1ac0017de0 con 0x7f1acc0cd760 2023-03-27T10:09:47.822 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:47.822 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-27T10:09:47.823 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1ab8066e30 msgr2=0x7f1ab80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1ab8066e30 0x7f1ab80692e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1abc014040 tx=0x7f1abc008030 comp rx=0 tx=0).stop 2023-03-27T10:09:47.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 msgr2=0x7f1acc151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:47.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc151cf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000e980 tx=0x7f1ac000ec90 comp rx=0 tx=0).stop 2023-03-27T10:09:47.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 shutdown_connections 2023-03-27T10:09:47.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1acc15c8f0 0x7f1acc152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1ab8066e30 0x7f1ab80692e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1acc0b27d0 0x7f1acc1e82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 --2- 172.21.15.172:0/3040331343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1acc0cd760 0x7f1acc151cf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 >> 172.21.15.172:0/3040331343 conn(0x7f1acc06dd60 msgr2=0x7f1acc06c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 shutdown_connections 2023-03-27T10:09:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:47.824+0000 7f1ad1bff700 1 -- 172.21.15.172:0/3040331343 wait complete. 2023-03-27T10:09:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 3 2023-03-27T10:09:47.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.024+0000 7f542f1ff700 1 Processor -- start 2023-03-27T10:09:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.024+0000 7f542f1ff700 1 -- start start 2023-03-27T10:09:48.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.025+0000 7f542f1ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f54280d0b90 0x7f54280ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.025+0000 7f542f1ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280cebc0 con 0x7f54280cd610 2023-03-27T10:09:48.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542f1ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54280ceea0 con 0x7f542815ca20 2023-03-27T10:09:48.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542f1ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280cf180 con 0x7f54280d0b90 2023-03-27T10:09:48.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542cf9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f54280d0b90 0x7f54280ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542cf9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f54280d0b90 0x7f54280ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54914/0 (socket says 172.21.15.172:54914) 2023-03-27T10:09:48.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542d79c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f54280cd610 0x7f54280b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55990/0 (socket says 172.21.15.172:55990) 2023-03-27T10:09:48.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542cf9b700 1 -- 172.21.15.172:0/3592622171 learned_addr learned my addr 172.21.15.172:0/3592622171 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:48.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542cf9b700 1 -- 172.21.15.172:0/3592622171 >> v1:172.21.15.191:6789/0 conn(0x7f542815ca20 legacy=0x7f54280d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542cf9b700 1 -- 172.21.15.172:0/3592622171 >> v1:172.21.15.172:6789/0 conn(0x7f54280cd610 legacy=0x7f54280b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f542cf9b700 1 -- 172.21.15.172:0/3592622171 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280cf460 con 0x7f54280d0b90 2023-03-27T10:09:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.026+0000 7f54277fe700 1 -- 172.21.15.172:0/3592622171 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139265474 0 0) 0x7f54280cebc0 con 0x7f54280cd610 2023-03-27T10:09:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542cf9b700 1 --2- 172.21.15.172:0/3592622171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280ce500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f541c006fd0 tx=0x7f541c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb34f9c4b9477af server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f54277fe700 1 -- 172.21.15.172:0/3592622171 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c005e30 con 0x7f54280d0b90 2023-03-27T10:09:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f54277fe700 1 -- 172.21.15.172:0/3592622171 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c004030 con 0x7f54280d0b90 2023-03-27T10:09:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f54277fe700 1 -- 172.21.15.172:0/3592622171 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0043e0 con 0x7f54280d0b90 2023-03-27T10:09:48.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542f1ff700 1 -- 172.21.15.172:0/3592622171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 msgr2=0x7f54280ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3592622171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280ce500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f541c006fd0 tx=0x7f541c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542f1ff700 1 -- 172.21.15.172:0/3592622171 shutdown_connections 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3592622171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280ce500 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542f1ff700 1 -- 172.21.15.172:0/3592622171 >> 172.21.15.172:0/3592622171 conn(0x7f54280721f0 msgr2=0x7f542809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.027+0000 7f542f1ff700 1 -- 172.21.15.172:0/3592622171 shutdown_connections 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.028+0000 7f542f1ff700 1 -- 172.21.15.172:0/3592622171 wait complete. 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.029+0000 7f542f1ff700 1 Processor -- start 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.029+0000 7f542f1ff700 1 -- start start 2023-03-27T10:09:48.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f542f1ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54280cd610 0x7f54280b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f542f1ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f542f1ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f542815ca20 0x7f54280c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f542f1ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b3b00 con 0x7f54280d0b90 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f542f1ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b3de0 con 0x7f542815ca20 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f542f1ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b40c0 con 0x7f54280cd610 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f5427fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f5427fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54930/0 (socket says 172.21.15.172:54930) 2023-03-27T10:09:48.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.030+0000 7f5427fff700 1 -- 172.21.15.172:0/3290512131 learned_addr learned my addr 172.21.15.172:0/3290512131 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f542cf9b700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54280cd610 0x7f54280b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f542d79c700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f542815ca20 0x7f54280c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f5427fff700 1 -- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54280cd610 msgr2=0x7f54280b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f5427fff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54280cd610 0x7f54280b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f5427fff700 1 -- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f542815ca20 msgr2=0x7f54280c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f5427fff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f542815ca20 0x7f54280c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f5427fff700 1 -- 172.21.15.172:0/3290512131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009500 con 0x7f54280d0b90 2023-03-27T10:09:48.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f542d79c700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f542815ca20 0x7f54280c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:48.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f5427fff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280c7020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f541400c450 tx=0x7f541400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140052d0 con 0x7f54280d0b90 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414005430 con 0x7f54280d0b90 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280d2d30 con 0x7f54280d0b90 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140038c0 con 0x7f54280d0b90 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.031+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54280afc50 con 0x7f54280d0b90 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.032+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54280b0880 con 0x7f54280d0b90 2023-03-27T10:09:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.033+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f5414019030 con 0x7f54280d0b90 2023-03-27T10:09:48.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.034+0000 7f54257fa700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f540c066e30 0x7f540c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.034+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f54140831b0 con 0x7f54280d0b90 2023-03-27T10:09:48.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.034+0000 7f542cf9b700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f540c066e30 0x7f540c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.035+0000 7f542cf9b700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f540c066e30 0x7f540c0692e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f541c000c00 tx=0x7f541c008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.038+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f5414050740 con 0x7f54280d0b90 2023-03-27T10:09:48.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.230+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5428074290 con 0x7f54280d0b90 2023-03-27T10:09:48.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.231+0000 7f54257fa700 1 -- 172.21.15.172:0/3290512131 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14312 (secure 0 0 0) 0x7f5414053d60 con 0x7f54280d0b90 2023-03-27T10:09:48.231 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:48.231 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":20,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:47.097599+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:48.233 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f540c066e30 msgr2=0x7f540c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.233 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f540c066e30 0x7f540c0692e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f541c000c00 tx=0x7f541c008070 comp rx=0 tx=0).stop 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 msgr2=0x7f54280c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280c7020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f541400c450 tx=0x7f541400c810 comp rx=0 tx=0).stop 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 shutdown_connections 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f540c066e30 0x7f540c0692e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f542815ca20 0x7f54280c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54280cd610 0x7f54280b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 --2- 172.21.15.172:0/3290512131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280d0b90 0x7f54280c7020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 >> 172.21.15.172:0/3290512131 conn(0x7f54280721f0 msgr2=0x7f542806b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:48.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 shutdown_connections 2023-03-27T10:09:48.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.234+0000 7f542f1ff700 1 -- 172.21.15.172:0/3290512131 wait complete. 2023-03-27T10:09:48.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:09:48.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:09:48.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.438+0000 7f9c151ff700 1 Processor -- start 2023-03-27T10:09:48.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.438+0000 7f9c151ff700 1 -- start start 2023-03-27T10:09:48.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.439+0000 7f9c151ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 0x7f9c100d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.439+0000 7f9c151ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9c100d1000 0x7f9c100cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.439+0000 7f9c151ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100cdbf0 con 0x7f9c100cfd50 2023-03-27T10:09:48.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.439+0000 7f9c151ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100d2e80 con 0x7f9c100d1000 2023-03-27T10:09:48.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.439+0000 7f9c151ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100d01d0 con 0x7f9c1015c520 2023-03-27T10:09:48.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 0x7f9c100d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0f59e700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f9c100cfd50 0x7f9c10160210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:59912/0 (socket says 172.21.15.172:59912) 2023-03-27T10:09:48.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 0x7f9c100d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:47988/0 (socket says 172.21.15.172:47988) 2023-03-27T10:09:48.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0e59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9c100d1000 0x7f9c100cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0f59e700 1 -- 172.21.15.172:0/1909146773 learned_addr learned my addr 172.21.15.172:0/1909146773 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0dd9b700 1 -- 172.21.15.172:0/1909146773 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183912710 0 0) 0x7f9c100cdbf0 con 0x7f9c100cfd50 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/1909146773 >> v2:172.21.15.191:3300/0 conn(0x7f9c100d1000 msgr2=0x7f9c100cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0ed9d700 1 --2- 172.21.15.172:0/1909146773 >> v2:172.21.15.191:3300/0 conn(0x7f9c100d1000 0x7f9c100cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/1909146773 >> v1:172.21.15.191:6789/0 conn(0x7f9c100cfd50 legacy=0x7f9c10160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/1909146773 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100d1430 con 0x7f9c1015c520 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.440+0000 7f9c0e59c700 1 --2- 172.21.15.172:0/1909146773 >> v2:172.21.15.191:3300/0 conn(0x7f9c100d1000 0x7f9c100cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c0ed9d700 1 --2- 172.21.15.172:0/1909146773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 0x7f9c100d0ac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009840 tx=0x7f9c00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f2690e01d545c2 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c0dd9b700 1 -- 172.21.15.172:0/1909146773 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011830 con 0x7f9c1015c520 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c0dd9b700 1 -- 172.21.15.172:0/1909146773 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00011990 con 0x7f9c1015c520 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c0dd9b700 1 -- 172.21.15.172:0/1909146773 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011d20 con 0x7f9c1015c520 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c151ff700 1 -- 172.21.15.172:0/1909146773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 msgr2=0x7f9c100d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c151ff700 1 --2- 172.21.15.172:0/1909146773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 0x7f9c100d0ac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009840 tx=0x7f9c00009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c151ff700 1 -- 172.21.15.172:0/1909146773 shutdown_connections 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c151ff700 1 --2- 172.21.15.172:0/1909146773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c1015c520 0x7f9c100d0ac0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.441+0000 7f9c151ff700 1 --2- 172.21.15.172:0/1909146773 >> v2:172.21.15.191:3300/0 conn(0x7f9c100d1000 0x7f9c100cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.442+0000 7f9c151ff700 1 -- 172.21.15.172:0/1909146773 >> 172.21.15.172:0/1909146773 conn(0x7f9c100721f0 msgr2=0x7f9c1009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:48.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.442+0000 7f9c151ff700 1 -- 172.21.15.172:0/1909146773 shutdown_connections 2023-03-27T10:09:48.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.442+0000 7f9c151ff700 1 -- 172.21.15.172:0/1909146773 wait complete. 2023-03-27T10:09:48.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.443+0000 7f9c151ff700 1 Processor -- start 2023-03-27T10:09:48.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.443+0000 7f9c151ff700 1 -- start start 2023-03-27T10:09:48.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c151ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 0x7f9c10158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c151ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c100d1000 0x7f9c10155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c151ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c1015c520 0x7f9c100cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c151ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100b1ec0 con 0x7f9c100cfd50 2023-03-27T10:09:48.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c151ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100cc550 con 0x7f9c1015c520 2023-03-27T10:09:48.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c151ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100cc830 con 0x7f9c100d1000 2023-03-27T10:09:48.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 0x7f9c10158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 0x7f9c10158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54940/0 (socket says 172.21.15.172:54940) 2023-03-27T10:09:48.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.444+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/2043971621 learned_addr learned my addr 172.21.15.172:0/2043971621 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0e59c700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c100d1000 0x7f9c10155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0f59e700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c1015c520 0x7f9c100cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c100d1000 msgr2=0x7f9c10155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0ed9d700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c100d1000 0x7f9c10155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c1015c520 msgr2=0x7f9c100cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0ed9d700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c1015c520 0x7f9c100cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0ed9d700 1 -- 172.21.15.172:0/2043971621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040094a0 con 0x7f9c100cfd50 2023-03-27T10:09:48.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9c0ed9d700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 0x7f9c10158b90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009b90 tx=0x7f9c00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000036a0 con 0x7f9c100cfd50 2023-03-27T10:09:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0001e070 con 0x7f9c100cfd50 2023-03-27T10:09:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.445+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00003a60 con 0x7f9c100cfd50 2023-03-27T10:09:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.446+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c000094a0 con 0x7f9c100cfd50 2023-03-27T10:09:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.446+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100d0420 con 0x7f9c100cfd50 2023-03-27T10:09:48.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.447+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c100cd5e0 con 0x7f9c100cfd50 2023-03-27T10:09:48.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.448+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f9c0000f050 con 0x7f9c100cfd50 2023-03-27T10:09:48.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.448+0000 7f9bf77fe700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9bfc066e30 0x7f9bfc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.448+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9c00084da0 con 0x7f9c100cfd50 2023-03-27T10:09:48.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.449+0000 7f9c0e59c700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9bfc066e30 0x7f9bfc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.449+0000 7f9c0e59c700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9bfc066e30 0x7f9bfc0692e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c101590d0 tx=0x7f9c04009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.452+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f9c00052330 con 0x7f9c100cfd50 2023-03-27T10:09:48.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.639+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c100cd880 con 0x7f9c100cfd50 2023-03-27T10:09:48.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.639+0000 7f9bf77fe700 1 -- 172.21.15.172:0/2043971621 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c000200a0 con 0x7f9c100cfd50 2023-03-27T10:09:48.639 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:09:48.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9bfc066e30 msgr2=0x7f9bfc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9bfc066e30 0x7f9bfc0692e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c101590d0 tx=0x7f9c04009210 comp rx=0 tx=0).stop 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 msgr2=0x7f9c10158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 0x7f9c10158b90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009b90 tx=0x7f9c00004750 comp rx=0 tx=0).stop 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 shutdown_connections 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9bfc066e30 0x7f9bfc0692e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c1015c520 0x7f9c100cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c100cfd50 0x7f9c10158b90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 --2- 172.21.15.172:0/2043971621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c100d1000 0x7f9c10155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 >> 172.21.15.172:0/2043971621 conn(0x7f9c100721f0 msgr2=0x7f9c100b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:48.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 shutdown_connections 2023-03-27T10:09:48.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.642+0000 7f9c151ff700 1 -- 172.21.15.172:0/2043971621 wait complete. 2023-03-27T10:09:48.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:09:48.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.846+0000 7f46b57ff700 1 Processor -- start 2023-03-27T10:09:48.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.847+0000 7f46b57ff700 1 -- start start 2023-03-27T10:09:48.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46b57ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46b015caa0 0x7f46b015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46b57ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b01609e0 con 0x7f46b00cc340 2023-03-27T10:09:48.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46b57ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00cb2a0 con 0x7f46b006a1a0 2023-03-27T10:09:48.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46b57ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b0161340 con 0x7f46b015caa0 2023-03-27T10:09:48.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46aeffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46b015caa0 0x7f46b015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46aeffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46b015caa0 0x7f46b015ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54944/0 (socket says 172.21.15.172:54944) 2023-03-27T10:09:48.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46af7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f46b00cc340 0x7f46b0071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55998/0 (socket says 172.21.15.172:55998) 2023-03-27T10:09:48.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46aeffd700 1 -- 172.21.15.172:0/2586530435 learned_addr learned my addr 172.21.15.172:0/2586530435 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:48.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.848+0000 7f46aeffd700 1 -- 172.21.15.172:0/2586530435 >> v1:172.21.15.191:6789/0 conn(0x7f46b006a1a0 legacy=0x7f46b00cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46aeffd700 1 -- 172.21.15.172:0/2586530435 >> v1:172.21.15.172:6789/0 conn(0x7f46b00cc340 legacy=0x7f46b0071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46aeffd700 1 -- 172.21.15.172:0/2586530435 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00cd180 con 0x7f46b015caa0 2023-03-27T10:09:48.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46ae7fc700 1 -- 172.21.15.172:0/2586530435 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472743325 0 0) 0x7f46b01609e0 con 0x7f46b00cc340 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46aeffd700 1 --2- 172.21.15.172:0/2586530435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b015caa0 0x7f46b015ce70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46a00098f0 tx=0x7f46a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9970484e4f777b20 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46ae7fc700 1 -- 172.21.15.172:0/2586530435 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000b8a0 con 0x7f46b015caa0 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46ae7fc700 1 -- 172.21.15.172:0/2586530435 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000ba00 con 0x7f46b015caa0 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46ae7fc700 1 -- 172.21.15.172:0/2586530435 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000bd90 con 0x7f46b015caa0 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46b57ff700 1 -- 172.21.15.172:0/2586530435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b015caa0 msgr2=0x7f46b015ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.849+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2586530435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b015caa0 0x7f46b015ce70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46a00098f0 tx=0x7f46a0009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.850+0000 7f46b57ff700 1 -- 172.21.15.172:0/2586530435 shutdown_connections 2023-03-27T10:09:48.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.850+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2586530435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b015caa0 0x7f46b015ce70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.850+0000 7f46b57ff700 1 -- 172.21.15.172:0/2586530435 >> 172.21.15.172:0/2586530435 conn(0x7f46b006b2b0 msgr2=0x7f46b006b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:48.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.850+0000 7f46b57ff700 1 -- 172.21.15.172:0/2586530435 shutdown_connections 2023-03-27T10:09:48.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.850+0000 7f46b57ff700 1 -- 172.21.15.172:0/2586530435 wait complete. 2023-03-27T10:09:48.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.852+0000 7f46b57ff700 1 Processor -- start 2023-03-27T10:09:48.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.852+0000 7f46b57ff700 1 -- start start 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.853+0000 7f46b57ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b006a1a0 0x7f46b00c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.853+0000 7f46b57ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 0x7f46b015ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.853+0000 7f46b57ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46b015caa0 0x7f46b014e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.853+0000 7f46b57ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b015eea0 con 0x7f46b00cc340 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.853+0000 7f46b57ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b015f180 con 0x7f46b006a1a0 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.853+0000 7f46b57ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b015f460 con 0x7f46b015caa0 2023-03-27T10:09:48.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 0x7f46b015ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 0x7f46b015ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54946/0 (socket says 172.21.15.172:54946) 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 -- 172.21.15.172:0/2993110968 learned_addr learned my addr 172.21.15.172:0/2993110968 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46aeffd700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b006a1a0 0x7f46b00c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46af7fe700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46b015caa0 0x7f46b014e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 -- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46b015caa0 msgr2=0x7f46b014e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46b015caa0 0x7f46b014e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 -- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b006a1a0 msgr2=0x7f46b00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:48.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b006a1a0 0x7f46b00c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:48.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 -- 172.21.15.172:0/2993110968 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009550 con 0x7f46b00cc340 2023-03-27T10:09:48.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a7fff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 0x7f46b015ff40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f469800c4d0 tx=0x7f469800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.854+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800cea0 con 0x7f46b00cc340 2023-03-27T10:09:48.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.855+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980052d0 con 0x7f46b00cc340 2023-03-27T10:09:48.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.855+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698003680 con 0x7f46b00cc340 2023-03-27T10:09:48.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.855+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b0160f60 con 0x7f46b00cc340 2023-03-27T10:09:48.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.855+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b0160c80 con 0x7f46b00cc340 2023-03-27T10:09:48.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.856+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b006acf0 con 0x7f46b00cc340 2023-03-27T10:09:48.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.857+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f4698019030 con 0x7f46b00cc340 2023-03-27T10:09:48.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.857+0000 7f46a77fe700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4690066e30 0x7f46900692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:48.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.858+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4698082fe0 con 0x7f46b00cc340 2023-03-27T10:09:48.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.858+0000 7f46aeffd700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4690066e30 0x7f46900692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:48.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.859+0000 7f46aeffd700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4690066e30 0x7f46900692e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:48.860 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:48.861+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f469804b4f0 con 0x7f46b00cc340 2023-03-27T10:09:49.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.049+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46b0074300 con 0x7f46b00cc340 2023-03-27T10:09:49.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.050+0000 7f46a77fe700 1 -- 172.21.15.172:0/2993110968 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4698017020 con 0x7f46b00cc340 2023-03-27T10:09:49.051 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:09:49.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4690066e30 msgr2=0x7f46900692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4690066e30 0x7f46900692e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a0008030 comp rx=0 tx=0).stop 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 msgr2=0x7f46b015ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 0x7f46b015ff40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f469800c4d0 tx=0x7f469800c7e0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 shutdown_connections 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46b015caa0 0x7f46b014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4690066e30 0x7f46900692e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b006a1a0 0x7f46b00c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 --2- 172.21.15.172:0/2993110968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46b00cc340 0x7f46b015ff40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 >> 172.21.15.172:0/2993110968 conn(0x7f46b006b2b0 msgr2=0x7f46b006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:49.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 shutdown_connections 2023-03-27T10:09:49.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.052+0000 7f46b57ff700 1 -- 172.21.15.172:0/2993110968 wait complete. 2023-03-27T10:09:49.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-27T10:09:49.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.255+0000 7f90f6dff700 1 Processor -- start 2023-03-27T10:09:49.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.255+0000 7f90f6dff700 1 -- start start 2023-03-27T10:09:49.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.256+0000 7f90f6dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f90f00d0b90 0x7f90f00ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f6dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00cebc0 con 0x7f90f00cd610 2023-03-27T10:09:49.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f6dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00ceea0 con 0x7f90f015ca20 2023-03-27T10:09:49.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f6dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00cf180 con 0x7f90f00d0b90 2023-03-27T10:09:49.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f539c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f90f00cd610 0x7f90f00b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56004/0 (socket says 172.21.15.172:56004) 2023-03-27T10:09:49.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f539c700 1 -- 172.21.15.172:0/3840547258 learned_addr learned my addr 172.21.15.172:0/3840547258 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:49.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f4b9b700 1 --2- 172.21.15.172:0/3840547258 >> v2:172.21.15.191:3300/0 conn(0x7f90f00d0b90 0x7f90f00ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90ef7fe700 1 -- 172.21.15.172:0/3840547258 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066960383 0 0) 0x7f90f00cebc0 con 0x7f90f00cd610 2023-03-27T10:09:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90ef7fe700 1 -- 172.21.15.172:0/3840547258 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90e00035b0 con 0x7f90f00cd610 2023-03-27T10:09:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f4b9b700 1 -- 172.21.15.172:0/3840547258 >> v1:172.21.15.191:6789/0 conn(0x7f90f015ca20 legacy=0x7f90f00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f4b9b700 1 -- 172.21.15.172:0/3840547258 >> v1:172.21.15.172:6789/0 conn(0x7f90f00cd610 legacy=0x7f90f00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.257+0000 7f90f4b9b700 1 -- 172.21.15.172:0/3840547258 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00cf460 con 0x7f90f00d0b90 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90f4b9b700 1 --2- 172.21.15.172:0/3840547258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00d0b90 0x7f90f00ce500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009820 tx=0x7f90e4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1455131169fef4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90ef7fe700 1 -- 172.21.15.172:0/3840547258 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4005e30 con 0x7f90f00d0b90 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90ef7fe700 1 -- 172.21.15.172:0/3840547258 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4006030 con 0x7f90f00d0b90 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90ef7fe700 1 -- 172.21.15.172:0/3840547258 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40063c0 con 0x7f90f00d0b90 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90f6dff700 1 -- 172.21.15.172:0/3840547258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00d0b90 msgr2=0x7f90f00ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90f6dff700 1 --2- 172.21.15.172:0/3840547258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00d0b90 0x7f90f00ce500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009820 tx=0x7f90e4009b30 comp rx=0 tx=0).stop 2023-03-27T10:09:49.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90f6dff700 1 -- 172.21.15.172:0/3840547258 shutdown_connections 2023-03-27T10:09:49.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90f6dff700 1 --2- 172.21.15.172:0/3840547258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00d0b90 0x7f90f00ce500 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.258+0000 7f90f6dff700 1 -- 172.21.15.172:0/3840547258 >> 172.21.15.172:0/3840547258 conn(0x7f90f00721f0 msgr2=0x7f90f009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:49.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.259+0000 7f90f6dff700 1 -- 172.21.15.172:0/3840547258 shutdown_connections 2023-03-27T10:09:49.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.259+0000 7f90f6dff700 1 -- 172.21.15.172:0/3840547258 wait complete. 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.260+0000 7f90f6dff700 1 Processor -- start 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.260+0000 7f90f6dff700 1 -- start start 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90f6dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00cd610 0x7f90f00b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90f6dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 0x7f90f00cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90f6dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90f015ca20 0x7f90f00cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90f6dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00b52e0 con 0x7f90f00d0b90 2023-03-27T10:09:49.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90f6dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00ca2c0 con 0x7f90f00cd610 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90f6dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00ca5a0 con 0x7f90f015ca20 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90effff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 0x7f90f00cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90effff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 0x7f90f00cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54960/0 (socket says 172.21.15.172:54960) 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.261+0000 7f90effff700 1 -- 172.21.15.172:0/2093115505 learned_addr learned my addr 172.21.15.172:0/2093115505 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90f4b9b700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00cd610 0x7f90f00b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90f539c700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90f015ca20 0x7f90f00cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90effff700 1 -- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90f015ca20 msgr2=0x7f90f00cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90effff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90f015ca20 0x7f90f00cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90effff700 1 -- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00cd610 msgr2=0x7f90f00b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90effff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00cd610 0x7f90f00b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90effff700 1 -- 172.21.15.172:0/2093115505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e4009430 con 0x7f90f00d0b90 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90f4b9b700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00cd610 0x7f90f00b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90effff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 0x7f90f00cb080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c450 tx=0x7f90dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:49.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0052d0 con 0x7f90f00d0b90 2023-03-27T10:09:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc005430 con 0x7f90f00d0b90 2023-03-27T10:09:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0038c0 con 0x7f90f00d0b90 2023-03-27T10:09:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f00d2d30 con 0x7f90f00d0b90 2023-03-27T10:09:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.262+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f00afc50 con 0x7f90f00d0b90 2023-03-27T10:09:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.263+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0074290 con 0x7f90f00d0b90 2023-03-27T10:09:49.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.264+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f90dc019030 con 0x7f90f00d0b90 2023-03-27T10:09:49.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.265+0000 7f90ed7fa700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f90d4066e30 0x7f90d40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.265+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f90dc083150 con 0x7f90f00d0b90 2023-03-27T10:09:49.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.266+0000 7f90f4b9b700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f90d4066e30 0x7f90d40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.266+0000 7f90f4b9b700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f90d4066e30 0x7f90d40692e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009b70 tx=0x7f90e4008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:49.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.269+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f90dc0506e0 con 0x7f90f00d0b90 2023-03-27T10:09:49.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.461+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90f00c68b0 con 0x7f90f00d0b90 2023-03-27T10:09:49.461 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.461+0000 7f90ed7fa700 1 -- 172.21.15.172:0/2093115505 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f90dc053d00 con 0x7f90f00d0b90 2023-03-27T10:09:49.461 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:49.461 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2023-03-27T10:09:49.461 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:09:49.461 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 2, 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": "rbd" 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:09:49.462 INFO:teuthology.orchestra.run.smithi172.stdout:] 2023-03-27T10:09:49.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f90d4066e30 msgr2=0x7f90d40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f90d4066e30 0x7f90d40692e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009b70 tx=0x7f90e4008070 comp rx=0 tx=0).stop 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 msgr2=0x7f90f00cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 0x7f90f00cb080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00c450 tx=0x7f90dc00c810 comp rx=0 tx=0).stop 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 shutdown_connections 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90f015ca20 0x7f90f00cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f90d4066e30 0x7f90d40692e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90f00cd610 0x7f90f00b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 --2- 172.21.15.172:0/2093115505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90f00d0b90 0x7f90f00cb080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.463+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 >> 172.21.15.172:0/2093115505 conn(0x7f90f00721f0 msgr2=0x7f90f01e1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:49.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.464+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 shutdown_connections 2023-03-27T10:09:49.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.464+0000 7f90f6dff700 1 -- 172.21.15.172:0/2093115505 wait complete. 2023-03-27T10:09:49.480 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-27T10:09:49.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-27T10:09:49.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.670+0000 7fb87c9ff700 1 Processor -- start 2023-03-27T10:09:49.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.670+0000 7fb87c9ff700 1 -- start start 2023-03-27T10:09:49.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb87c9ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8780afb70 0x7fb8780b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb87c9ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb8780d1220 0x7fb878166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb87c9ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8780b0bf0 con 0x7fb87815c930 2023-03-27T10:09:49.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb87c9ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8780affe0 con 0x7fb8780afb70 2023-03-27T10:09:49.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb87c9ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8780b02c0 con 0x7fb8780d1220 2023-03-27T10:09:49.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb875d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8780afb70 0x7fb8780b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.671+0000 7fb875d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8780afb70 0x7fb8780b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54968/0 (socket says 172.21.15.172:54968) 2023-03-27T10:09:49.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb875d9b700 1 -- 172.21.15.172:0/2919134393 learned_addr learned my addr 172.21.15.172:0/2919134393 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:49.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb87659c700 1 --1- 172.21.15.172:0/2919134393 >> v1:172.21.15.172:6789/0 conn(0x7fb87815c930 0x7fb8780d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56020/0 (socket says 172.21.15.172:56020) 2023-03-27T10:09:49.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb876d9d700 1 --2- 172.21.15.172:0/2919134393 >> v2:172.21.15.191:3300/0 conn(0x7fb8780d1220 0x7fb878166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb875d9b700 1 -- 172.21.15.172:0/2919134393 >> v2:172.21.15.191:3300/0 conn(0x7fb8780d1220 msgr2=0x7fb878166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:49.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb875d9b700 1 --2- 172.21.15.172:0/2919134393 >> v2:172.21.15.191:3300/0 conn(0x7fb8780d1220 0x7fb878166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb875d9b700 1 -- 172.21.15.172:0/2919134393 >> v1:172.21.15.172:6789/0 conn(0x7fb87815c930 legacy=0x7fb8780d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb875d9b700 1 -- 172.21.15.172:0/2919134393 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8780b05a0 con 0x7fb8780afb70 2023-03-27T10:09:49.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb875d9b700 1 --2- 172.21.15.172:0/2919134393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb8780b4480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb878160470 tx=0x7fb86c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb57492bd4440f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:49.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb87559a700 1 -- 172.21.15.172:0/2919134393 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00b870 con 0x7fb8780afb70 2023-03-27T10:09:49.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb87559a700 1 -- 172.21.15.172:0/2919134393 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00b9d0 con 0x7fb8780afb70 2023-03-27T10:09:49.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.672+0000 7fb87559a700 1 -- 172.21.15.172:0/2919134393 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00bd60 con 0x7fb8780afb70 2023-03-27T10:09:49.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2919134393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 msgr2=0x7fb8780b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2919134393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb8780b4480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb878160470 tx=0x7fb86c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2919134393 shutdown_connections 2023-03-27T10:09:49.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2919134393 >> v2:172.21.15.191:3300/0 conn(0x7fb8780d1220 0x7fb878166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2919134393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb8780b4480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2919134393 >> 172.21.15.172:0/2919134393 conn(0x7fb87809c210 msgr2=0x7fb8780d2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:49.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2919134393 shutdown_connections 2023-03-27T10:09:49.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.673+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2919134393 wait complete. 2023-03-27T10:09:49.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.675+0000 7fb87c9ff700 1 Processor -- start 2023-03-27T10:09:49.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.675+0000 7fb87c9ff700 1 -- start start 2023-03-27T10:09:49.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87c9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb87815f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87c9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8780d1220 0x7fb87815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87c9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb87815c930 0x7fb8781f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87c9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8780b6650 con 0x7fb8780afb70 2023-03-27T10:09:49.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87c9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8780b6040 con 0x7fb87815c930 2023-03-27T10:09:49.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87c9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87815d810 con 0x7fb8780d1220 2023-03-27T10:09:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb87815f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb87815f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54978/0 (socket says 172.21.15.172:54978) 2023-03-27T10:09:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 -- 172.21.15.172:0/2581169977 learned_addr learned my addr 172.21.15.172:0/2581169977 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb876d9d700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb87815c930 0x7fb8781f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb875d9b700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8780d1220 0x7fb87815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 -- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8780d1220 msgr2=0x7fb87815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8780d1220 0x7fb87815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 -- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb87815c930 msgr2=0x7fb8781f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:49.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb87815c930 0x7fb8781f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:49.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb87659c700 1 -- 172.21.15.172:0/2581169977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009550 con 0x7fb8780afb70 2023-03-27T10:09:49.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb876d9d700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb87815c930 0x7fb8781f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:49.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.676+0000 7fb875d9b700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8780d1220 0x7fb87815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:49.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.677+0000 7fb87659c700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb87815f7b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c500 tx=0x7fb86800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:49.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.677+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868005cb0 con 0x7fb8780afb70 2023-03-27T10:09:49.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.677+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868005e10 con 0x7fb8780afb70 2023-03-27T10:09:49.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.677+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87815cd00 con 0x7fb8780afb70 2023-03-27T10:09:49.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.677+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8680072d0 con 0x7fb8780afb70 2023-03-27T10:09:49.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.677+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8780b0880 con 0x7fb8780afb70 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.678+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87815ce90 con 0x7fb8780afb70 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.679+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fb868019030 con 0x7fb8780afb70 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.680+0000 7fb866ffd700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb858066e30 0x7fb8580692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.680+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb868083120 con 0x7fb8780afb70 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.680+0000 7fb875d9b700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb858066e30 0x7fb8580692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.681+0000 7fb875d9b700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb858066e30 0x7fb8580692e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8780b8150 tx=0x7fb86c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:49.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.684+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fb86804b4f0 con 0x7fb8780afb70 2023-03-27T10:09:49.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:49.875+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb878074290 con 0x7fb8780afb70 2023-03-27T10:09:50.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.585+0000 7fb866ffd700 1 -- 172.21.15.172:0/2581169977 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb87815ce90 con 0x7fb8780afb70 2023-03-27T10:09:50.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb858066e30 msgr2=0x7fb8580692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb858066e30 0x7fb8580692e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8780b8150 tx=0x7fb86c008030 comp rx=0 tx=0).stop 2023-03-27T10:09:50.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 msgr2=0x7fb87815f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb87815f7b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c500 tx=0x7fb86800c8c0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 shutdown_connections 2023-03-27T10:09:50.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb858066e30 0x7fb8580692e0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb8780b8150 tx=0x7fb86c008030 comp rx=0 tx=0).stop 2023-03-27T10:09:50.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb87815c930 0x7fb8781f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8780afb70 0x7fb87815f7b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 --2- 172.21.15.172:0/2581169977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb8780d1220 0x7fb87815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.593+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 >> 172.21.15.172:0/2581169977 conn(0x7fb87809c210 msgr2=0x7fb878159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:50.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.594+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 shutdown_connections 2023-03-27T10:09:50.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.594+0000 7fb87c9ff700 1 -- 172.21.15.172:0/2581169977 wait complete. 2023-03-27T10:09:50.595 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2023-03-27T10:09:50.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-27T10:09:50.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.808+0000 7fc9fabff700 1 Processor -- start 2023-03-27T10:09:50.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.808+0000 7fc9fabff700 1 -- start start 2023-03-27T10:09:50.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.809+0000 7fc9fabff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 0x7fc9f41747e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.809+0000 7fc9fabff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f416d240 con 0x7fc9f408a570 2023-03-27T10:09:50.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.809+0000 7fc9fabff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f40cbaa0 con 0x7fc9f416ce70 2023-03-27T10:09:50.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.809+0000 7fc9fabff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40cc830 con 0x7fc9f40cf1d0 2023-03-27T10:09:50.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.810+0000 7fc9f3fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc9f408a570 0x7fc9f40ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56032/0 (socket says 172.21.15.172:56032) 2023-03-27T10:09:50.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.810+0000 7fc9f3fff700 1 -- 172.21.15.172:0/1688403473 learned_addr learned my addr 172.21.15.172:0/1688403473 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:50.826 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.810+0000 7fc9f919c700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 0x7fc9f41747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.826 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.810+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878983300 0 0) 0x7fc9f416d240 con 0x7fc9f408a570 2023-03-27T10:09:50.826 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e4003590 con 0x7fc9f408a570 2023-03-27T10:09:50.826 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500339043 0 0) 0x7fc9f40cbaa0 con 0x7fc9f416ce70 2023-03-27T10:09:50.826 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f416d240 con 0x7fc9f416ce70 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2317038554 0 0) 0x7fc9e4003590 con 0x7fc9f408a570 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 msgr2=0x7fc9f41747e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 0x7fc9f41747e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 >> v1:172.21.15.191:6789/0 conn(0x7fc9f416ce70 legacy=0x7fc9f40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40cbd80 con 0x7fc9f408a570 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7fc9e0001670 con 0x7fc9f408a570 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 >> v1:172.21.15.172:6789/0 conn(0x7fc9f408a570 legacy=0x7fc9f40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9e4006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9e40067b0 0x7fc9e400d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 0x7fc9e400f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40cc830 con 0x7fc9e4003d90 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e400ff40 con 0x7fc9e40067b0 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.823+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4010100 con 0x7fc9f40cf1d0 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9e4006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f919c700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 0x7fc9e400f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f3fff700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9e40067b0 0x7fc9e400d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 -- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 msgr2=0x7fc9e400f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40cf1d0 0x7fc9e400f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 -- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9e40067b0 msgr2=0x7fc9e400d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9e40067b0 0x7fc9e400d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 -- 172.21.15.172:0/1688403473 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4003590 con 0x7fc9e4003d90 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f3fff700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9e40067b0 0x7fc9e400d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f899b700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9e4006190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8001980 tx=0x7fc9e4003840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a789c35fed9445 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8001470 con 0x7fc9e4003d90 2023-03-27T10:09:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e80052d0 con 0x7fc9e4003d90 2023-03-27T10:09:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.824+0000 7fc9f37fe700 1 -- 172.21.15.172:0/1688403473 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8003680 con 0x7fc9e4003d90 2023-03-27T10:09:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9fabff700 1 -- 172.21.15.172:0/1688403473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 msgr2=0x7fc9e4006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9fabff700 1 --2- 172.21.15.172:0/1688403473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9e4006190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8001980 tx=0x7fc9e4003840 comp rx=0 tx=0).stop 2023-03-27T10:09:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9f919c700 1 -- 172.21.15.172:0/1688403473 reap_dead start 2023-03-27T10:09:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9fabff700 1 -- 172.21.15.172:0/1688403473 shutdown_connections 2023-03-27T10:09:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9fabff700 1 -- 172.21.15.172:0/1688403473 >> 172.21.15.172:0/1688403473 conn(0x7fc9f406d510 msgr2=0x7fc9f406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9fabff700 1 -- 172.21.15.172:0/1688403473 shutdown_connections 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.825+0000 7fc9fabff700 1 -- 172.21.15.172:0/1688403473 wait complete. 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.827+0000 7fc9fabff700 1 Processor -- start 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.827+0000 7fc9fabff700 1 -- start start 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9fabff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9f40a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9fabff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40c49e0 0x7fc9f4202ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9fabff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9f40c4f30 0x7fc9f42031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9fabff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40b1530 con 0x7fc9e4003d90 2023-03-27T10:09:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9fabff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40c5c00 con 0x7fc9f40c4f30 2023-03-27T10:09:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9fabff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40b1250 con 0x7fc9f40c49e0 2023-03-27T10:09:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9f899b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9f40a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9f899b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9f40a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54996/0 (socket says 172.21.15.172:54996) 2023-03-27T10:09:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9f899b700 1 -- 172.21.15.172:0/930615215 learned_addr learned my addr 172.21.15.172:0/930615215 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9f919c700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9f40c4f30 0x7fc9f42031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.828+0000 7fc9f3fff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40c49e0 0x7fc9f4202ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f899b700 1 -- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40c49e0 msgr2=0x7fc9f4202ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f899b700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40c49e0 0x7fc9f4202ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f899b700 1 -- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9f40c4f30 msgr2=0x7fc9f42031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f899b700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9f40c4f30 0x7fc9f42031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f899b700 1 -- 172.21.15.172:0/930615215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40cc340 con 0x7fc9e4003d90 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f899b700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9f40a92f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400ff10 tx=0x7fc9e8001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8001110 con 0x7fc9e4003d90 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8001410 con 0x7fc9e4003d90 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80072a0 con 0x7fc9e4003d90 2023-03-27T10:09:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f40cc060 con 0x7fc9e4003d90 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.829+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f40cdc90 con 0x7fc9e4003d90 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.830+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f4074300 con 0x7fc9e4003d90 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.831+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc9e802e070 con 0x7fc9e4003d90 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.832+0000 7fc9f17fa700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc9d8066e30 0x7fc9d80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.832+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fc9e8085410 con 0x7fc9e4003d90 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.833+0000 7fc9f3fff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc9d8066e30 0x7fc9d80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.833+0000 7fc9f3fff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc9d8066e30 0x7fc9d80692e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0001200 tx=0x7fc9e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:50.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:50.836+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc9e80528b0 con 0x7fc9e4003d90 2023-03-27T10:09:51.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.023+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc9f406fc40 con 0x7fc9e4003d90 2023-03-27T10:09:51.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.604+0000 7fc9f17fa700 1 -- 172.21.15.172:0/930615215 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc9e8055ed0 con 0x7fc9e4003d90 2023-03-27T10:09:51.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.609+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc9d8066e30 msgr2=0x7fc9d80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:51.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.609+0000 7fc9fabff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc9d8066e30 0x7fc9d80692e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0001200 tx=0x7fc9e0009040 comp rx=0 tx=0).stop 2023-03-27T10:09:51.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.609+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 msgr2=0x7fc9f40a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:51.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.609+0000 7fc9fabff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9f40a92f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400ff10 tx=0x7fc9e8001310 comp rx=0 tx=0).stop 2023-03-27T10:09:51.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.610+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 shutdown_connections 2023-03-27T10:09:51.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.610+0000 7fc9fabff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc9d8066e30 0x7fc9d80692e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.610+0000 7fc9fabff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9f40c4f30 0x7fc9f42031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.610+0000 7fc9fabff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9e4003d90 0x7fc9f40a92f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.610+0000 7fc9fabff700 1 --2- 172.21.15.172:0/930615215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9f40c49e0 0x7fc9f4202ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.610+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 >> 172.21.15.172:0/930615215 conn(0x7fc9f406d510 msgr2=0x7fc9f406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:51.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.612+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 shutdown_connections 2023-03-27T10:09:51.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.617+0000 7fc9fabff700 1 -- 172.21.15.172:0/930615215 wait complete. 2023-03-27T10:09:51.618 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2023-03-27T10:09:51.635 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-27T10:09:51.823 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.824+0000 7f62435ff700 1 Processor -- start 2023-03-27T10:09:51.823 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.824+0000 7f62435ff700 1 -- start start 2023-03-27T10:09:51.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f62435ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f623c15a240 0x7f623c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:51.827 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f62435ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c0d3a30 0x7f623c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:51.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f62435ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623c0d29d0 con 0x7f623c1604b0 2023-03-27T10:09:51.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f62435ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f623c161020 con 0x7f623c15a240 2023-03-27T10:09:51.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f62435ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c161200 con 0x7f623c0d3a30 2023-03-27T10:09:51.828 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f624139b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f623c15a240 0x7f623c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:51.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f624139b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f623c15a240 0x7f623c0d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55008/0 (socket says 172.21.15.172:55008) 2023-03-27T10:09:51.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f624139b700 1 -- 172.21.15.172:0/1754213333 learned_addr learned my addr 172.21.15.172:0/1754213333 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:51.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.825+0000 7f6241b9c700 1 --1- 172.21.15.172:0/1754213333 >> v1:172.21.15.172:6789/0 conn(0x7f623c1604b0 0x7f623c160910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56042/0 (socket says 172.21.15.172:56042) 2023-03-27T10:09:51.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f6240b9a700 1 --2- 172.21.15.172:0/1754213333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c0d3a30 0x7f623c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:51.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f624139b700 1 -- 172.21.15.172:0/1754213333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c0d3a30 msgr2=0x7f623c0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:51.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f624139b700 1 --2- 172.21.15.172:0/1754213333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c0d3a30 0x7f623c0d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f624139b700 1 -- 172.21.15.172:0/1754213333 >> v1:172.21.15.172:6789/0 conn(0x7f623c1604b0 legacy=0x7f623c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:51.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f624139b700 1 -- 172.21.15.172:0/1754213333 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c15a610 con 0x7f623c15a240 2023-03-27T10:09:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f624139b700 1 --2- 172.21.15.172:0/1754213333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c15a240 0x7f623c0d0ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62380098f0 tx=0x7f6238009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aacd970e93c6d26 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f6233fff700 1 -- 172.21.15.172:0/1754213333 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238011830 con 0x7f623c15a240 2023-03-27T10:09:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f6233fff700 1 -- 172.21.15.172:0/1754213333 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238011990 con 0x7f623c15a240 2023-03-27T10:09:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.826+0000 7f6233fff700 1 -- 172.21.15.172:0/1754213333 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238011d20 con 0x7f623c15a240 2023-03-27T10:09:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 -- 172.21.15.172:0/1754213333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c15a240 msgr2=0x7f623c0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 --2- 172.21.15.172:0/1754213333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c15a240 0x7f623c0d0ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62380098f0 tx=0x7f6238009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:51.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 -- 172.21.15.172:0/1754213333 shutdown_connections 2023-03-27T10:09:51.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 --2- 172.21.15.172:0/1754213333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c15a240 0x7f623c0d0ac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 --2- 172.21.15.172:0/1754213333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c0d3a30 0x7f623c0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 -- 172.21.15.172:0/1754213333 >> 172.21.15.172:0/1754213333 conn(0x7f623c0721f0 msgr2=0x7f623c09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:51.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 -- 172.21.15.172:0/1754213333 shutdown_connections 2023-03-27T10:09:51.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.827+0000 7f62435ff700 1 -- 172.21.15.172:0/1754213333 wait complete. 2023-03-27T10:09:51.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.829+0000 7f62435ff700 1 Processor -- start 2023-03-27T10:09:51.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.830+0000 7f62435ff700 1 -- start start 2023-03-27T10:09:51.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f62435ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f623c0d3a30 0x7f623c14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:51.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f62435ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c15a240 0x7f623c15f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:51.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f62435ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 0x7f623c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:51.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f62435ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c14e980 con 0x7f623c1604b0 2023-03-27T10:09:51.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f62435ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c15ded0 con 0x7f623c0d3a30 2023-03-27T10:09:51.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f62435ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623c15e1b0 con 0x7f623c15a240 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f6241b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 0x7f623c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f624139b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f623c0d3a30 0x7f623c14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f6240b9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c15a240 0x7f623c15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f6241b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 0x7f623c157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55014/0 (socket says 172.21.15.172:55014) 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.831+0000 7f6241b9c700 1 -- 172.21.15.172:0/218643058 learned_addr learned my addr 172.21.15.172:0/218643058 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6241b9c700 1 -- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c15a240 msgr2=0x7f623c15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:51.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6241b9c700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c15a240 0x7f623c15f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6241b9c700 1 -- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f623c0d3a30 msgr2=0x7f623c14e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6241b9c700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f623c0d3a30 0x7f623c14e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6241b9c700 1 -- 172.21.15.172:0/218643058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238009550 con 0x7f623c1604b0 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6241b9c700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 0x7f623c157e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f623400cbc0 tx=0x7f623400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623400a9e0 con 0x7f623c1604b0 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623400ab40 con 0x7f623c1604b0 2023-03-27T10:09:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c0d2f50 con 0x7f623c1604b0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234007070 con 0x7f623c1604b0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.832+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c0d2c70 con 0x7f623c1604b0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.833+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c0d3230 con 0x7f623c1604b0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.834+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f6234019030 con 0x7f623c1604b0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.835+0000 7f6231ffb700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6220066e30 0x7f62200692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.835+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6234083cc0 con 0x7f623c1604b0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.836+0000 7f624139b700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6220066e30 0x7f62200692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:51.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.836+0000 7f624139b700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6220066e30 0x7f62200692e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6238009c40 tx=0x7f6238008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:51.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:51.840+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f623404b4f0 con 0x7f623c1604b0 2023-03-27T10:09:52.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.068+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f623c074300 con 0x7f623c1604b0 2023-03-27T10:09:52.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.079+0000 7f6231ffb700 1 -- 172.21.15.172:0/218643058 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6234017020 con 0x7f623c1604b0 2023-03-27T10:09:52.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.088+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6220066e30 msgr2=0x7f62200692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.088+0000 7f62435ff700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6220066e30 0x7f62200692e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6238009c40 tx=0x7f6238008030 comp rx=0 tx=0).stop 2023-03-27T10:09:52.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.088+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 msgr2=0x7f623c157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.088+0000 7f62435ff700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 0x7f623c157e90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f623400cbc0 tx=0x7f623400ced0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.094+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 shutdown_connections 2023-03-27T10:09:52.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.094+0000 7f62435ff700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f623c1604b0 0x7f623c157e90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.094+0000 7f62435ff700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6220066e30 0x7f62200692e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.094+0000 7f62435ff700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f623c0d3a30 0x7f623c14e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.094+0000 7f62435ff700 1 --2- 172.21.15.172:0/218643058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f623c15a240 0x7f623c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.094+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 >> 172.21.15.172:0/218643058 conn(0x7f623c0721f0 msgr2=0x7f623c0b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.098+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 shutdown_connections 2023-03-27T10:09:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.098+0000 7f62435ff700 1 -- 172.21.15.172:0/218643058 wait complete. 2023-03-27T10:09:52.102 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 3 and data pool 4 2023-03-27T10:09:52.121 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.306+0000 7f733cbff700 1 Processor -- start 2023-03-27T10:09:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.306+0000 7f733cbff700 1 -- start start 2023-03-27T10:09:52.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.307+0000 7f733cbff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f733815ca20 0x7f73380ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.307+0000 7f733cbff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73380cebc0 con 0x7f73380cd610 2023-03-27T10:09:52.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.307+0000 7f733cbff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73380ceea0 con 0x7f73380d0b90 2023-03-27T10:09:52.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.307+0000 7f733cbff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73380cf180 con 0x7f733815ca20 2023-03-27T10:09:52.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f7336d9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f73380cd610 0x7f73380b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56050/0 (socket says 172.21.15.172:56050) 2023-03-27T10:09:52.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f7336d9d700 1 -- 172.21.15.172:0/3175313890 learned_addr learned my addr 172.21.15.172:0/3175313890 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:52.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f732ffff700 1 --2- 172.21.15.172:0/3175313890 >> v2:172.21.15.191:3300/0 conn(0x7f733815ca20 0x7f73380ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234248118 0 0) 0x7f73380cebc0 con 0x7f73380cd610 2023-03-27T10:09:52.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73240035b0 con 0x7f73380cd610 2023-03-27T10:09:52.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611724299 0 0) 0x7f73380ceea0 con 0x7f73380d0b90 2023-03-27T10:09:52.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73380cebc0 con 0x7f73380d0b90 2023-03-27T10:09:52.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f732ffff700 1 -- 172.21.15.172:0/3175313890 >> v1:172.21.15.191:6789/0 conn(0x7f73380d0b90 legacy=0x7f73380d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f732ffff700 1 -- 172.21.15.172:0/3175313890 >> v1:172.21.15.172:6789/0 conn(0x7f73380cd610 legacy=0x7f73380b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.308+0000 7f732ffff700 1 -- 172.21.15.172:0/3175313890 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73380cf460 con 0x7f733815ca20 2023-03-27T10:09:52.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f732ffff700 1 --2- 172.21.15.172:0/3175313890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f733815ca20 0x7f73380ce500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7320009840 tx=0x7f7320009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7244c9f03b64c02 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:52.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011830 con 0x7f733815ca20 2023-03-27T10:09:52.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320011990 con 0x7f733815ca20 2023-03-27T10:09:52.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f7335d9b700 1 -- 172.21.15.172:0/3175313890 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011d20 con 0x7f733815ca20 2023-03-27T10:09:52.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 -- 172.21.15.172:0/3175313890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f733815ca20 msgr2=0x7f73380ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 --2- 172.21.15.172:0/3175313890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f733815ca20 0x7f73380ce500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7320009840 tx=0x7f7320009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:52.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 -- 172.21.15.172:0/3175313890 shutdown_connections 2023-03-27T10:09:52.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 --2- 172.21.15.172:0/3175313890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f733815ca20 0x7f73380ce500 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 -- 172.21.15.172:0/3175313890 >> 172.21.15.172:0/3175313890 conn(0x7f73380721f0 msgr2=0x7f733809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:52.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 -- 172.21.15.172:0/3175313890 shutdown_connections 2023-03-27T10:09:52.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.309+0000 7f733cbff700 1 -- 172.21.15.172:0/3175313890 wait complete. 2023-03-27T10:09:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.311+0000 7f733cbff700 1 Processor -- start 2023-03-27T10:09:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.311+0000 7f733cbff700 1 -- start start 2023-03-27T10:09:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f733cbff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73380cd610 0x7f733814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f733cbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73380d0b90 0x7f73380cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f733cbff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 0x7f73380cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f733cbff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73380ca750 con 0x7f733815ca20 2023-03-27T10:09:52.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f733cbff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338154600 con 0x7f73380cd610 2023-03-27T10:09:52.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f733cbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73381548e0 con 0x7f73380d0b90 2023-03-27T10:09:52.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f7336d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 0x7f73380cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f7336d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 0x7f73380cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55016/0 (socket says 172.21.15.172:55016) 2023-03-27T10:09:52.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.312+0000 7f7336d9d700 1 -- 172.21.15.172:0/4083210391 learned_addr learned my addr 172.21.15.172:0/4083210391 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f733659c700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73380cd610 0x7f733814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f732ffff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73380d0b90 0x7f73380cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f7336d9d700 1 -- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73380d0b90 msgr2=0x7f73380cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f7336d9d700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73380d0b90 0x7f73380cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f7336d9d700 1 -- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73380cd610 msgr2=0x7f733814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f7336d9d700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73380cd610 0x7f733814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f7336d9d700 1 -- 172.21.15.172:0/4083210391 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73200094a0 con 0x7f733815ca20 2023-03-27T10:09:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f7336d9d700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 0x7f73380cca50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f733000cba0 tx=0x7f733000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000ab20 con 0x7f733815ca20 2023-03-27T10:09:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733000ac80 con 0x7f733815ca20 2023-03-27T10:09:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330012400 con 0x7f733815ca20 2023-03-27T10:09:52.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73380d2d30 con 0x7f733815ca20 2023-03-27T10:09:52.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.313+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73380afc50 con 0x7f733815ca20 2023-03-27T10:09:52.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.314+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73380b0880 con 0x7f733815ca20 2023-03-27T10:09:52.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.315+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7330019030 con 0x7f733815ca20 2023-03-27T10:09:52.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.317+0000 7f732effd700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7318066e30 0x7f73180692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.317+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7330083f60 con 0x7f733815ca20 2023-03-27T10:09:52.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.317+0000 7f733659c700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7318066e30 0x7f73180692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.318+0000 7f733659c700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7318066e30 0x7f73180692e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7328001230 tx=0x7f7328009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:52.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.321+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f73300511a0 con 0x7f733815ca20 2023-03-27T10:09:52.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.510+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73380ca890 con 0x7f733815ca20 2023-03-27T10:09:52.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.511+0000 7f732effd700 1 -- 172.21.15.172:0/4083210391 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17968 (secure 0 0 0) 0x7f73380ca890 con 0x7f733815ca20 2023-03-27T10:09:52.510 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:52.511 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:52.069623+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7318066e30 msgr2=0x7f73180692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7318066e30 0x7f73180692e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7328001230 tx=0x7f7328009040 comp rx=0 tx=0).stop 2023-03-27T10:09:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 msgr2=0x7f73380cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 0x7f73380cca50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f733000cba0 tx=0x7f733000cf60 comp rx=0 tx=0).stop 2023-03-27T10:09:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 shutdown_connections 2023-03-27T10:09:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f733815ca20 0x7f73380cca50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7318066e30 0x7f73180692e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73380cd610 0x7f733814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 --2- 172.21.15.172:0/4083210391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73380d0b90 0x7f73380cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 >> 172.21.15.172:0/4083210391 conn(0x7f73380721f0 msgr2=0x7f733806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 shutdown_connections 2023-03-27T10:09:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.514+0000 7f733cbff700 1 -- 172.21.15.172:0/4083210391 wait complete. 2023-03-27T10:09:52.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:52.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.717+0000 7f68335ff700 1 Processor -- start 2023-03-27T10:09:52.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.717+0000 7f68335ff700 1 -- start start 2023-03-27T10:09:52.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.718+0000 7f68335ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f682c0d0b90 0x7f682c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.718+0000 7f68335ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0cebc0 con 0x7f682c15ca20 2023-03-27T10:09:52.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.718+0000 7f68335ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0ceea0 con 0x7f682c0cd610 2023-03-27T10:09:52.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.718+0000 7f68335ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c0cf180 con 0x7f682c0d0b90 2023-03-27T10:09:52.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f682c0d0b90 0x7f682c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f682c0d0b90 0x7f682c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55026/0 (socket says 172.21.15.172:55026) 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 -- 172.21.15.172:0/972791900 learned_addr learned my addr 172.21.15.172:0/972791900 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f6830b9a700 1 --1- 172.21.15.172:0/972791900 >> v1:172.21.15.172:6789/0 conn(0x7f682c15ca20 0x7f682c0d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56056/0 (socket says 172.21.15.172:56056) 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 -- 172.21.15.172:0/972791900 >> v1:172.21.15.191:6789/0 conn(0x7f682c0cd610 legacy=0x7f682c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 -- 172.21.15.172:0/972791900 >> v1:172.21.15.172:6789/0 conn(0x7f682c15ca20 legacy=0x7f682c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f6823fff700 1 -- 172.21.15.172:0/972791900 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639747479 0 0) 0x7f682c0cebc0 con 0x7f682c15ca20 2023-03-27T10:09:52.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 -- 172.21.15.172:0/972791900 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0cf460 con 0x7f682c0d0b90 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.719+0000 7f683139b700 1 --2- 172.21.15.172:0/972791900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0d0b90 0x7f682c0ce500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6828006fd0 tx=0x7f6828009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c41318a27666da server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f6823fff700 1 -- 172.21.15.172:0/972791900 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828005e30 con 0x7f682c0d0b90 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f6823fff700 1 -- 172.21.15.172:0/972791900 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6828004030 con 0x7f682c0d0b90 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f6823fff700 1 -- 172.21.15.172:0/972791900 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68280043e0 con 0x7f682c0d0b90 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 -- 172.21.15.172:0/972791900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0d0b90 msgr2=0x7f682c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 --2- 172.21.15.172:0/972791900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0d0b90 0x7f682c0ce500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6828006fd0 tx=0x7f6828009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 -- 172.21.15.172:0/972791900 shutdown_connections 2023-03-27T10:09:52.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 --2- 172.21.15.172:0/972791900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0d0b90 0x7f682c0ce500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 -- 172.21.15.172:0/972791900 >> 172.21.15.172:0/972791900 conn(0x7f682c0721f0 msgr2=0x7f682c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:52.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 -- 172.21.15.172:0/972791900 shutdown_connections 2023-03-27T10:09:52.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.720+0000 7f68335ff700 1 -- 172.21.15.172:0/972791900 wait complete. 2023-03-27T10:09:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.722+0000 7f68335ff700 1 Processor -- start 2023-03-27T10:09:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.722+0000 7f68335ff700 1 -- start start 2023-03-27T10:09:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f68335ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 0x7f682c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f68335ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0d0b90 0x7f682c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f68335ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c15ca20 0x7f682c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f68335ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0b4880 con 0x7f682c0cd610 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f68335ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0b4b60 con 0x7f682c0d0b90 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f68335ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0b4e40 con 0x7f682c15ca20 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f683139b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 0x7f682c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f683139b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 0x7f682c15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55042/0 (socket says 172.21.15.172:55042) 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.723+0000 7f683139b700 1 -- 172.21.15.172:0/489133735 learned_addr learned my addr 172.21.15.172:0/489133735 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f683139b700 1 -- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c15ca20 msgr2=0x7f682c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f683139b700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c15ca20 0x7f682c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f683139b700 1 -- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0d0b90 msgr2=0x7f682c0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f683139b700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0d0b90 0x7f682c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f683139b700 1 -- 172.21.15.172:0/489133735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009500 con 0x7f682c0cd610 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f683139b700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 0x7f682c15b570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6828009c10 tx=0x7f6828004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828011620 con 0x7f682c0cd610 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6828011780 con 0x7f682c0cd610 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0d2d30 con 0x7f682c0cd610 2023-03-27T10:09:52.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828011b30 con 0x7f682c0cd610 2023-03-27T10:09:52.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.724+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c0afc50 con 0x7f682c0cd610 2023-03-27T10:09:52.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.725+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c074290 con 0x7f682c0cd610 2023-03-27T10:09:52.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.726+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f682802c070 con 0x7f682c0cd610 2023-03-27T10:09:52.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.727+0000 7f6821ffb700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e60 0x7f6810069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:52.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.727+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6828085500 con 0x7f682c0cd610 2023-03-27T10:09:52.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.728+0000 7f6830b9a700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e60 0x7f6810069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:52.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.729+0000 7f6830b9a700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e60 0x7f6810069310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f681c000c00 tx=0x7f681c007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:52.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.732+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f6828052740 con 0x7f682c0cd610 2023-03-27T10:09:52.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.923+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f682c0b07d0 con 0x7f682c0cd610 2023-03-27T10:09:52.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.924+0000 7f6821ffb700 1 -- 172.21.15.172:0/489133735 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17968 (secure 0 0 0) 0x7f6828055d60 con 0x7f682c0cd610 2023-03-27T10:09:52.923 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:52.923 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:52.069623+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:52.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.926+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e60 msgr2=0x7f6810069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.926+0000 7f68335ff700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e60 0x7f6810069310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f681c000c00 tx=0x7f681c007a50 comp rx=0 tx=0).stop 2023-03-27T10:09:52.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.926+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 msgr2=0x7f682c15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:52.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.926+0000 7f68335ff700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 0x7f682c15b570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6828009c10 tx=0x7f6828004750 comp rx=0 tx=0).stop 2023-03-27T10:09:52.926 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 shutdown_connections 2023-03-27T10:09:52.926 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c15ca20 0x7f682c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c0cd610 0x7f682c15b570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e60 0x7f6810069310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 --2- 172.21.15.172:0/489133735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0d0b90 0x7f682c0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:52.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 >> 172.21.15.172:0/489133735 conn(0x7f682c0721f0 msgr2=0x7f682c0b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:52.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 shutdown_connections 2023-03-27T10:09:52.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:52.927+0000 7f68335ff700 1 -- 172.21.15.172:0/489133735 wait complete. 2023-03-27T10:09:52.943 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-27T10:09:53.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.133+0000 7fdcac7ff700 1 Processor -- start 2023-03-27T10:09:53.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.133+0000 7fdcac7ff700 1 -- start start 2023-03-27T10:09:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcac7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cff20 0x7fdca41675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcac7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40cdbf0 con 0x7fdca415c520 2023-03-27T10:09:53.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcac7ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40cd5e0 con 0x7fdca40d11d0 2023-03-27T10:09:53.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcac7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40d2e80 con 0x7fdca40cff20 2023-03-27T10:09:53.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcaa59b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdca415c520 0x7fdca40d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56060/0 (socket says 172.21.15.172:56060) 2023-03-27T10:09:53.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcaa59b700 1 -- 172.21.15.172:0/1852435774 learned_addr learned my addr 172.21.15.172:0/1852435774 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:53.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdcaad9c700 1 --2- 172.21.15.172:0/1852435774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cff20 0x7fdca41675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752640247 0 0) 0x7fdca40cdbf0 con 0x7fdca415c520 2023-03-27T10:09:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.135+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc900035b0 con 0x7fdca415c520 2023-03-27T10:09:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456471017 0 0) 0x7fdca40cd5e0 con 0x7fdca40d11d0 2023-03-27T10:09:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca40cdbf0 con 0x7fdca40d11d0 2023-03-27T10:09:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061059816 0 0) 0x7fdc900035b0 con 0x7fdca415c520 2023-03-27T10:09:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdcaad9c700 1 -- 172.21.15.172:0/1852435774 >> v1:172.21.15.191:6789/0 conn(0x7fdca40d11d0 legacy=0x7fdca40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdcaad9c700 1 -- 172.21.15.172:0/1852435774 >> v1:172.21.15.172:6789/0 conn(0x7fdca415c520 legacy=0x7fdca40d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdcaad9c700 1 -- 172.21.15.172:0/1852435774 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40d0420 con 0x7fdca40cff20 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdcaad9c700 1 --2- 172.21.15.172:0/1852435774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cff20 0x7fdca41675a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009dc0 tx=0x7fdc9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44dd1bf20d383730 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00e070 con 0x7fdca40cff20 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c003a20 con 0x7fdca40cff20 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.136+0000 7fdca9599700 1 -- 172.21.15.172:0/1852435774 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0001670 con 0x7fdca40cff20 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 -- 172.21.15.172:0/1852435774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cff20 msgr2=0x7fdca41675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/1852435774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cff20 0x7fdca41675a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009dc0 tx=0x7fdc9c00b330 comp rx=0 tx=0).stop 2023-03-27T10:09:53.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 -- 172.21.15.172:0/1852435774 shutdown_connections 2023-03-27T10:09:53.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/1852435774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cff20 0x7fdca41675a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:53.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 -- 172.21.15.172:0/1852435774 >> 172.21.15.172:0/1852435774 conn(0x7fdca40721f0 msgr2=0x7fdca409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:53.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 -- 172.21.15.172:0/1852435774 shutdown_connections 2023-03-27T10:09:53.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.137+0000 7fdcac7ff700 1 -- 172.21.15.172:0/1852435774 wait complete. 2023-03-27T10:09:53.140 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.138+0000 7fdcac7ff700 1 Processor -- start 2023-03-27T10:09:53.140 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.139+0000 7fdcac7ff700 1 -- start start 2023-03-27T10:09:53.140 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.139+0000 7fdcac7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca40cff20 0x7fdca41f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:53.140 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcac7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 0x7fdca41f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:53.140 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcac7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca415c520 0x7fdca40c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcac7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41f5870 con 0x7fdca40d11d0 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcac7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41f5af0 con 0x7fdca40cff20 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcac7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41f5dd0 con 0x7fdca415c520 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 0x7fdca41f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 0x7fdca41f5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55050/0 (socket says 172.21.15.172:55050) 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 -- 172.21.15.172:0/2894088795 learned_addr learned my addr 172.21.15.172:0/2894088795 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcaa59b700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca40cff20 0x7fdca41f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdcaad9c700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca415c520 0x7fdca40c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 -- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca415c520 msgr2=0x7fdca40c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca415c520 0x7fdca40c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 -- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca40cff20 msgr2=0x7fdca41f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca40cff20 0x7fdca41f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 -- 172.21.15.172:0/2894088795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009a70 con 0x7fdca40d11d0 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.140+0000 7fdca9d9a700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 0x7fdca41f5330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c4f0 tx=0x7fdc9400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.141+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940052d0 con 0x7fdca40d11d0 2023-03-27T10:09:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.141+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94005430 con 0x7fdca40d11d0 2023-03-27T10:09:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.141+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca40d0700 con 0x7fdca40d11d0 2023-03-27T10:09:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.141+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94003880 con 0x7fdca40d11d0 2023-03-27T10:09:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.141+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca40cd880 con 0x7fdca40d11d0 2023-03-27T10:09:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.142+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca415c8f0 con 0x7fdca40d11d0 2023-03-27T10:09:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.143+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fdc94019030 con 0x7fdca40d11d0 2023-03-27T10:09:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.143+0000 7fdc9affd700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdc88066e30 0x7fdc880692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.144+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc94083460 con 0x7fdca40d11d0 2023-03-27T10:09:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.144+0000 7fdcaa59b700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdc88066e30 0x7fdc880692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.145+0000 7fdcaa59b700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdc88066e30 0x7fdc880692e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000f60 tx=0x7fdca0001670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:53.145 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.147+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fdc9404b4f0 con 0x7fdca40d11d0 2023-03-27T10:09:53.379 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:53.380+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdca4074300 con 0x7fdca40d11d0 2023-03-27T10:09:54.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.095+0000 7fdc9affd700 1 -- 172.21.15.172:0/2894088795 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdc94050750 con 0x7fdca40d11d0 2023-03-27T10:09:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdc88066e30 msgr2=0x7fdc880692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdc88066e30 0x7fdc880692e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000f60 tx=0x7fdca0001670 comp rx=0 tx=0).stop 2023-03-27T10:09:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 msgr2=0x7fdca41f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 0x7fdca41f5330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c4f0 tx=0x7fdc9400c800 comp rx=0 tx=0).stop 2023-03-27T10:09:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 shutdown_connections 2023-03-27T10:09:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca415c520 0x7fdca40c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdc88066e30 0x7fdc880692e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca40cff20 0x7fdca41f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 --2- 172.21.15.172:0/2894088795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40d11d0 0x7fdca41f5330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.097+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 >> 172.21.15.172:0/2894088795 conn(0x7fdca40721f0 msgr2=0x7fdca40b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.098+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 shutdown_connections 2023-03-27T10:09:54.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.098+0000 7fdcac7ff700 1 -- 172.21.15.172:0/2894088795 wait complete. 2023-03-27T10:09:54.114 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-27T10:09:54.115 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-27T10:09:54.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.303+0000 7f842adff700 1 Processor -- start 2023-03-27T10:09:54.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.304+0000 7f842adff700 1 -- start start 2023-03-27T10:09:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f842adff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f842415a240 0x7f84240d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f842adff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 0x7f84240d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f842adff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84240d29d0 con 0x7f84240d3a30 2023-03-27T10:09:54.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f842adff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8424161200 con 0x7f842415a240 2023-03-27T10:09:54.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f842adff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842415a610 con 0x7f8424160bc0 2023-03-27T10:09:54.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f8423fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f84240d3a30 0x7f84241604b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56064/0 (socket says 172.21.15.172:56064) 2023-03-27T10:09:54.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f8423fff700 1 -- 172.21.15.172:0/1616430270 learned_addr learned my addr 172.21.15.172:0/1616430270 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:54.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f8428b9b700 1 --2- 172.21.15.172:0/1616430270 >> v2:172.21.15.191:3300/0 conn(0x7f842415a240 0x7f84240d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f842939c700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 0x7f84240d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194984425 0 0) 0x7f84240d29d0 con 0x7f84240d3a30 2023-03-27T10:09:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84140035b0 con 0x7f84240d3a30 2023-03-27T10:09:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.305+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747728497 0 0) 0x7f84140035b0 con 0x7f84240d3a30 2023-03-27T10:09:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 msgr2=0x7f84240d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 0x7f84240d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 >> v2:172.21.15.191:3300/0 conn(0x7f842415a240 msgr2=0x7f84240d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 --2- 172.21.15.172:0/1616430270 >> v2:172.21.15.191:3300/0 conn(0x7f842415a240 0x7f84240d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240d2c70 con 0x7f84240d3a30 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7f8410001670 con 0x7f84240d3a30 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 >> v1:172.21.15.172:6789/0 conn(0x7f84240d3a30 legacy=0x7f84241604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 0x7f8414003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414003f80 0x7f8414004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8414004d90 0x7f8414005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8424161200 con 0x7f8414003f80 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842415a610 con 0x7f8414004d90 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841400ba40 con 0x7f8424160bc0 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8423fff700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414003f80 0x7f8414004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8428b9b700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 0x7f8414003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f842939c700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8414004d90 0x7f8414005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8423fff700 1 -- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 msgr2=0x7f8414003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8423fff700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8424160bc0 0x7f8414003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8423fff700 1 -- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8414004d90 msgr2=0x7f8414005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8423fff700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8414004d90 0x7f8414005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f8423fff700 1 -- 172.21.15.172:0/1616430270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84140035b0 con 0x7f8414003f80 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.306+0000 7f842939c700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8414004d90 0x7f8414005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f8423fff700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414003f80 0x7f8414004850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f841000c370 tx=0x7f8414005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b818c78fe6a0be server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410007c60 con 0x7f8414003f80 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8410005960 con 0x7f8414003f80 2023-03-27T10:09:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f84237fe700 1 -- 172.21.15.172:0/1616430270 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410005d10 con 0x7f8414003f80 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f842adff700 1 -- 172.21.15.172:0/1616430270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414003f80 msgr2=0x7f8414004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f842adff700 1 --2- 172.21.15.172:0/1616430270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8414003f80 0x7f8414004850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f841000c370 tx=0x7f8414005880 comp rx=0 tx=0).stop 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f842939c700 1 -- 172.21.15.172:0/1616430270 reap_dead start 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f842adff700 1 -- 172.21.15.172:0/1616430270 shutdown_connections 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f842adff700 1 -- 172.21.15.172:0/1616430270 >> 172.21.15.172:0/1616430270 conn(0x7f84240721f0 msgr2=0x7f842409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.307+0000 7f842adff700 1 -- 172.21.15.172:0/1616430270 shutdown_connections 2023-03-27T10:09:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.308+0000 7f842adff700 1 -- 172.21.15.172:0/1616430270 wait complete. 2023-03-27T10:09:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.309+0000 7f842adff700 1 Processor -- start 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.309+0000 7f842adff700 1 -- start start 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f842adff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8414003f80 0x7f842415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f842adff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 0x7f8424157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f842adff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84240c73e0 0x7f842415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f842adff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842415b720 con 0x7f84240b7fb0 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f842adff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84240b7a70 con 0x7f84240c73e0 2023-03-27T10:09:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f842adff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842415ae80 con 0x7f8414003f80 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f8423fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 0x7f8424157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f8423fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 0x7f8424157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55060/0 (socket says 172.21.15.172:55060) 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.310+0000 7f8423fff700 1 -- 172.21.15.172:0/838979002 learned_addr learned my addr 172.21.15.172:0/838979002 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8428b9b700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8414003f80 0x7f842415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f842939c700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84240c73e0 0x7f842415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8423fff700 1 -- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8414003f80 msgr2=0x7f842415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8423fff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8414003f80 0x7f842415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8423fff700 1 -- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84240c73e0 msgr2=0x7f842415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8423fff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84240c73e0 0x7f842415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8423fff700 1 -- 172.21.15.172:0/838979002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240d3230 con 0x7f84240b7fb0 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f8423fff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 0x7f8424157440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8410011000 tx=0x7f8410000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410004870 con 0x7f84240b7fb0 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84100049d0 con 0x7f84240b7fb0 2023-03-27T10:09:54.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410004d60 con 0x7f84240b7fb0 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.311+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84240d2f50 con 0x7f84240b7fb0 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.312+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84240d3510 con 0x7f84240b7fb0 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.312+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8424074300 con 0x7f84240b7fb0 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.313+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f8410024030 con 0x7f84240b7fb0 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.314+0000 7f84217fa700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8408066e30 0x7f84080692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.314+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8410085570 con 0x7f84240b7fb0 2023-03-27T10:09:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.315+0000 7f8428b9b700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8408066e30 0x7f84080692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:54.318 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.315+0000 7f8428b9b700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8408066e30 0x7f84080692e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f842415f9b0 tx=0x7f841800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:54.318 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.318+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f84100527b0 con 0x7f84240b7fb0 2023-03-27T10:09:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:54.550+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f84241609a0 con 0x7f84240b7fb0 2023-03-27T10:09:55.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.099+0000 7f84217fa700 1 -- 172.21.15.172:0/838979002 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8410007dc0 con 0x7f84240b7fb0 2023-03-27T10:09:55.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.101+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8408066e30 msgr2=0x7f84080692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.101+0000 7f842adff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8408066e30 0x7f84080692e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f842415f9b0 tx=0x7f841800b040 comp rx=0 tx=0).stop 2023-03-27T10:09:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.101+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 msgr2=0x7f8424157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.101+0000 7f842adff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 0x7f8424157440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8410011000 tx=0x7f8410000fe0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 shutdown_connections 2023-03-27T10:09:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8408066e30 0x7f84080692e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84240c73e0 0x7f842415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8414003f80 0x7f842415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 --2- 172.21.15.172:0/838979002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84240b7fb0 0x7f8424157440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 >> 172.21.15.172:0/838979002 conn(0x7f84240721f0 msgr2=0x7f84240b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:55.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 shutdown_connections 2023-03-27T10:09:55.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.102+0000 7f842adff700 1 -- 172.21.15.172:0/838979002 wait complete. 2023-03-27T10:09:55.118 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-27T10:09:55.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:09:55.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.304+0000 7f34ed5ff700 1 Processor -- start 2023-03-27T10:09:55.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.304+0000 7f34ed5ff700 1 -- start start 2023-03-27T10:09:55.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34ed5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80d0b90 0x7f34e80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34ed5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f34e815ca20 0x7f34e80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34ed5ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80d14a0 con 0x7f34e80cd610 2023-03-27T10:09:55.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34ed5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80cebc0 con 0x7f34e815ca20 2023-03-27T10:09:55.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34ed5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80ceea0 con 0x7f34e80d0b90 2023-03-27T10:09:55.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34e67fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f34e815ca20 0x7f34e80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34e67fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f34e815ca20 0x7f34e80d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55074/0 (socket says 172.21.15.172:55074) 2023-03-27T10:09:55.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34e67fc700 1 -- 172.21.15.172:0/3590362012 learned_addr learned my addr 172.21.15.172:0/3590362012 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:55.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34e77fe700 1 --1- 172.21.15.172:0/3590362012 >> v1:172.21.15.172:6789/0 conn(0x7f34e80cd610 0x7f34e80cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56074/0 (socket says 172.21.15.172:56074) 2023-03-27T10:09:55.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.306+0000 7f34e6ffd700 1 --2- 172.21.15.172:0/3590362012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80d0b90 0x7f34e80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e67fc700 1 -- 172.21.15.172:0/3590362012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80d0b90 msgr2=0x7f34e80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:55.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e67fc700 1 --2- 172.21.15.172:0/3590362012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80d0b90 0x7f34e80ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e67fc700 1 -- 172.21.15.172:0/3590362012 >> v1:172.21.15.172:6789/0 conn(0x7f34e80cd610 legacy=0x7f34e80cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e67fc700 1 -- 172.21.15.172:0/3590362012 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80cf180 con 0x7f34e815ca20 2023-03-27T10:09:55.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e5ffb700 1 -- 172.21.15.172:0/3590362012 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512457717 0 0) 0x7f34e80d14a0 con 0x7f34e80cd610 2023-03-27T10:09:55.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e67fc700 1 --2- 172.21.15.172:0/3590362012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e815ca20 0x7f34e80d0f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0098f0 tx=0x7f34dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c258395f52f8289 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:55.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e5ffb700 1 -- 172.21.15.172:0/3590362012 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00b8a0 con 0x7f34e815ca20 2023-03-27T10:09:55.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e5ffb700 1 -- 172.21.15.172:0/3590362012 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00ba00 con 0x7f34e815ca20 2023-03-27T10:09:55.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.307+0000 7f34e5ffb700 1 -- 172.21.15.172:0/3590362012 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00bd90 con 0x7f34e815ca20 2023-03-27T10:09:55.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 -- 172.21.15.172:0/3590362012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e815ca20 msgr2=0x7f34e80d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/3590362012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e815ca20 0x7f34e80d0f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0098f0 tx=0x7f34dc009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 -- 172.21.15.172:0/3590362012 shutdown_connections 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/3590362012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80d0b90 0x7f34e80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/3590362012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e815ca20 0x7f34e80d0f60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 -- 172.21.15.172:0/3590362012 >> 172.21.15.172:0/3590362012 conn(0x7f34e80721f0 msgr2=0x7f34e809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 -- 172.21.15.172:0/3590362012 shutdown_connections 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.308+0000 7f34ed5ff700 1 -- 172.21.15.172:0/3590362012 wait complete. 2023-03-27T10:09:55.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.309+0000 7f34ed5ff700 1 Processor -- start 2023-03-27T10:09:55.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 -- start start 2023-03-27T10:09:55.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80cd610 0x7f34e8157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 0x7f34e80cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34e815ca20 0x7f34e815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8157740 con 0x7f34e80d0b90 2023-03-27T10:09:55.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80cb690 con 0x7f34e815ca20 2023-03-27T10:09:55.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.310+0000 7f34ed5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80ccec0 con 0x7f34e80cd610 2023-03-27T10:09:55.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 0x7f34e80cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 0x7f34e80cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55078/0 (socket says 172.21.15.172:55078) 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 -- 172.21.15.172:0/731080359 learned_addr learned my addr 172.21.15.172:0/731080359 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e6ffd700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80cd610 0x7f34e8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e77fe700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34e815ca20 0x7f34e815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 -- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80cd610 msgr2=0x7f34e8157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80cd610 0x7f34e8157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 -- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34e815ca20 msgr2=0x7f34e815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34e815ca20 0x7f34e815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 -- 172.21.15.172:0/731080359 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc009550 con 0x7f34e80d0b90 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34e67fc700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 0x7f34e80cc980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34dc013000 tx=0x7f34dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.311+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0036a0 con 0x7f34e80d0b90 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.312+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc003800 con 0x7f34e80d0b90 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.312+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc003bb0 con 0x7f34e80d0b90 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.312+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e80afc50 con 0x7f34e80d0b90 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.312+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80cf460 con 0x7f34e80d0b90 2023-03-27T10:09:55.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.313+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e80d2d30 con 0x7f34e80d0b90 2023-03-27T10:09:55.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.313+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f34dc02a020 con 0x7f34e80d0b90 2023-03-27T10:09:55.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.314+0000 7f34cf7fe700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f34d4066e60 0x7f34d4069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.314+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34dc0857f0 con 0x7f34e80d0b90 2023-03-27T10:09:55.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.315+0000 7f34e6ffd700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f34d4066e60 0x7f34d4069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.315+0000 7f34e6ffd700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f34d4066e60 0x7f34d4069310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006fd0 tx=0x7f34d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:55.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.319+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f34dc0529d0 con 0x7f34e80d0b90 2023-03-27T10:09:55.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.547+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34e8074290 con 0x7f34e80d0b90 2023-03-27T10:09:55.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.547+0000 7f34cf7fe700 1 -- 172.21.15.172:0/731080359 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4624 (secure 0 0 0) 0x7f34dc055ff0 con 0x7f34e80d0b90 2023-03-27T10:09:55.546 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:55.546 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:09:52.070050+0000","modified":"2023-03-27T10:09:55.094484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-27T10:09:55.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f34d4066e60 msgr2=0x7f34d4069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f34d4066e60 0x7f34d4069310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006fd0 tx=0x7f34d8008040 comp rx=0 tx=0).stop 2023-03-27T10:09:55.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 msgr2=0x7f34e80cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 0x7f34e80cc980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34dc013000 tx=0x7f34dc004750 comp rx=0 tx=0).stop 2023-03-27T10:09:55.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 shutdown_connections 2023-03-27T10:09:55.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f34d4066e60 0x7f34d4069310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34e815ca20 0x7f34e815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34e80cd610 0x7f34e8157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 --2- 172.21.15.172:0/731080359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34e80d0b90 0x7f34e80cc980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 >> 172.21.15.172:0/731080359 conn(0x7f34e80721f0 msgr2=0x7f34e806ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:55.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 shutdown_connections 2023-03-27T10:09:55.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.549+0000 7f34ed5ff700 1 -- 172.21.15.172:0/731080359 wait complete. 2023-03-27T10:09:55.551 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2023-03-27T10:09:55.566 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:55.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.753+0000 7f69e4bff700 1 Processor -- start 2023-03-27T10:09:55.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.753+0000 7f69e4bff700 1 -- start start 2023-03-27T10:09:55.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69e4bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f69e00d0b90 0x7f69e00ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69e4bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69e015ca20 0x7f69e00d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69e4bff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00d14a0 con 0x7f69e00cd610 2023-03-27T10:09:55.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69e4bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e00cebc0 con 0x7f69e015ca20 2023-03-27T10:09:55.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69e4bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e00ceea0 con 0x7f69e00d0b90 2023-03-27T10:09:55.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69e015ca20 0x7f69e00d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69e015ca20 0x7f69e00d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55090/0 (socket says 172.21.15.172:55090) 2023-03-27T10:09:55.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 -- 172.21.15.172:0/1406692432 learned_addr learned my addr 172.21.15.172:0/1406692432 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:55.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69de59c700 1 --2- 172.21.15.172:0/1406692432 >> v2:172.21.15.191:3300/0 conn(0x7f69e00d0b90 0x7f69e00ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 -- 172.21.15.172:0/1406692432 >> v2:172.21.15.191:3300/0 conn(0x7f69e00d0b90 msgr2=0x7f69e00ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:55.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 --2- 172.21.15.172:0/1406692432 >> v2:172.21.15.191:3300/0 conn(0x7f69e00d0b90 0x7f69e00ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 -- 172.21.15.172:0/1406692432 >> v1:172.21.15.191:6789/0 conn(0x7f69e00cd610 legacy=0x7f69e00cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69d7fff700 1 -- 172.21.15.172:0/1406692432 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00cf180 con 0x7f69e015ca20 2023-03-27T10:09:55.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.755+0000 7f69de59c700 1 --2- 172.21.15.172:0/1406692432 >> v2:172.21.15.191:3300/0 conn(0x7f69e00d0b90 0x7f69e00ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:55.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69d7fff700 1 --2- 172.21.15.172:0/1406692432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e015ca20 0x7f69e00d0f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69e008c260 tx=0x7f69c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dead0104e5b03cc server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:55.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69ddd9b700 1 -- 172.21.15.172:0/1406692432 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800b870 con 0x7f69e015ca20 2023-03-27T10:09:55.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69ddd9b700 1 -- 172.21.15.172:0/1406692432 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c800b9d0 con 0x7f69e015ca20 2023-03-27T10:09:55.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69ddd9b700 1 -- 172.21.15.172:0/1406692432 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800bd60 con 0x7f69e015ca20 2023-03-27T10:09:55.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69e4bff700 1 -- 172.21.15.172:0/1406692432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e015ca20 msgr2=0x7f69e00d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69e4bff700 1 --2- 172.21.15.172:0/1406692432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e015ca20 0x7f69e00d0f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69e008c260 tx=0x7f69c8009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69e4bff700 1 -- 172.21.15.172:0/1406692432 shutdown_connections 2023-03-27T10:09:55.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69e4bff700 1 --2- 172.21.15.172:0/1406692432 >> v2:172.21.15.191:3300/0 conn(0x7f69e00d0b90 0x7f69e00ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69e4bff700 1 --2- 172.21.15.172:0/1406692432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e015ca20 0x7f69e00d0f60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.756+0000 7f69e4bff700 1 -- 172.21.15.172:0/1406692432 >> 172.21.15.172:0/1406692432 conn(0x7f69e00721f0 msgr2=0x7f69e009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:55.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.757+0000 7f69e4bff700 1 -- 172.21.15.172:0/1406692432 shutdown_connections 2023-03-27T10:09:55.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.757+0000 7f69e4bff700 1 -- 172.21.15.172:0/1406692432 wait complete. 2023-03-27T10:09:55.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.758+0000 7f69e4bff700 1 Processor -- start 2023-03-27T10:09:55.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.758+0000 7f69e4bff700 1 -- start start 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69e4bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 0x7f69e00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69e4bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69e00d0b90 0x7f69e00c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69e4bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69e015ca20 0x7f69e00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69e4bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00c99b0 con 0x7f69e00cd610 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69e4bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00cb5c0 con 0x7f69e00d0b90 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69e4bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00cb8a0 con 0x7f69e015ca20 2023-03-27T10:09:55.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69de59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 0x7f69e00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69de59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 0x7f69e00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55100/0 (socket says 172.21.15.172:55100) 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.759+0000 7f69de59c700 1 -- 172.21.15.172:0/2718606526 learned_addr learned my addr 172.21.15.172:0/2718606526 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69d7fff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69e00d0b90 0x7f69e00c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69ded9d700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69e015ca20 0x7f69e00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69de59c700 1 -- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69e015ca20 msgr2=0x7f69e00b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69de59c700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69e015ca20 0x7f69e00b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69de59c700 1 -- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69e00d0b90 msgr2=0x7f69e00c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69de59c700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69e00d0b90 0x7f69e00c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69de59c700 1 -- 172.21.15.172:0/2718606526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c8009550 con 0x7f69e00cd610 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69d7fff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69e00d0b90 0x7f69e00c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69de59c700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 0x7f69e00cc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69d000e810 tx=0x7f69d000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0005c20 con 0x7f69e00cd610 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0005d80 con 0x7f69e00cd610 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0006230 con 0x7f69e00cd610 2023-03-27T10:09:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.760+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e00afc50 con 0x7f69e00cd610 2023-03-27T10:09:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.761+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e00cf460 con 0x7f69e00cd610 2023-03-27T10:09:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.761+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e00d2d30 con 0x7f69e00cd610 2023-03-27T10:09:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.762+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f69d0022070 con 0x7f69e00cd610 2023-03-27T10:09:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.763+0000 7f69d6ffd700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f69c0066e30 0x7f69c00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.763+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69d0083e50 con 0x7f69e00cd610 2023-03-27T10:09:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.764+0000 7f69d7fff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f69c0066e30 0x7f69c00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.764+0000 7f69d7fff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f69c0066e30 0x7f69c00692e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69c8000c00 tx=0x7f69c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.767+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f69d0050fa0 con 0x7f69e00cd610 2023-03-27T10:09:55.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.957+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69e00cc4b0 con 0x7f69e00cd610 2023-03-27T10:09:55.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.958+0000 7f69d6ffd700 1 -- 172.21.15.172:0/2718606526 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f69d0085090 con 0x7f69e00cd610 2023-03-27T10:09:55.957 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:55.957 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:55.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f69c0066e30 msgr2=0x7f69c00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f69c0066e30 0x7f69c00692e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69c8000c00 tx=0x7f69c8008030 comp rx=0 tx=0).stop 2023-03-27T10:09:55.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 msgr2=0x7f69e00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:55.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 0x7f69e00cc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69d000e810 tx=0x7f69d000ebd0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 shutdown_connections 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69e015ca20 0x7f69e00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e00cd610 0x7f69e00cc660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f69c0066e30 0x7f69c00692e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 --2- 172.21.15.172:0/2718606526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69e00d0b90 0x7f69e00c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 >> 172.21.15.172:0/2718606526 conn(0x7f69e00721f0 msgr2=0x7f69e009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.960+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 shutdown_connections 2023-03-27T10:09:55.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:55.961+0000 7f69e4bff700 1 -- 172.21.15.172:0/2718606526 wait complete. 2023-03-27T10:09:55.976 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-27T10:09:55.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-27T10:09:56.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.163+0000 7f02efdff700 1 Processor -- start 2023-03-27T10:09:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.163+0000 7f02efdff700 1 -- start start 2023-03-27T10:09:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.164+0000 7f02efdff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02e80cd610 0x7f02e80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.164+0000 7f02efdff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80cebc0 con 0x7f02e815ca20 2023-03-27T10:09:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.164+0000 7f02efdff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e80ceea0 con 0x7f02e80d0b90 2023-03-27T10:09:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.164+0000 7f02efdff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80cf180 con 0x7f02e80cd610 2023-03-27T10:09:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ed39a700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f02e815ca20 0x7f02e80b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52998/0 (socket says 172.21.15.172:52998) 2023-03-27T10:09:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ed39a700 1 -- 172.21.15.172:0/3125556441 learned_addr learned my addr 172.21.15.172:0/3125556441 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ee39c700 1 --2- 172.21.15.172:0/3125556441 >> v2:172.21.15.172:3300/0 conn(0x7f02e80cd610 0x7f02e80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ee39c700 1 -- 172.21.15.172:0/3125556441 >> v1:172.21.15.191:6789/0 conn(0x7f02e80d0b90 legacy=0x7f02e80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ee39c700 1 -- 172.21.15.172:0/3125556441 >> v1:172.21.15.172:6789/0 conn(0x7f02e815ca20 legacy=0x7f02e80b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ee39c700 1 -- 172.21.15.172:0/3125556441 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80cf460 con 0x7f02e80cd610 2023-03-27T10:09:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ee39c700 1 --2- 172.21.15.172:0/3125556441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e80ce500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a329b797865d11 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.165+0000 7f02ecb99700 1 -- 172.21.15.172:0/3125556441 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000e070 con 0x7f02e80cd610 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02ecb99700 1 -- 172.21.15.172:0/3125556441 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000bb90 con 0x7f02e80cd610 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02ecb99700 1 -- 172.21.15.172:0/3125556441 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0003a20 con 0x7f02e80cd610 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 -- 172.21.15.172:0/3125556441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 msgr2=0x7f02e80ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 --2- 172.21.15.172:0/3125556441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e80ce500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d90 tx=0x7f02e000b330 comp rx=0 tx=0).stop 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 -- 172.21.15.172:0/3125556441 shutdown_connections 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 --2- 172.21.15.172:0/3125556441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e80ce500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 -- 172.21.15.172:0/3125556441 >> 172.21.15.172:0/3125556441 conn(0x7f02e80721f0 msgr2=0x7f02e809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 -- 172.21.15.172:0/3125556441 shutdown_connections 2023-03-27T10:09:56.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.166+0000 7f02efdff700 1 -- 172.21.15.172:0/3125556441 wait complete. 2023-03-27T10:09:56.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.168+0000 7f02efdff700 1 Processor -- start 2023-03-27T10:09:56.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.168+0000 7f02efdff700 1 -- start start 2023-03-27T10:09:56.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02efdff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02efdff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e80d0b90 0x7f02e80b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02efdff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02e815ca20 0x7f02e80cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02efdff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e81e3fb0 con 0x7f02e80cd610 2023-03-27T10:09:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02efdff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c7700 con 0x7f02e80d0b90 2023-03-27T10:09:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02efdff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c6af0 con 0x7f02e815ca20 2023-03-27T10:09:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02edb9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02edb9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40482/0 (socket says 172.21.15.172:40482) 2023-03-27T10:09:56.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02edb9b700 1 -- 172.21.15.172:0/257073789 learned_addr learned my addr 172.21.15.172:0/257073789 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:56.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02ed39a700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e80d0b90 0x7f02e80b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.169+0000 7f02ee39c700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02e815ca20 0x7f02e80cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02edb9b700 1 -- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02e815ca20 msgr2=0x7f02e80cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.171 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02edb9b700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02e815ca20 0x7f02e80cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02edb9b700 1 -- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e80d0b90 msgr2=0x7f02e80b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02edb9b700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e80d0b90 0x7f02e80b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02edb9b700 1 -- 172.21.15.172:0/257073789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0009a70 con 0x7f02e80cd610 2023-03-27T10:09:56.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02ee39c700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02e815ca20 0x7f02e80cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:56.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02ed39a700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e80d0b90 0x7f02e80b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:56.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02edb9b700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e814d620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c4e0 tx=0x7f02e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:56.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4011790 con 0x7f02e80cd610 2023-03-27T10:09:56.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e40118f0 con 0x7f02e80cd610 2023-03-27T10:09:56.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4011ca0 con 0x7f02e80cd610 2023-03-27T10:09:56.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80d2d30 con 0x7f02e80cd610 2023-03-27T10:09:56.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.170+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80afc50 con 0x7f02e80cd610 2023-03-27T10:09:56.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.171+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e80b0880 con 0x7f02e80cd610 2023-03-27T10:09:56.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.172+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f02e4010050 con 0x7f02e80cd610 2023-03-27T10:09:56.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.173+0000 7f02de7fc700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f02cc066e30 0x7f02cc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.173+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02e4083ff0 con 0x7f02e80cd610 2023-03-27T10:09:56.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.173+0000 7f02ed39a700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f02cc066e30 0x7f02cc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.174+0000 7f02ed39a700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f02cc066e30 0x7f02cc0692e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f02e81e3b40 tx=0x7f02d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:56.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.177+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f02e4051230 con 0x7f02e80cd610 2023-03-27T10:09:56.360 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.362+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 --> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02e80c7840 con 0x7f02cc066e30 2023-03-27T10:09:56.371 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.372+0000 7f02de7fc700 1 -- 172.21.15.172:0/257073789 <== mgr.4100 v2:172.21.15.191:6832/109700 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286737 (secure 0 0 0) 0x7f02d80070d0 con 0x7f02cc066e30 2023-03-27T10:09:56.374 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:56.376 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f02cc066e30 msgr2=0x7f02cc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.377 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f02cc066e30 0x7f02cc0692e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f02e81e3b40 tx=0x7f02d8009040 comp rx=0 tx=0).stop 2023-03-27T10:09:56.377 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 msgr2=0x7f02e814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.377 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e814d620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c4e0 tx=0x7f02e400c8a0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.377 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 shutdown_connections 2023-03-27T10:09:56.377 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02e815ca20 0x7f02e80cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e80cd610 0x7f02e814d620 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f02cc066e30 0x7f02cc0692e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 --2- 172.21.15.172:0/257073789 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02e80d0b90 0x7f02e80b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 >> 172.21.15.172:0/257073789 conn(0x7f02e80721f0 msgr2=0x7f02e80d3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:56.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 shutdown_connections 2023-03-27T10:09:56.379 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.376+0000 7f02efdff700 1 -- 172.21.15.172:0/257073789 wait complete. 2023-03-27T10:09:56.379 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-03-27T10:09:56.392 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-03-27T10:09:55.277366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66240,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":754908480,"statfs":{"total":773094113280,"available":773026283520,"internally_reserved":0,"allocated":3211264,"data_stored":1897366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.688656"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078386+0000","last_change":"2023-03-27T10:09:52.092982+0000","last_active":"2023-03-27T10:09:53.078386+0000","last_peered":"2023-03-27T10:09:53.078386+0000","last_clean":"2023-03-27T10:09:53.078386+0000","last_became_active":"2023-03-27T10:09:52.092730+0000","last_became_peered":"2023-03-27T10:09:52.092730+0000","last_unstale":"2023-03-27T10:09:53.078386+0000","last_undegraded":"2023-03-27T10:09:53.078386+0000","last_fullsized":"2023-03-27T10:09:53.078386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:47.906298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.106629+0000","last_change":"2023-03-27T10:09:52.101670+0000","last_active":"2023-03-27T10:09:52.106629+0000","last_peered":"2023-03-27T10:09:52.106629+0000","last_clean":"2023-03-27T10:09:52.106629+0000","last_became_active":"2023-03-27T10:09:52.101416+0000","last_became_peered":"2023-03-27T10:09:52.101416+0000","last_unstale":"2023-03-27T10:09:52.106629+0000","last_undegraded":"2023-03-27T10:09:52.106629+0000","last_fullsized":"2023-03-27T10:09:52.106629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078062+0000","last_change":"2023-03-27T10:09:52.098166+0000","last_active":"2023-03-27T10:09:53.078062+0000","last_peered":"2023-03-27T10:09:53.078062+0000","last_clean":"2023-03-27T10:09:53.078062+0000","last_became_active":"2023-03-27T10:09:52.097566+0000","last_became_peered":"2023-03-27T10:09:52.097566+0000","last_unstale":"2023-03-27T10:09:53.078062+0000","last_undegraded":"2023-03-27T10:09:53.078062+0000","last_fullsized":"2023-03-27T10:09:53.078062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:17:39.738754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.094324+0000","last_change":"2023-03-27T10:09:52.092492+0000","last_active":"2023-03-27T10:09:52.094324+0000","last_peered":"2023-03-27T10:09:52.094324+0000","last_clean":"2023-03-27T10:09:52.094324+0000","last_became_active":"2023-03-27T10:09:52.092129+0000","last_became_peered":"2023-03-27T10:09:52.092129+0000","last_unstale":"2023-03-27T10:09:52.094324+0000","last_undegraded":"2023-03-27T10:09:52.094324+0000","last_fullsized":"2023-03-27T10:09:52.094324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:44.247914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.091934+0000","last_change":"2023-03-27T10:09:52.090058+0000","last_active":"2023-03-27T10:09:52.091934+0000","last_peered":"2023-03-27T10:09:52.091934+0000","last_clean":"2023-03-27T10:09:52.091934+0000","last_became_active":"2023-03-27T10:09:52.089732+0000","last_became_peered":"2023-03-27T10:09:52.089732+0000","last_unstale":"2023-03-27T10:09:52.091934+0000","last_undegraded":"2023-03-27T10:09:52.091934+0000","last_fullsized":"2023-03-27T10:09:52.091934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077922+0000","last_change":"2023-03-27T10:09:52.095899+0000","last_active":"2023-03-27T10:09:53.077922+0000","last_peered":"2023-03-27T10:09:53.077922+0000","last_clean":"2023-03-27T10:09:53.077922+0000","last_became_active":"2023-03-27T10:09:52.095619+0000","last_became_peered":"2023-03-27T10:09:52.095619+0000","last_unstale":"2023-03-27T10:09:53.077922+0000","last_undegraded":"2023-03-27T10:09:53.077922+0000","last_fullsized":"2023-03-27T10:09:53.077922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:18:43.652732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101786+0000","last_change":"2023-03-27T10:09:52.097492+0000","last_active":"2023-03-27T10:09:52.101786+0000","last_peered":"2023-03-27T10:09:52.101786+0000","last_clean":"2023-03-27T10:09:52.101786+0000","last_became_active":"2023-03-27T10:09:52.097213+0000","last_became_peered":"2023-03-27T10:09:52.097213+0000","last_unstale":"2023-03-27T10:09:52.101786+0000","last_undegraded":"2023-03-27T10:09:52.101786+0000","last_fullsized":"2023-03-27T10:09:52.101786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107381+0000","last_change":"2023-03-27T10:09:52.103087+0000","last_active":"2023-03-27T10:09:52.107381+0000","last_peered":"2023-03-27T10:09:52.107381+0000","last_clean":"2023-03-27T10:09:52.107381+0000","last_became_active":"2023-03-27T10:09:52.102367+0000","last_became_peered":"2023-03-27T10:09:52.102367+0000","last_unstale":"2023-03-27T10:09:52.107381+0000","last_undegraded":"2023-03-27T10:09:52.107381+0000","last_fullsized":"2023-03-27T10:09:52.107381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.100779+0000","last_change":"2023-03-27T10:09:52.096511+0000","last_active":"2023-03-27T10:09:52.100779+0000","last_peered":"2023-03-27T10:09:52.100779+0000","last_clean":"2023-03-27T10:09:52.100779+0000","last_became_active":"2023-03-27T10:09:52.096240+0000","last_became_peered":"2023-03-27T10:09:52.096240+0000","last_unstale":"2023-03-27T10:09:52.100779+0000","last_undegraded":"2023-03-27T10:09:52.100779+0000","last_fullsized":"2023-03-27T10:09:52.100779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.093115+0000","last_change":"2023-03-27T10:09:52.089753+0000","last_active":"2023-03-27T10:09:52.093115+0000","last_peered":"2023-03-27T10:09:52.093115+0000","last_clean":"2023-03-27T10:09:52.093115+0000","last_became_active":"2023-03-27T10:09:52.089386+0000","last_became_peered":"2023-03-27T10:09:52.089386+0000","last_unstale":"2023-03-27T10:09:52.093115+0000","last_undegraded":"2023-03-27T10:09:52.093115+0000","last_fullsized":"2023-03-27T10:09:52.093115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078132+0000","last_change":"2023-03-27T10:09:52.099885+0000","last_active":"2023-03-27T10:09:53.078132+0000","last_peered":"2023-03-27T10:09:53.078132+0000","last_clean":"2023-03-27T10:09:53.078132+0000","last_became_active":"2023-03-27T10:09:52.099574+0000","last_became_peered":"2023-03-27T10:09:52.099574+0000","last_unstale":"2023-03-27T10:09:53.078132+0000","last_undegraded":"2023-03-27T10:09:53.078132+0000","last_fullsized":"2023-03-27T10:09:53.078132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:46:07.725303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078388+0000","last_change":"2023-03-27T10:09:52.100207+0000","last_active":"2023-03-27T10:09:53.078388+0000","last_peered":"2023-03-27T10:09:53.078388+0000","last_clean":"2023-03-27T10:09:53.078388+0000","last_became_active":"2023-03-27T10:09:52.099924+0000","last_became_peered":"2023-03-27T10:09:52.099924+0000","last_unstale":"2023-03-27T10:09:53.078388+0000","last_undegraded":"2023-03-27T10:09:53.078388+0000","last_fullsized":"2023-03-27T10:09:53.078388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:49.858973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078147+0000","last_change":"2023-03-27T10:09:52.094046+0000","last_active":"2023-03-27T10:09:53.078147+0000","last_peered":"2023-03-27T10:09:53.078147+0000","last_clean":"2023-03-27T10:09:53.078147+0000","last_became_active":"2023-03-27T10:09:52.093731+0000","last_became_peered":"2023-03-27T10:09:52.093731+0000","last_unstale":"2023-03-27T10:09:53.078147+0000","last_undegraded":"2023-03-27T10:09:53.078147+0000","last_fullsized":"2023-03-27T10:09:53.078147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:28.421519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.098832+0000","last_change":"2023-03-27T10:09:52.096296+0000","last_active":"2023-03-27T10:09:52.098832+0000","last_peered":"2023-03-27T10:09:52.098832+0000","last_clean":"2023-03-27T10:09:52.098832+0000","last_became_active":"2023-03-27T10:09:52.095479+0000","last_became_peered":"2023-03-27T10:09:52.095479+0000","last_unstale":"2023-03-27T10:09:52.098832+0000","last_undegraded":"2023-03-27T10:09:52.098832+0000","last_fullsized":"2023-03-27T10:09:52.098832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101807+0000","last_change":"2023-03-27T10:09:52.097616+0000","last_active":"2023-03-27T10:09:52.101807+0000","last_peered":"2023-03-27T10:09:52.101807+0000","last_clean":"2023-03-27T10:09:52.101807+0000","last_became_active":"2023-03-27T10:09:52.097333+0000","last_became_peered":"2023-03-27T10:09:52.097333+0000","last_unstale":"2023-03-27T10:09:52.101807+0000","last_undegraded":"2023-03-27T10:09:52.101807+0000","last_fullsized":"2023-03-27T10:09:52.101807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077882+0000","last_change":"2023-03-27T10:09:52.093782+0000","last_active":"2023-03-27T10:09:53.077882+0000","last_peered":"2023-03-27T10:09:53.077882+0000","last_clean":"2023-03-27T10:09:53.077882+0000","last_became_active":"2023-03-27T10:09:52.093446+0000","last_became_peered":"2023-03-27T10:09:52.093446+0000","last_unstale":"2023-03-27T10:09:53.077882+0000","last_undegraded":"2023-03-27T10:09:53.077882+0000","last_fullsized":"2023-03-27T10:09:53.077882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:24:48.042121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.092362+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:52.092362+0000","last_peered":"2023-03-27T10:09:52.092362+0000","last_clean":"2023-03-27T10:09:52.092362+0000","last_became_active":"2023-03-27T10:09:52.089580+0000","last_became_peered":"2023-03-27T10:09:52.089580+0000","last_unstale":"2023-03-27T10:09:52.092362+0000","last_undegraded":"2023-03-27T10:09:52.092362+0000","last_fullsized":"2023-03-27T10:09:52.092362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078431+0000","last_change":"2023-03-27T10:09:52.095466+0000","last_active":"2023-03-27T10:09:53.078431+0000","last_peered":"2023-03-27T10:09:53.078431+0000","last_clean":"2023-03-27T10:09:53.078431+0000","last_became_active":"2023-03-27T10:09:52.094721+0000","last_became_peered":"2023-03-27T10:09:52.094721+0000","last_unstale":"2023-03-27T10:09:53.078431+0000","last_undegraded":"2023-03-27T10:09:53.078431+0000","last_fullsized":"2023-03-27T10:09:53.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078298+0000","last_change":"2023-03-27T10:09:52.093525+0000","last_active":"2023-03-27T10:09:53.078298+0000","last_peered":"2023-03-27T10:09:53.078298+0000","last_clean":"2023-03-27T10:09:53.078298+0000","last_became_active":"2023-03-27T10:09:52.093265+0000","last_became_peered":"2023-03-27T10:09:52.093265+0000","last_unstale":"2023-03-27T10:09:53.078298+0000","last_undegraded":"2023-03-27T10:09:53.078298+0000","last_fullsized":"2023-03-27T10:09:53.078298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:53.392900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078673+0000","last_change":"2023-03-27T10:09:52.099661+0000","last_active":"2023-03-27T10:09:53.078673+0000","last_peered":"2023-03-27T10:09:53.078673+0000","last_clean":"2023-03-27T10:09:53.078673+0000","last_became_active":"2023-03-27T10:09:52.098998+0000","last_became_peered":"2023-03-27T10:09:52.098998+0000","last_unstale":"2023-03-27T10:09:53.078673+0000","last_undegraded":"2023-03-27T10:09:53.078673+0000","last_fullsized":"2023-03-27T10:09:53.078673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:33:36.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.094354+0000","last_change":"2023-03-27T10:09:52.090988+0000","last_active":"2023-03-27T10:09:52.094354+0000","last_peered":"2023-03-27T10:09:52.094354+0000","last_clean":"2023-03-27T10:09:52.094354+0000","last_became_active":"2023-03-27T10:09:52.090631+0000","last_became_peered":"2023-03-27T10:09:52.090631+0000","last_unstale":"2023-03-27T10:09:52.094354+0000","last_undegraded":"2023-03-27T10:09:52.094354+0000","last_fullsized":"2023-03-27T10:09:52.094354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.104052+0000","last_change":"2023-03-27T10:09:52.098273+0000","last_active":"2023-03-27T10:09:52.104052+0000","last_peered":"2023-03-27T10:09:52.104052+0000","last_clean":"2023-03-27T10:09:52.104052+0000","last_became_active":"2023-03-27T10:09:52.098119+0000","last_became_peered":"2023-03-27T10:09:52.098119+0000","last_unstale":"2023-03-27T10:09:52.104052+0000","last_undegraded":"2023-03-27T10:09:52.104052+0000","last_fullsized":"2023-03-27T10:09:52.104052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076772+0000","last_change":"2023-03-27T10:09:52.095429+0000","last_active":"2023-03-27T10:09:53.076772+0000","last_peered":"2023-03-27T10:09:53.076772+0000","last_clean":"2023-03-27T10:09:53.076772+0000","last_became_active":"2023-03-27T10:09:52.095162+0000","last_became_peered":"2023-03-27T10:09:52.095162+0000","last_unstale":"2023-03-27T10:09:53.076772+0000","last_undegraded":"2023-03-27T10:09:53.076772+0000","last_fullsized":"2023-03-27T10:09:53.076772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.096273+0000","last_change":"2023-03-27T10:09:52.088996+0000","last_active":"2023-03-27T10:09:52.096273+0000","last_peered":"2023-03-27T10:09:52.096273+0000","last_clean":"2023-03-27T10:09:52.096273+0000","last_became_active":"2023-03-27T10:09:52.088726+0000","last_became_peered":"2023-03-27T10:09:52.088726+0000","last_unstale":"2023-03-27T10:09:52.096273+0000","last_undegraded":"2023-03-27T10:09:52.096273+0000","last_fullsized":"2023-03-27T10:09:52.096273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110648+0000","last_change":"2023-03-27T10:09:52.109336+0000","last_active":"2023-03-27T10:09:52.110648+0000","last_peered":"2023-03-27T10:09:52.110648+0000","last_clean":"2023-03-27T10:09:52.110648+0000","last_became_active":"2023-03-27T10:09:52.108989+0000","last_became_peered":"2023-03-27T10:09:52.108989+0000","last_unstale":"2023-03-27T10:09:52.110648+0000","last_undegraded":"2023-03-27T10:09:52.110648+0000","last_fullsized":"2023-03-27T10:09:52.110648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101598+0000","last_change":"2023-03-27T10:09:52.098826+0000","last_active":"2023-03-27T10:09:52.101598+0000","last_peered":"2023-03-27T10:09:52.101598+0000","last_clean":"2023-03-27T10:09:52.101598+0000","last_became_active":"2023-03-27T10:09:52.097953+0000","last_became_peered":"2023-03-27T10:09:52.097953+0000","last_unstale":"2023-03-27T10:09:52.101598+0000","last_undegraded":"2023-03-27T10:09:52.101598+0000","last_fullsized":"2023-03-27T10:09:52.101598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107482+0000","last_change":"2023-03-27T10:09:52.104784+0000","last_active":"2023-03-27T10:09:52.107482+0000","last_peered":"2023-03-27T10:09:52.107482+0000","last_clean":"2023-03-27T10:09:52.107482+0000","last_became_active":"2023-03-27T10:09:52.104514+0000","last_became_peered":"2023-03-27T10:09:52.104514+0000","last_unstale":"2023-03-27T10:09:52.107482+0000","last_undegraded":"2023-03-27T10:09:52.107482+0000","last_fullsized":"2023-03-27T10:09:52.107482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078137+0000","last_change":"2023-03-27T10:09:51.616324+0000","last_active":"2023-03-27T10:09:53.078137+0000","last_peered":"2023-03-27T10:09:53.078137+0000","last_clean":"2023-03-27T10:09:53.078137+0000","last_became_active":"2023-03-27T10:09:51.616038+0000","last_became_peered":"2023-03-27T10:09:51.616038+0000","last_unstale":"2023-03-27T10:09:53.078137+0000","last_undegraded":"2023-03-27T10:09:53.078137+0000","last_fullsized":"2023-03-27T10:09:53.078137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:20:38.312045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076796+0000","last_change":"2023-03-27T10:09:52.101349+0000","last_active":"2023-03-27T10:09:53.076796+0000","last_peered":"2023-03-27T10:09:53.076796+0000","last_clean":"2023-03-27T10:09:53.076796+0000","last_became_active":"2023-03-27T10:09:52.101052+0000","last_became_peered":"2023-03-27T10:09:52.101052+0000","last_unstale":"2023-03-27T10:09:53.076796+0000","last_undegraded":"2023-03-27T10:09:53.076796+0000","last_fullsized":"2023-03-27T10:09:53.076796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097196+0000","last_change":"2023-03-27T10:09:51.611795+0000","last_active":"2023-03-27T10:09:52.097196+0000","last_peered":"2023-03-27T10:09:52.097196+0000","last_clean":"2023-03-27T10:09:52.097196+0000","last_became_active":"2023-03-27T10:09:51.611060+0000","last_became_peered":"2023-03-27T10:09:51.611060+0000","last_unstale":"2023-03-27T10:09:52.097196+0000","last_undegraded":"2023-03-27T10:09:52.097196+0000","last_fullsized":"2023-03-27T10:09:52.097196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.104020+0000","last_change":"2023-03-27T10:09:52.097761+0000","last_active":"2023-03-27T10:09:52.104020+0000","last_peered":"2023-03-27T10:09:52.104020+0000","last_clean":"2023-03-27T10:09:52.104020+0000","last_became_active":"2023-03-27T10:09:52.097543+0000","last_became_peered":"2023-03-27T10:09:52.097543+0000","last_unstale":"2023-03-27T10:09:52.104020+0000","last_undegraded":"2023-03-27T10:09:52.104020+0000","last_fullsized":"2023-03-27T10:09:52.104020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076491+0000","last_change":"2023-03-27T10:09:51.614621+0000","last_active":"2023-03-27T10:09:53.076491+0000","last_peered":"2023-03-27T10:09:53.076491+0000","last_clean":"2023-03-27T10:09:53.076491+0000","last_became_active":"2023-03-27T10:09:51.613765+0000","last_became_peered":"2023-03-27T10:09:51.613765+0000","last_unstale":"2023-03-27T10:09:53.076491+0000","last_undegraded":"2023-03-27T10:09:53.076491+0000","last_fullsized":"2023-03-27T10:09:53.076491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.093668+0000","last_change":"2023-03-27T10:09:52.087655+0000","last_active":"2023-03-27T10:09:52.093668+0000","last_peered":"2023-03-27T10:09:52.093668+0000","last_clean":"2023-03-27T10:09:52.093668+0000","last_became_active":"2023-03-27T10:09:52.087383+0000","last_became_peered":"2023-03-27T10:09:52.087383+0000","last_unstale":"2023-03-27T10:09:52.093668+0000","last_undegraded":"2023-03-27T10:09:52.093668+0000","last_fullsized":"2023-03-27T10:09:52.093668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:15.162076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.084226+0000","last_change":"2023-03-27T10:09:51.621560+0000","last_active":"2023-03-27T10:09:52.084226+0000","last_peered":"2023-03-27T10:09:52.084226+0000","last_clean":"2023-03-27T10:09:52.084226+0000","last_became_active":"2023-03-27T10:09:51.621122+0000","last_became_peered":"2023-03-27T10:09:51.621122+0000","last_unstale":"2023-03-27T10:09:52.084226+0000","last_undegraded":"2023-03-27T10:09:52.084226+0000","last_fullsized":"2023-03-27T10:09:52.084226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076407+0000","last_change":"2023-03-27T10:09:52.098575+0000","last_active":"2023-03-27T10:09:53.076407+0000","last_peered":"2023-03-27T10:09:53.076407+0000","last_clean":"2023-03-27T10:09:53.076407+0000","last_became_active":"2023-03-27T10:09:52.097932+0000","last_became_peered":"2023-03-27T10:09:52.097932+0000","last_unstale":"2023-03-27T10:09:53.076407+0000","last_undegraded":"2023-03-27T10:09:53.076407+0000","last_fullsized":"2023-03-27T10:09:53.076407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.082675+0000","last_change":"2023-03-27T10:09:51.615898+0000","last_active":"2023-03-27T10:09:52.082675+0000","last_peered":"2023-03-27T10:09:52.082675+0000","last_clean":"2023-03-27T10:09:52.082675+0000","last_became_active":"2023-03-27T10:09:51.614109+0000","last_became_peered":"2023-03-27T10:09:51.614109+0000","last_unstale":"2023-03-27T10:09:52.082675+0000","last_undegraded":"2023-03-27T10:09:52.082675+0000","last_fullsized":"2023-03-27T10:09:52.082675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076484+0000","last_change":"2023-03-27T10:09:52.088791+0000","last_active":"2023-03-27T10:09:53.076484+0000","last_peered":"2023-03-27T10:09:53.076484+0000","last_clean":"2023-03-27T10:09:53.076484+0000","last_became_active":"2023-03-27T10:09:52.088546+0000","last_became_peered":"2023-03-27T10:09:52.088546+0000","last_unstale":"2023-03-27T10:09:53.076484+0000","last_undegraded":"2023-03-27T10:09:53.076484+0000","last_fullsized":"2023-03-27T10:09:53.076484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110086+0000","last_change":"2023-03-27T10:09:51.619965+0000","last_active":"2023-03-27T10:09:52.110086+0000","last_peered":"2023-03-27T10:09:52.110086+0000","last_clean":"2023-03-27T10:09:52.110086+0000","last_became_active":"2023-03-27T10:09:51.619669+0000","last_became_peered":"2023-03-27T10:09:51.619669+0000","last_unstale":"2023-03-27T10:09:52.110086+0000","last_undegraded":"2023-03-27T10:09:52.110086+0000","last_fullsized":"2023-03-27T10:09:52.110086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110628+0000","last_change":"2023-03-27T10:09:52.109249+0000","last_active":"2023-03-27T10:09:52.110628+0000","last_peered":"2023-03-27T10:09:52.110628+0000","last_clean":"2023-03-27T10:09:52.110628+0000","last_became_active":"2023-03-27T10:09:52.108978+0000","last_became_peered":"2023-03-27T10:09:52.108978+0000","last_unstale":"2023-03-27T10:09:52.110628+0000","last_undegraded":"2023-03-27T10:09:52.110628+0000","last_fullsized":"2023-03-27T10:09:52.110628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078791+0000","last_change":"2023-03-27T10:09:51.615701+0000","last_active":"2023-03-27T10:09:53.078791+0000","last_peered":"2023-03-27T10:09:53.078791+0000","last_clean":"2023-03-27T10:09:53.078791+0000","last_became_active":"2023-03-27T10:09:51.615154+0000","last_became_peered":"2023-03-27T10:09:51.615154+0000","last_unstale":"2023-03-27T10:09:53.078791+0000","last_undegraded":"2023-03-27T10:09:53.078791+0000","last_fullsized":"2023-03-27T10:09:53.078791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078630+0000","last_change":"2023-03-27T10:09:52.096016+0000","last_active":"2023-03-27T10:09:53.078630+0000","last_peered":"2023-03-27T10:09:53.078630+0000","last_clean":"2023-03-27T10:09:53.078630+0000","last_became_active":"2023-03-27T10:09:52.095750+0000","last_became_peered":"2023-03-27T10:09:52.095750+0000","last_unstale":"2023-03-27T10:09:53.078630+0000","last_undegraded":"2023-03-27T10:09:53.078630+0000","last_fullsized":"2023-03-27T10:09:53.078630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105470+0000","last_change":"2023-03-27T10:09:51.621889+0000","last_active":"2023-03-27T10:09:52.105470+0000","last_peered":"2023-03-27T10:09:52.105470+0000","last_clean":"2023-03-27T10:09:52.105470+0000","last_became_active":"2023-03-27T10:09:51.621395+0000","last_became_peered":"2023-03-27T10:09:51.621395+0000","last_unstale":"2023-03-27T10:09:52.105470+0000","last_undegraded":"2023-03-27T10:09:52.105470+0000","last_fullsized":"2023-03-27T10:09:52.105470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:24.048712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076636+0000","last_change":"2023-03-27T10:09:52.101533+0000","last_active":"2023-03-27T10:09:53.076636+0000","last_peered":"2023-03-27T10:09:53.076636+0000","last_clean":"2023-03-27T10:09:53.076636+0000","last_became_active":"2023-03-27T10:09:52.101282+0000","last_became_peered":"2023-03-27T10:09:52.101282+0000","last_unstale":"2023-03-27T10:09:53.076636+0000","last_undegraded":"2023-03-27T10:09:53.076636+0000","last_fullsized":"2023-03-27T10:09:53.076636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.082142+0000","last_change":"2023-03-27T10:09:51.617855+0000","last_active":"2023-03-27T10:09:52.082142+0000","last_peered":"2023-03-27T10:09:52.082142+0000","last_clean":"2023-03-27T10:09:52.082142+0000","last_became_active":"2023-03-27T10:09:51.617615+0000","last_became_peered":"2023-03-27T10:09:51.617615+0000","last_unstale":"2023-03-27T10:09:52.082142+0000","last_undegraded":"2023-03-27T10:09:52.082142+0000","last_fullsized":"2023-03-27T10:09:52.082142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107471+0000","last_change":"2023-03-27T10:09:52.104706+0000","last_active":"2023-03-27T10:09:52.107471+0000","last_peered":"2023-03-27T10:09:52.107471+0000","last_clean":"2023-03-27T10:09:52.107471+0000","last_became_active":"2023-03-27T10:09:52.104399+0000","last_became_peered":"2023-03-27T10:09:52.104399+0000","last_unstale":"2023-03-27T10:09:52.107471+0000","last_undegraded":"2023-03-27T10:09:52.107471+0000","last_fullsized":"2023-03-27T10:09:52.107471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.082273+0000","last_change":"2023-03-27T10:09:51.622460+0000","last_active":"2023-03-27T10:09:52.082273+0000","last_peered":"2023-03-27T10:09:52.082273+0000","last_clean":"2023-03-27T10:09:52.082273+0000","last_became_active":"2023-03-27T10:09:51.622173+0000","last_became_peered":"2023-03-27T10:09:51.622173+0000","last_unstale":"2023-03-27T10:09:52.082273+0000","last_undegraded":"2023-03-27T10:09:52.082273+0000","last_fullsized":"2023-03-27T10:09:52.082273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:52.390198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.091661+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:52.091661+0000","last_peered":"2023-03-27T10:09:52.091661+0000","last_clean":"2023-03-27T10:09:52.091661+0000","last_became_active":"2023-03-27T10:09:52.089994+0000","last_became_peered":"2023-03-27T10:09:52.089994+0000","last_unstale":"2023-03-27T10:09:52.091661+0000","last_undegraded":"2023-03-27T10:09:52.091661+0000","last_fullsized":"2023-03-27T10:09:52.091661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105130+0000","last_change":"2023-03-27T10:09:51.617245+0000","last_active":"2023-03-27T10:09:52.105130+0000","last_peered":"2023-03-27T10:09:52.105130+0000","last_clean":"2023-03-27T10:09:52.105130+0000","last_became_active":"2023-03-27T10:09:51.616762+0000","last_became_peered":"2023-03-27T10:09:51.616762+0000","last_unstale":"2023-03-27T10:09:52.105130+0000","last_undegraded":"2023-03-27T10:09:52.105130+0000","last_fullsized":"2023-03-27T10:09:52.105130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076949+0000","last_change":"2023-03-27T10:09:52.095172+0000","last_active":"2023-03-27T10:09:53.076949+0000","last_peered":"2023-03-27T10:09:53.076949+0000","last_clean":"2023-03-27T10:09:53.076949+0000","last_became_active":"2023-03-27T10:09:52.093048+0000","last_became_peered":"2023-03-27T10:09:52.093048+0000","last_unstale":"2023-03-27T10:09:53.076949+0000","last_undegraded":"2023-03-27T10:09:53.076949+0000","last_fullsized":"2023-03-27T10:09:53.076949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105411+0000","last_change":"2023-03-27T10:09:51.622695+0000","last_active":"2023-03-27T10:09:52.105411+0000","last_peered":"2023-03-27T10:09:52.105411+0000","last_clean":"2023-03-27T10:09:52.105411+0000","last_became_active":"2023-03-27T10:09:51.622334+0000","last_became_peered":"2023-03-27T10:09:51.622334+0000","last_unstale":"2023-03-27T10:09:52.105411+0000","last_undegraded":"2023-03-27T10:09:52.105411+0000","last_fullsized":"2023-03-27T10:09:52.105411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:43.245212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107439+0000","last_change":"2023-03-27T10:09:52.103636+0000","last_active":"2023-03-27T10:09:52.107439+0000","last_peered":"2023-03-27T10:09:52.107439+0000","last_clean":"2023-03-27T10:09:52.107439+0000","last_became_active":"2023-03-27T10:09:52.103345+0000","last_became_peered":"2023-03-27T10:09:52.103345+0000","last_unstale":"2023-03-27T10:09:52.107439+0000","last_undegraded":"2023-03-27T10:09:52.107439+0000","last_fullsized":"2023-03-27T10:09:52.107439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105368+0000","last_change":"2023-03-27T10:09:51.621953+0000","last_active":"2023-03-27T10:09:52.105368+0000","last_peered":"2023-03-27T10:09:52.105368+0000","last_clean":"2023-03-27T10:09:52.105368+0000","last_became_active":"2023-03-27T10:09:51.621630+0000","last_became_peered":"2023-03-27T10:09:51.621630+0000","last_unstale":"2023-03-27T10:09:52.105368+0000","last_undegraded":"2023-03-27T10:09:52.105368+0000","last_fullsized":"2023-03-27T10:09:52.105368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077921+0000","last_change":"2023-03-27T10:09:52.101803+0000","last_active":"2023-03-27T10:09:53.077921+0000","last_peered":"2023-03-27T10:09:53.077921+0000","last_clean":"2023-03-27T10:09:53.077921+0000","last_became_active":"2023-03-27T10:09:52.100140+0000","last_became_peered":"2023-03-27T10:09:52.100140+0000","last_unstale":"2023-03-27T10:09:53.077921+0000","last_undegraded":"2023-03-27T10:09:53.077921+0000","last_fullsized":"2023-03-27T10:09:53.077921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:52:48.138618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.106946+0000","last_change":"2023-03-27T10:09:51.620614+0000","last_active":"2023-03-27T10:09:52.106946+0000","last_peered":"2023-03-27T10:09:52.106946+0000","last_clean":"2023-03-27T10:09:52.106946+0000","last_became_active":"2023-03-27T10:09:51.620331+0000","last_became_peered":"2023-03-27T10:09:51.620331+0000","last_unstale":"2023-03-27T10:09:52.106946+0000","last_undegraded":"2023-03-27T10:09:52.106946+0000","last_fullsized":"2023-03-27T10:09:52.106946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102144+0000","last_change":"2023-03-27T10:09:52.097480+0000","last_active":"2023-03-27T10:09:52.102144+0000","last_peered":"2023-03-27T10:09:52.102144+0000","last_clean":"2023-03-27T10:09:52.102144+0000","last_became_active":"2023-03-27T10:09:52.097210+0000","last_became_peered":"2023-03-27T10:09:52.097210+0000","last_unstale":"2023-03-27T10:09:52.102144+0000","last_undegraded":"2023-03-27T10:09:52.102144+0000","last_fullsized":"2023-03-27T10:09:52.102144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:53:27.358285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.081030+0000","last_change":"2023-03-27T10:09:51.615276+0000","last_active":"2023-03-27T10:09:52.081030+0000","last_peered":"2023-03-27T10:09:52.081030+0000","last_clean":"2023-03-27T10:09:52.081030+0000","last_became_active":"2023-03-27T10:09:51.614739+0000","last_became_peered":"2023-03-27T10:09:51.614739+0000","last_unstale":"2023-03-27T10:09:52.081030+0000","last_undegraded":"2023-03-27T10:09:52.081030+0000","last_fullsized":"2023-03-27T10:09:52.081030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110000+0000","last_change":"2023-03-27T10:09:52.106003+0000","last_active":"2023-03-27T10:09:52.110000+0000","last_peered":"2023-03-27T10:09:52.110000+0000","last_clean":"2023-03-27T10:09:52.110000+0000","last_became_active":"2023-03-27T10:09:52.105235+0000","last_became_peered":"2023-03-27T10:09:52.105235+0000","last_unstale":"2023-03-27T10:09:52.110000+0000","last_undegraded":"2023-03-27T10:09:52.110000+0000","last_fullsized":"2023-03-27T10:09:52.110000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076894+0000","last_change":"2023-03-27T10:09:51.614759+0000","last_active":"2023-03-27T10:09:53.076894+0000","last_peered":"2023-03-27T10:09:53.076894+0000","last_clean":"2023-03-27T10:09:53.076894+0000","last_became_active":"2023-03-27T10:09:51.613946+0000","last_became_peered":"2023-03-27T10:09:51.613946+0000","last_unstale":"2023-03-27T10:09:53.076894+0000","last_undegraded":"2023-03-27T10:09:53.076894+0000","last_fullsized":"2023-03-27T10:09:53.076894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078757+0000","last_change":"2023-03-27T10:09:52.099430+0000","last_active":"2023-03-27T10:09:53.078757+0000","last_peered":"2023-03-27T10:09:53.078757+0000","last_clean":"2023-03-27T10:09:53.078757+0000","last_became_active":"2023-03-27T10:09:52.098704+0000","last_became_peered":"2023-03-27T10:09:52.098704+0000","last_unstale":"2023-03-27T10:09:53.078757+0000","last_undegraded":"2023-03-27T10:09:53.078757+0000","last_fullsized":"2023-03-27T10:09:53.078757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083352+0000","last_change":"2023-03-27T10:09:51.618553+0000","last_active":"2023-03-27T10:09:52.083352+0000","last_peered":"2023-03-27T10:09:52.083352+0000","last_clean":"2023-03-27T10:09:52.083352+0000","last_became_active":"2023-03-27T10:09:51.618221+0000","last_became_peered":"2023-03-27T10:09:51.618221+0000","last_unstale":"2023-03-27T10:09:52.083352+0000","last_undegraded":"2023-03-27T10:09:52.083352+0000","last_fullsized":"2023-03-27T10:09:52.083352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078676+0000","last_change":"2023-03-27T10:09:52.097963+0000","last_active":"2023-03-27T10:09:53.078676+0000","last_peered":"2023-03-27T10:09:53.078676+0000","last_clean":"2023-03-27T10:09:53.078676+0000","last_became_active":"2023-03-27T10:09:52.097246+0000","last_became_peered":"2023-03-27T10:09:52.097246+0000","last_unstale":"2023-03-27T10:09:53.078676+0000","last_undegraded":"2023-03-27T10:09:53.078676+0000","last_fullsized":"2023-03-27T10:09:53.078676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078174+0000","last_change":"2023-03-27T10:09:51.607348+0000","last_active":"2023-03-27T10:09:53.078174+0000","last_peered":"2023-03-27T10:09:53.078174+0000","last_clean":"2023-03-27T10:09:53.078174+0000","last_became_active":"2023-03-27T10:09:51.605922+0000","last_became_peered":"2023-03-27T10:09:51.605922+0000","last_unstale":"2023-03-27T10:09:53.078174+0000","last_undegraded":"2023-03-27T10:09:53.078174+0000","last_fullsized":"2023-03-27T10:09:53.078174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:42:49.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078583+0000","last_change":"2023-03-27T10:09:52.095246+0000","last_active":"2023-03-27T10:09:53.078583+0000","last_peered":"2023-03-27T10:09:53.078583+0000","last_clean":"2023-03-27T10:09:53.078583+0000","last_became_active":"2023-03-27T10:09:52.094368+0000","last_became_peered":"2023-03-27T10:09:52.094368+0000","last_unstale":"2023-03-27T10:09:53.078583+0000","last_undegraded":"2023-03-27T10:09:53.078583+0000","last_fullsized":"2023-03-27T10:09:53.078583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076378+0000","last_change":"2023-03-27T10:09:51.615859+0000","last_active":"2023-03-27T10:09:53.076378+0000","last_peered":"2023-03-27T10:09:53.076378+0000","last_clean":"2023-03-27T10:09:53.076378+0000","last_became_active":"2023-03-27T10:09:51.615589+0000","last_became_peered":"2023-03-27T10:09:51.615589+0000","last_unstale":"2023-03-27T10:09:53.076378+0000","last_undegraded":"2023-03-27T10:09:53.076378+0000","last_fullsized":"2023-03-27T10:09:53.076378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110141+0000","last_change":"2023-03-27T10:09:52.108218+0000","last_active":"2023-03-27T10:09:52.110141+0000","last_peered":"2023-03-27T10:09:52.110141+0000","last_clean":"2023-03-27T10:09:52.110141+0000","last_became_active":"2023-03-27T10:09:52.107884+0000","last_became_peered":"2023-03-27T10:09:52.107884+0000","last_unstale":"2023-03-27T10:09:52.110141+0000","last_undegraded":"2023-03-27T10:09:52.110141+0000","last_fullsized":"2023-03-27T10:09:52.110141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.602634+0000","last_change":"2023-03-27T10:09:46.107098+0000","last_active":"2023-03-27T10:09:51.602634+0000","last_peered":"2023-03-27T10:09:51.602634+0000","last_clean":"2023-03-27T10:09:51.602634+0000","last_became_active":"2023-03-27T10:09:46.106831+0000","last_became_peered":"2023-03-27T10:09:46.106831+0000","last_unstale":"2023-03-27T10:09:51.602634+0000","last_undegraded":"2023-03-27T10:09:51.602634+0000","last_fullsized":"2023-03-27T10:09:51.602634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083641+0000","last_change":"2023-03-27T10:09:51.614610+0000","last_active":"2023-03-27T10:09:52.083641+0000","last_peered":"2023-03-27T10:09:52.083641+0000","last_clean":"2023-03-27T10:09:52.083641+0000","last_became_active":"2023-03-27T10:09:51.614320+0000","last_became_peered":"2023-03-27T10:09:51.614320+0000","last_unstale":"2023-03-27T10:09:52.083641+0000","last_undegraded":"2023-03-27T10:09:52.083641+0000","last_fullsized":"2023-03-27T10:09:52.083641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.104202+0000","last_change":"2023-03-27T10:09:52.102379+0000","last_active":"2023-03-27T10:09:52.104202+0000","last_peered":"2023-03-27T10:09:52.104202+0000","last_clean":"2023-03-27T10:09:52.104202+0000","last_became_active":"2023-03-27T10:09:52.102073+0000","last_became_peered":"2023-03-27T10:09:52.102073+0000","last_unstale":"2023-03-27T10:09:52.104202+0000","last_undegraded":"2023-03-27T10:09:52.104202+0000","last_fullsized":"2023-03-27T10:09:52.104202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.601745+0000","last_change":"2023-03-27T10:09:46.107305+0000","last_active":"2023-03-27T10:09:51.601745+0000","last_peered":"2023-03-27T10:09:51.601745+0000","last_clean":"2023-03-27T10:09:51.601745+0000","last_became_active":"2023-03-27T10:09:46.107038+0000","last_became_peered":"2023-03-27T10:09:46.107038+0000","last_unstale":"2023-03-27T10:09:51.601745+0000","last_undegraded":"2023-03-27T10:09:51.601745+0000","last_fullsized":"2023-03-27T10:09:51.601745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078493+0000","last_change":"2023-03-27T10:09:51.619230+0000","last_active":"2023-03-27T10:09:53.078493+0000","last_peered":"2023-03-27T10:09:53.078493+0000","last_clean":"2023-03-27T10:09:53.078493+0000","last_became_active":"2023-03-27T10:09:51.618937+0000","last_became_peered":"2023-03-27T10:09:51.618937+0000","last_unstale":"2023-03-27T10:09:53.078493+0000","last_undegraded":"2023-03-27T10:09:53.078493+0000","last_fullsized":"2023-03-27T10:09:53.078493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:22:21.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101646+0000","last_change":"2023-03-27T10:09:52.099004+0000","last_active":"2023-03-27T10:09:52.101646+0000","last_peered":"2023-03-27T10:09:52.101646+0000","last_clean":"2023-03-27T10:09:52.101646+0000","last_became_active":"2023-03-27T10:09:52.098396+0000","last_became_peered":"2023-03-27T10:09:52.098396+0000","last_unstale":"2023-03-27T10:09:52.101646+0000","last_undegraded":"2023-03-27T10:09:52.101646+0000","last_fullsized":"2023-03-27T10:09:52.101646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.076320+0000","last_change":"2023-03-27T10:09:46.326263+0000","last_active":"2023-03-27T10:09:52.076320+0000","last_peered":"2023-03-27T10:09:52.076320+0000","last_clean":"2023-03-27T10:09:52.076320+0000","last_became_active":"2023-03-27T10:09:46.325963+0000","last_became_peered":"2023-03-27T10:09:46.325963+0000","last_unstale":"2023-03-27T10:09:52.076320+0000","last_undegraded":"2023-03-27T10:09:52.076320+0000","last_fullsized":"2023-03-27T10:09:52.076320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.099686+0000","last_change":"2023-03-27T10:09:51.614527+0000","last_active":"2023-03-27T10:09:52.099686+0000","last_peered":"2023-03-27T10:09:52.099686+0000","last_clean":"2023-03-27T10:09:52.099686+0000","last_became_active":"2023-03-27T10:09:51.614208+0000","last_became_peered":"2023-03-27T10:09:51.614208+0000","last_unstale":"2023-03-27T10:09:52.099686+0000","last_undegraded":"2023-03-27T10:09:52.099686+0000","last_fullsized":"2023-03-27T10:09:52.099686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101254+0000","last_change":"2023-03-27T10:09:52.096517+0000","last_active":"2023-03-27T10:09:52.101254+0000","last_peered":"2023-03-27T10:09:52.101254+0000","last_clean":"2023-03-27T10:09:52.101254+0000","last_became_active":"2023-03-27T10:09:52.096184+0000","last_became_peered":"2023-03-27T10:09:52.096184+0000","last_unstale":"2023-03-27T10:09:52.101254+0000","last_undegraded":"2023-03-27T10:09:52.101254+0000","last_fullsized":"2023-03-27T10:09:52.101254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.601700+0000","last_change":"2023-03-27T10:09:46.106690+0000","last_active":"2023-03-27T10:09:51.601700+0000","last_peered":"2023-03-27T10:09:51.601700+0000","last_clean":"2023-03-27T10:09:51.601700+0000","last_became_active":"2023-03-27T10:09:46.106393+0000","last_became_peered":"2023-03-27T10:09:46.106393+0000","last_unstale":"2023-03-27T10:09:51.601700+0000","last_undegraded":"2023-03-27T10:09:51.601700+0000","last_fullsized":"2023-03-27T10:09:51.601700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.610552+0000","last_change":"2023-03-27T10:09:40.691310+0000","last_active":"2023-03-27T10:09:51.610552+0000","last_peered":"2023-03-27T10:09:51.610552+0000","last_clean":"2023-03-27T10:09:51.610552+0000","last_became_active":"2023-03-27T10:09:40.690248+0000","last_became_peered":"2023-03-27T10:09:40.690248+0000","last_unstale":"2023-03-27T10:09:51.610552+0000","last_undegraded":"2023-03-27T10:09:51.610552+0000","last_fullsized":"2023-03-27T10:09:51.610552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_clean_scrub_stamp":"2023-03-27T10:09:39.335229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:58:29.036302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076523+0000","last_change":"2023-03-27T10:09:51.612759+0000","last_active":"2023-03-27T10:09:53.076523+0000","last_peered":"2023-03-27T10:09:53.076523+0000","last_clean":"2023-03-27T10:09:53.076523+0000","last_became_active":"2023-03-27T10:09:51.612495+0000","last_became_peered":"2023-03-27T10:09:51.612495+0000","last_unstale":"2023-03-27T10:09:53.076523+0000","last_undegraded":"2023-03-27T10:09:53.076523+0000","last_fullsized":"2023-03-27T10:09:53.076523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102717+0000","last_change":"2023-03-27T10:09:52.100115+0000","last_active":"2023-03-27T10:09:52.102717+0000","last_peered":"2023-03-27T10:09:52.102717+0000","last_clean":"2023-03-27T10:09:52.102717+0000","last_became_active":"2023-03-27T10:09:52.099833+0000","last_became_peered":"2023-03-27T10:09:52.099833+0000","last_unstale":"2023-03-27T10:09:52.102717+0000","last_undegraded":"2023-03-27T10:09:52.102717+0000","last_fullsized":"2023-03-27T10:09:52.102717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:02:14.752486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.610714+0000","last_change":"2023-03-27T10:09:46.108163+0000","last_active":"2023-03-27T10:09:51.610714+0000","last_peered":"2023-03-27T10:09:51.610714+0000","last_clean":"2023-03-27T10:09:51.610714+0000","last_became_active":"2023-03-27T10:09:46.107807+0000","last_became_peered":"2023-03-27T10:09:46.107807+0000","last_unstale":"2023-03-27T10:09:51.610714+0000","last_undegraded":"2023-03-27T10:09:51.610714+0000","last_fullsized":"2023-03-27T10:09:51.610714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.081140+0000","last_change":"2023-03-27T10:09:51.620513+0000","last_active":"2023-03-27T10:09:52.081140+0000","last_peered":"2023-03-27T10:09:52.081140+0000","last_clean":"2023-03-27T10:09:52.081140+0000","last_became_active":"2023-03-27T10:09:51.620285+0000","last_became_peered":"2023-03-27T10:09:51.620285+0000","last_unstale":"2023-03-27T10:09:52.081140+0000","last_undegraded":"2023-03-27T10:09:52.081140+0000","last_fullsized":"2023-03-27T10:09:52.081140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.109724+0000","last_change":"2023-03-27T10:09:52.103681+0000","last_active":"2023-03-27T10:09:52.109724+0000","last_peered":"2023-03-27T10:09:52.109724+0000","last_clean":"2023-03-27T10:09:52.109724+0000","last_became_active":"2023-03-27T10:09:52.103419+0000","last_became_peered":"2023-03-27T10:09:52.103419+0000","last_unstale":"2023-03-27T10:09:52.109724+0000","last_undegraded":"2023-03-27T10:09:52.109724+0000","last_fullsized":"2023-03-27T10:09:52.109724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.612157+0000","last_change":"2023-03-27T10:09:46.107100+0000","last_active":"2023-03-27T10:09:51.612157+0000","last_peered":"2023-03-27T10:09:51.612157+0000","last_clean":"2023-03-27T10:09:51.612157+0000","last_became_active":"2023-03-27T10:09:46.106766+0000","last_became_peered":"2023-03-27T10:09:46.106766+0000","last_unstale":"2023-03-27T10:09:51.612157+0000","last_undegraded":"2023-03-27T10:09:51.612157+0000","last_fullsized":"2023-03-27T10:09:51.612157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:44:01.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097652+0000","last_change":"2023-03-27T10:09:51.611165+0000","last_active":"2023-03-27T10:09:52.097652+0000","last_peered":"2023-03-27T10:09:52.097652+0000","last_clean":"2023-03-27T10:09:52.097652+0000","last_became_active":"2023-03-27T10:09:51.610854+0000","last_became_peered":"2023-03-27T10:09:51.610854+0000","last_unstale":"2023-03-27T10:09:52.097652+0000","last_undegraded":"2023-03-27T10:09:52.097652+0000","last_fullsized":"2023-03-27T10:09:52.097652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.091916+0000","last_change":"2023-03-27T10:09:52.088129+0000","last_active":"2023-03-27T10:09:52.091916+0000","last_peered":"2023-03-27T10:09:52.091916+0000","last_clean":"2023-03-27T10:09:52.091916+0000","last_became_active":"2023-03-27T10:09:52.087826+0000","last_became_peered":"2023-03-27T10:09:52.087826+0000","last_unstale":"2023-03-27T10:09:52.091916+0000","last_undegraded":"2023-03-27T10:09:52.091916+0000","last_fullsized":"2023-03-27T10:09:52.091916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077036+0000","last_change":"2023-03-27T10:09:51.614313+0000","last_active":"2023-03-27T10:09:53.077036+0000","last_peered":"2023-03-27T10:09:53.077036+0000","last_clean":"2023-03-27T10:09:53.077036+0000","last_became_active":"2023-03-27T10:09:51.613995+0000","last_became_peered":"2023-03-27T10:09:51.613995+0000","last_unstale":"2023-03-27T10:09:53.077036+0000","last_undegraded":"2023-03-27T10:09:53.077036+0000","last_fullsized":"2023-03-27T10:09:53.077036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.603077+0000","last_change":"2023-03-27T10:09:46.108779+0000","last_active":"2023-03-27T10:09:51.603077+0000","last_peered":"2023-03-27T10:09:51.603077+0000","last_clean":"2023-03-27T10:09:51.603077+0000","last_became_active":"2023-03-27T10:09:46.108307+0000","last_became_peered":"2023-03-27T10:09:46.108307+0000","last_unstale":"2023-03-27T10:09:51.603077+0000","last_undegraded":"2023-03-27T10:09:51.603077+0000","last_fullsized":"2023-03-27T10:09:51.603077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076313+0000","last_change":"2023-03-27T10:09:52.089355+0000","last_active":"2023-03-27T10:09:53.076313+0000","last_peered":"2023-03-27T10:09:53.076313+0000","last_clean":"2023-03-27T10:09:53.076313+0000","last_became_active":"2023-03-27T10:09:52.089075+0000","last_became_peered":"2023-03-27T10:09:52.089075+0000","last_unstale":"2023-03-27T10:09:53.076313+0000","last_undegraded":"2023-03-27T10:09:53.076313+0000","last_fullsized":"2023-03-27T10:09:53.076313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.606687+0000","last_change":"2023-03-27T10:09:46.108791+0000","last_active":"2023-03-27T10:09:51.606687+0000","last_peered":"2023-03-27T10:09:51.606687+0000","last_clean":"2023-03-27T10:09:51.606687+0000","last_became_active":"2023-03-27T10:09:46.108203+0000","last_became_peered":"2023-03-27T10:09:46.108203+0000","last_unstale":"2023-03-27T10:09:51.606687+0000","last_undegraded":"2023-03-27T10:09:51.606687+0000","last_fullsized":"2023-03-27T10:09:51.606687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083550+0000","last_change":"2023-03-27T10:09:51.617246+0000","last_active":"2023-03-27T10:09:52.083550+0000","last_peered":"2023-03-27T10:09:52.083550+0000","last_clean":"2023-03-27T10:09:52.083550+0000","last_became_active":"2023-03-27T10:09:51.616745+0000","last_became_peered":"2023-03-27T10:09:51.616745+0000","last_unstale":"2023-03-27T10:09:52.083550+0000","last_undegraded":"2023-03-27T10:09:52.083550+0000","last_fullsized":"2023-03-27T10:09:52.083550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078179+0000","last_change":"2023-03-27T10:09:52.100091+0000","last_active":"2023-03-27T10:09:53.078179+0000","last_peered":"2023-03-27T10:09:53.078179+0000","last_clean":"2023-03-27T10:09:53.078179+0000","last_became_active":"2023-03-27T10:09:52.099822+0000","last_became_peered":"2023-03-27T10:09:52.099822+0000","last_unstale":"2023-03-27T10:09:53.078179+0000","last_undegraded":"2023-03-27T10:09:53.078179+0000","last_fullsized":"2023-03-27T10:09:53.078179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105474+0000","last_change":"2023-03-27T10:09:51.624415+0000","last_active":"2023-03-27T10:09:52.105474+0000","last_peered":"2023-03-27T10:09:52.105474+0000","last_clean":"2023-03-27T10:09:52.105474+0000","last_became_active":"2023-03-27T10:09:51.624151+0000","last_became_peered":"2023-03-27T10:09:51.624151+0000","last_unstale":"2023-03-27T10:09:52.105474+0000","last_undegraded":"2023-03-27T10:09:52.105474+0000","last_fullsized":"2023-03-27T10:09:52.105474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078453+0000","last_change":"2023-03-27T10:09:52.097854+0000","last_active":"2023-03-27T10:09:53.078453+0000","last_peered":"2023-03-27T10:09:53.078453+0000","last_clean":"2023-03-27T10:09:53.078453+0000","last_became_active":"2023-03-27T10:09:52.097592+0000","last_became_peered":"2023-03-27T10:09:52.097592+0000","last_unstale":"2023-03-27T10:09:53.078453+0000","last_undegraded":"2023-03-27T10:09:53.078453+0000","last_fullsized":"2023-03-27T10:09:53.078453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105707+0000","last_change":"2023-03-27T10:09:51.620648+0000","last_active":"2023-03-27T10:09:52.105707+0000","last_peered":"2023-03-27T10:09:52.105707+0000","last_clean":"2023-03-27T10:09:52.105707+0000","last_became_active":"2023-03-27T10:09:51.620327+0000","last_became_peered":"2023-03-27T10:09:51.620327+0000","last_unstale":"2023-03-27T10:09:52.105707+0000","last_undegraded":"2023-03-27T10:09:52.105707+0000","last_fullsized":"2023-03-27T10:09:52.105707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078428+0000","last_change":"2023-03-27T10:09:52.083060+0000","last_active":"2023-03-27T10:09:53.078428+0000","last_peered":"2023-03-27T10:09:53.078428+0000","last_clean":"2023-03-27T10:09:53.078428+0000","last_became_active":"2023-03-27T10:09:52.082804+0000","last_became_peered":"2023-03-27T10:09:52.082804+0000","last_unstale":"2023-03-27T10:09:53.078428+0000","last_undegraded":"2023-03-27T10:09:53.078428+0000","last_fullsized":"2023-03-27T10:09:53.078428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105416+0000","last_change":"2023-03-27T10:09:51.620593+0000","last_active":"2023-03-27T10:09:52.105416+0000","last_peered":"2023-03-27T10:09:52.105416+0000","last_clean":"2023-03-27T10:09:52.105416+0000","last_became_active":"2023-03-27T10:09:51.620287+0000","last_became_peered":"2023-03-27T10:09:51.620287+0000","last_unstale":"2023-03-27T10:09:52.105416+0000","last_undegraded":"2023-03-27T10:09:52.105416+0000","last_fullsized":"2023-03-27T10:09:52.105416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078402+0000","last_change":"2023-03-27T10:09:52.080606+0000","last_active":"2023-03-27T10:09:53.078402+0000","last_peered":"2023-03-27T10:09:53.078402+0000","last_clean":"2023-03-27T10:09:53.078402+0000","last_became_active":"2023-03-27T10:09:52.080331+0000","last_became_peered":"2023-03-27T10:09:52.080331+0000","last_unstale":"2023-03-27T10:09:53.078402+0000","last_undegraded":"2023-03-27T10:09:53.078402+0000","last_fullsized":"2023-03-27T10:09:53.078402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076857+0000","last_change":"2023-03-27T10:09:51.616366+0000","last_active":"2023-03-27T10:09:53.076857+0000","last_peered":"2023-03-27T10:09:53.076857+0000","last_clean":"2023-03-27T10:09:53.076857+0000","last_became_active":"2023-03-27T10:09:51.615908+0000","last_became_peered":"2023-03-27T10:09:51.615908+0000","last_unstale":"2023-03-27T10:09:53.076857+0000","last_undegraded":"2023-03-27T10:09:53.076857+0000","last_fullsized":"2023-03-27T10:09:53.076857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076487+0000","last_change":"2023-03-27T10:09:52.102730+0000","last_active":"2023-03-27T10:09:53.076487+0000","last_peered":"2023-03-27T10:09:53.076487+0000","last_clean":"2023-03-27T10:09:53.076487+0000","last_became_active":"2023-03-27T10:09:52.102450+0000","last_became_peered":"2023-03-27T10:09:52.102450+0000","last_unstale":"2023-03-27T10:09:53.076487+0000","last_undegraded":"2023-03-27T10:09:53.076487+0000","last_fullsized":"2023-03-27T10:09:53.076487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.096625+0000","last_change":"2023-03-27T10:09:51.621408+0000","last_active":"2023-03-27T10:09:52.096625+0000","last_peered":"2023-03-27T10:09:52.096625+0000","last_clean":"2023-03-27T10:09:52.096625+0000","last_became_active":"2023-03-27T10:09:51.620743+0000","last_became_peered":"2023-03-27T10:09:51.620743+0000","last_unstale":"2023-03-27T10:09:52.096625+0000","last_undegraded":"2023-03-27T10:09:52.096625+0000","last_fullsized":"2023-03-27T10:09:52.096625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077753+0000","last_change":"2023-03-27T10:09:52.088963+0000","last_active":"2023-03-27T10:09:53.077753+0000","last_peered":"2023-03-27T10:09:53.077753+0000","last_clean":"2023-03-27T10:09:53.077753+0000","last_became_active":"2023-03-27T10:09:52.088695+0000","last_became_peered":"2023-03-27T10:09:52.088695+0000","last_unstale":"2023-03-27T10:09:53.077753+0000","last_undegraded":"2023-03-27T10:09:53.077753+0000","last_fullsized":"2023-03-27T10:09:53.077753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102986+0000","last_change":"2023-03-27T10:09:52.098801+0000","last_active":"2023-03-27T10:09:52.102986+0000","last_peered":"2023-03-27T10:09:52.102986+0000","last_clean":"2023-03-27T10:09:52.102986+0000","last_became_active":"2023-03-27T10:09:52.098214+0000","last_became_peered":"2023-03-27T10:09:52.098214+0000","last_unstale":"2023-03-27T10:09:52.102986+0000","last_undegraded":"2023-03-27T10:09:52.102986+0000","last_fullsized":"2023-03-27T10:09:52.102986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076365+0000","last_change":"2023-03-27T10:09:52.101353+0000","last_active":"2023-03-27T10:09:53.076365+0000","last_peered":"2023-03-27T10:09:53.076365+0000","last_clean":"2023-03-27T10:09:53.076365+0000","last_became_active":"2023-03-27T10:09:52.101060+0000","last_became_peered":"2023-03-27T10:09:52.101060+0000","last_unstale":"2023-03-27T10:09:53.076365+0000","last_undegraded":"2023-03-27T10:09:53.076365+0000","last_fullsized":"2023-03-27T10:09:53.076365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078027+0000","last_change":"2023-03-27T10:09:52.090063+0000","last_active":"2023-03-27T10:09:53.078027+0000","last_peered":"2023-03-27T10:09:53.078027+0000","last_clean":"2023-03-27T10:09:53.078027+0000","last_became_active":"2023-03-27T10:09:52.089785+0000","last_became_peered":"2023-03-27T10:09:52.089785+0000","last_unstale":"2023-03-27T10:09:53.078027+0000","last_undegraded":"2023-03-27T10:09:53.078027+0000","last_fullsized":"2023-03-27T10:09:53.078027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:23:37.734370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076654+0000","last_change":"2023-03-27T10:09:52.102062+0000","last_active":"2023-03-27T10:09:53.076654+0000","last_peered":"2023-03-27T10:09:53.076654+0000","last_clean":"2023-03-27T10:09:53.076654+0000","last_became_active":"2023-03-27T10:09:52.101762+0000","last_became_peered":"2023-03-27T10:09:52.101762+0000","last_unstale":"2023-03-27T10:09:53.076654+0000","last_undegraded":"2023-03-27T10:09:53.076654+0000","last_fullsized":"2023-03-27T10:09:53.076654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102774+0000","last_change":"2023-03-27T10:09:52.100627+0000","last_active":"2023-03-27T10:09:52.102774+0000","last_peered":"2023-03-27T10:09:52.102774+0000","last_clean":"2023-03-27T10:09:52.102774+0000","last_became_active":"2023-03-27T10:09:52.100237+0000","last_became_peered":"2023-03-27T10:09:52.100237+0000","last_unstale":"2023-03-27T10:09:52.102774+0000","last_undegraded":"2023-03-27T10:09:52.102774+0000","last_fullsized":"2023-03-27T10:09:52.102774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7936,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363904,"statfs":{"total":96636764160,"available":96628637696,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":679465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":87333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":678267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":88937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":87969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":87333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-27T10:09:56.402 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-27T10:09:56.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.616+0000 7f89371ff700 1 Processor -- start 2023-03-27T10:09:56.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.616+0000 7f89371ff700 1 -- start start 2023-03-27T10:09:56.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.617+0000 7f89371ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f893015c8f0 0x7f893006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.617+0000 7f89371ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 0x7f893006c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.617+0000 7f89371ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300cb3a0 con 0x7f89300cd760 2023-03-27T10:09:56.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.617+0000 7f89371ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893006b9a0 con 0x7f893015c8f0 2023-03-27T10:09:56.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.617+0000 7f89371ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8930070220 con 0x7f893006be30 2023-03-27T10:09:56.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.617+0000 7f893579c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 0x7f893006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f8934f9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f89300cd760 0x7f89300cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48384/0 (socket says 172.21.15.172:48384) 2023-03-27T10:09:56.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892ffff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f893015c8f0 0x7f893006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f8934f9b700 1 -- 172.21.15.172:0/2813002750 learned_addr learned my addr 172.21.15.172:0/2813002750 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:56.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f893579c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 0x7f893006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55732/0 (socket says 172.21.15.172:55732) 2023-03-27T10:09:56.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892f7fe700 1 -- 172.21.15.172:0/2813002750 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677327641 0 0) 0x7f89300cb3a0 con 0x7f89300cd760 2023-03-27T10:09:56.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892ffff700 1 -- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 msgr2=0x7f893006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:56.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892ffff700 1 --2- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 0x7f893006c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892ffff700 1 -- 172.21.15.172:0/2813002750 >> v1:172.21.15.191:6789/0 conn(0x7f89300cd760 legacy=0x7f89300cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892ffff700 1 -- 172.21.15.172:0/2813002750 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300d07b0 con 0x7f893015c8f0 2023-03-27T10:09:56.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f893579c700 1 --2- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 0x7f893006c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:09:56.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.618+0000 7f892ffff700 1 --2- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893015c8f0 0x7f893006f710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f891c009840 tx=0x7f891c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1242377ca98913de server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:56.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f892f7fe700 1 -- 172.21.15.172:0/2813002750 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c011830 con 0x7f893015c8f0 2023-03-27T10:09:56.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f892f7fe700 1 -- 172.21.15.172:0/2813002750 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c011990 con 0x7f893015c8f0 2023-03-27T10:09:56.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f892f7fe700 1 -- 172.21.15.172:0/2813002750 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c011d20 con 0x7f893015c8f0 2023-03-27T10:09:56.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 -- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893015c8f0 msgr2=0x7f893006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 --2- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893015c8f0 0x7f893006f710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f891c009840 tx=0x7f891c009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:56.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 -- 172.21.15.172:0/2813002750 shutdown_connections 2023-03-27T10:09:56.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 --2- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f893006be30 0x7f893006c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 --2- 172.21.15.172:0/2813002750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893015c8f0 0x7f893006f710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 -- 172.21.15.172:0/2813002750 >> 172.21.15.172:0/2813002750 conn(0x7f893006dd60 msgr2=0x7f893006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:56.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 -- 172.21.15.172:0/2813002750 shutdown_connections 2023-03-27T10:09:56.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.619+0000 7f89371ff700 1 -- 172.21.15.172:0/2813002750 wait complete. 2023-03-27T10:09:56.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.621+0000 7f89371ff700 1 Processor -- start 2023-03-27T10:09:56.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.621+0000 7f89371ff700 1 -- start start 2023-03-27T10:09:56.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f89371ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893006be30 0x7f89300c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f89371ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89300cd760 0x7f8930155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f89371ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 0x7f89300af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f89371ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300c7270 con 0x7f893015c8f0 2023-03-27T10:09:56.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f89371ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300c5c90 con 0x7f893006be30 2023-03-27T10:09:56.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f89371ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300c5f70 con 0x7f89300cd760 2023-03-27T10:09:56.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.622+0000 7f893579c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 0x7f89300af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 0x7f89300af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40492/0 (socket says 172.21.15.172:40492) 2023-03-27T10:09:56.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 -- 172.21.15.172:0/1900094456 learned_addr learned my addr 172.21.15.172:0/1900094456 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:56.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f892ffff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89300cd760 0x7f8930155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f8934f9b700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893006be30 0x7f89300c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 -- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89300cd760 msgr2=0x7f8930155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89300cd760 0x7f8930155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 -- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893006be30 msgr2=0x7f89300c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893006be30 0x7f89300c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 -- 172.21.15.172:0/1900094456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009a70 con 0x7f893015c8f0 2023-03-27T10:09:56.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f893579c700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 0x7f89300af2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f892800efc0 tx=0x7f892800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:56.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800cc90 con 0x7f893015c8f0 2023-03-27T10:09:56.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800f040 con 0x7f893015c8f0 2023-03-27T10:09:56.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c0094a0 con 0x7f893015c8f0 2023-03-27T10:09:56.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.623+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928003a20 con 0x7f893015c8f0 2023-03-27T10:09:56.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.624+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893006b350 con 0x7f893015c8f0 2023-03-27T10:09:56.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.625+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89300d0a90 con 0x7f893015c8f0 2023-03-27T10:09:56.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.625+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f892801a020 con 0x7f893015c8f0 2023-03-27T10:09:56.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.626+0000 7f892d7fa700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8914066e30 0x7f89140692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:56.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.626+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8928084d20 con 0x7f893015c8f0 2023-03-27T10:09:56.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.627+0000 7f8934f9b700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8914066e30 0x7f89140692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:56.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.627+0000 7f8934f9b700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8914066e30 0x7f89140692e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8924000f60 tx=0x7f8924007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:56.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.630+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f8928051f60 con 0x7f893015c8f0 2023-03-27T10:09:56.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.813+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 --> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f893006b630 con 0x7f8914066e30 2023-03-27T10:09:56.820 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.822+0000 7f892d7fa700 1 -- 172.21.15.172:0/1900094456 <== mgr.4100 v2:172.21.15.191:6832/109700 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286737 (secure 0 0 0) 0x7f893006b630 con 0x7f8914066e30 2023-03-27T10:09:56.821 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8914066e30 msgr2=0x7f89140692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8914066e30 0x7f89140692e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8924000f60 tx=0x7f8924007e70 comp rx=0 tx=0).stop 2023-03-27T10:09:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 msgr2=0x7f89300af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 0x7f89300af2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f892800efc0 tx=0x7f892800c3a0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 shutdown_connections 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f893015c8f0 0x7f89300af2d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8914066e30 0x7f89140692e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f893006be30 0x7f89300c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 --2- 172.21.15.172:0/1900094456 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89300cd760 0x7f8930155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 >> 172.21.15.172:0/1900094456 conn(0x7f893006dd60 msgr2=0x7f893015cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 shutdown_connections 2023-03-27T10:09:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:56.826+0000 7f89371ff700 1 -- 172.21.15.172:0/1900094456 wait complete. 2023-03-27T10:09:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-03-27T10:09:56.842 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-03-27T10:09:55.277366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66240,"kb_used_data":3136,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":754908480,"statfs":{"total":773094113280,"available":773026283520,"internally_reserved":0,"allocated":3211264,"data_stored":1897366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.688656"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078386+0000","last_change":"2023-03-27T10:09:52.092982+0000","last_active":"2023-03-27T10:09:53.078386+0000","last_peered":"2023-03-27T10:09:53.078386+0000","last_clean":"2023-03-27T10:09:53.078386+0000","last_became_active":"2023-03-27T10:09:52.092730+0000","last_became_peered":"2023-03-27T10:09:52.092730+0000","last_unstale":"2023-03-27T10:09:53.078386+0000","last_undegraded":"2023-03-27T10:09:53.078386+0000","last_fullsized":"2023-03-27T10:09:53.078386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:47.906298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.106629+0000","last_change":"2023-03-27T10:09:52.101670+0000","last_active":"2023-03-27T10:09:52.106629+0000","last_peered":"2023-03-27T10:09:52.106629+0000","last_clean":"2023-03-27T10:09:52.106629+0000","last_became_active":"2023-03-27T10:09:52.101416+0000","last_became_peered":"2023-03-27T10:09:52.101416+0000","last_unstale":"2023-03-27T10:09:52.106629+0000","last_undegraded":"2023-03-27T10:09:52.106629+0000","last_fullsized":"2023-03-27T10:09:52.106629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078062+0000","last_change":"2023-03-27T10:09:52.098166+0000","last_active":"2023-03-27T10:09:53.078062+0000","last_peered":"2023-03-27T10:09:53.078062+0000","last_clean":"2023-03-27T10:09:53.078062+0000","last_became_active":"2023-03-27T10:09:52.097566+0000","last_became_peered":"2023-03-27T10:09:52.097566+0000","last_unstale":"2023-03-27T10:09:53.078062+0000","last_undegraded":"2023-03-27T10:09:53.078062+0000","last_fullsized":"2023-03-27T10:09:53.078062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:17:39.738754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.094324+0000","last_change":"2023-03-27T10:09:52.092492+0000","last_active":"2023-03-27T10:09:52.094324+0000","last_peered":"2023-03-27T10:09:52.094324+0000","last_clean":"2023-03-27T10:09:52.094324+0000","last_became_active":"2023-03-27T10:09:52.092129+0000","last_became_peered":"2023-03-27T10:09:52.092129+0000","last_unstale":"2023-03-27T10:09:52.094324+0000","last_undegraded":"2023-03-27T10:09:52.094324+0000","last_fullsized":"2023-03-27T10:09:52.094324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:44.247914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.091934+0000","last_change":"2023-03-27T10:09:52.090058+0000","last_active":"2023-03-27T10:09:52.091934+0000","last_peered":"2023-03-27T10:09:52.091934+0000","last_clean":"2023-03-27T10:09:52.091934+0000","last_became_active":"2023-03-27T10:09:52.089732+0000","last_became_peered":"2023-03-27T10:09:52.089732+0000","last_unstale":"2023-03-27T10:09:52.091934+0000","last_undegraded":"2023-03-27T10:09:52.091934+0000","last_fullsized":"2023-03-27T10:09:52.091934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077922+0000","last_change":"2023-03-27T10:09:52.095899+0000","last_active":"2023-03-27T10:09:53.077922+0000","last_peered":"2023-03-27T10:09:53.077922+0000","last_clean":"2023-03-27T10:09:53.077922+0000","last_became_active":"2023-03-27T10:09:52.095619+0000","last_became_peered":"2023-03-27T10:09:52.095619+0000","last_unstale":"2023-03-27T10:09:53.077922+0000","last_undegraded":"2023-03-27T10:09:53.077922+0000","last_fullsized":"2023-03-27T10:09:53.077922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:18:43.652732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101786+0000","last_change":"2023-03-27T10:09:52.097492+0000","last_active":"2023-03-27T10:09:52.101786+0000","last_peered":"2023-03-27T10:09:52.101786+0000","last_clean":"2023-03-27T10:09:52.101786+0000","last_became_active":"2023-03-27T10:09:52.097213+0000","last_became_peered":"2023-03-27T10:09:52.097213+0000","last_unstale":"2023-03-27T10:09:52.101786+0000","last_undegraded":"2023-03-27T10:09:52.101786+0000","last_fullsized":"2023-03-27T10:09:52.101786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107381+0000","last_change":"2023-03-27T10:09:52.103087+0000","last_active":"2023-03-27T10:09:52.107381+0000","last_peered":"2023-03-27T10:09:52.107381+0000","last_clean":"2023-03-27T10:09:52.107381+0000","last_became_active":"2023-03-27T10:09:52.102367+0000","last_became_peered":"2023-03-27T10:09:52.102367+0000","last_unstale":"2023-03-27T10:09:52.107381+0000","last_undegraded":"2023-03-27T10:09:52.107381+0000","last_fullsized":"2023-03-27T10:09:52.107381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.100779+0000","last_change":"2023-03-27T10:09:52.096511+0000","last_active":"2023-03-27T10:09:52.100779+0000","last_peered":"2023-03-27T10:09:52.100779+0000","last_clean":"2023-03-27T10:09:52.100779+0000","last_became_active":"2023-03-27T10:09:52.096240+0000","last_became_peered":"2023-03-27T10:09:52.096240+0000","last_unstale":"2023-03-27T10:09:52.100779+0000","last_undegraded":"2023-03-27T10:09:52.100779+0000","last_fullsized":"2023-03-27T10:09:52.100779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.093115+0000","last_change":"2023-03-27T10:09:52.089753+0000","last_active":"2023-03-27T10:09:52.093115+0000","last_peered":"2023-03-27T10:09:52.093115+0000","last_clean":"2023-03-27T10:09:52.093115+0000","last_became_active":"2023-03-27T10:09:52.089386+0000","last_became_peered":"2023-03-27T10:09:52.089386+0000","last_unstale":"2023-03-27T10:09:52.093115+0000","last_undegraded":"2023-03-27T10:09:52.093115+0000","last_fullsized":"2023-03-27T10:09:52.093115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078132+0000","last_change":"2023-03-27T10:09:52.099885+0000","last_active":"2023-03-27T10:09:53.078132+0000","last_peered":"2023-03-27T10:09:53.078132+0000","last_clean":"2023-03-27T10:09:53.078132+0000","last_became_active":"2023-03-27T10:09:52.099574+0000","last_became_peered":"2023-03-27T10:09:52.099574+0000","last_unstale":"2023-03-27T10:09:53.078132+0000","last_undegraded":"2023-03-27T10:09:53.078132+0000","last_fullsized":"2023-03-27T10:09:53.078132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:46:07.725303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078388+0000","last_change":"2023-03-27T10:09:52.100207+0000","last_active":"2023-03-27T10:09:53.078388+0000","last_peered":"2023-03-27T10:09:53.078388+0000","last_clean":"2023-03-27T10:09:53.078388+0000","last_became_active":"2023-03-27T10:09:52.099924+0000","last_became_peered":"2023-03-27T10:09:52.099924+0000","last_unstale":"2023-03-27T10:09:53.078388+0000","last_undegraded":"2023-03-27T10:09:53.078388+0000","last_fullsized":"2023-03-27T10:09:53.078388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:49.858973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078147+0000","last_change":"2023-03-27T10:09:52.094046+0000","last_active":"2023-03-27T10:09:53.078147+0000","last_peered":"2023-03-27T10:09:53.078147+0000","last_clean":"2023-03-27T10:09:53.078147+0000","last_became_active":"2023-03-27T10:09:52.093731+0000","last_became_peered":"2023-03-27T10:09:52.093731+0000","last_unstale":"2023-03-27T10:09:53.078147+0000","last_undegraded":"2023-03-27T10:09:53.078147+0000","last_fullsized":"2023-03-27T10:09:53.078147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:28.421519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.098832+0000","last_change":"2023-03-27T10:09:52.096296+0000","last_active":"2023-03-27T10:09:52.098832+0000","last_peered":"2023-03-27T10:09:52.098832+0000","last_clean":"2023-03-27T10:09:52.098832+0000","last_became_active":"2023-03-27T10:09:52.095479+0000","last_became_peered":"2023-03-27T10:09:52.095479+0000","last_unstale":"2023-03-27T10:09:52.098832+0000","last_undegraded":"2023-03-27T10:09:52.098832+0000","last_fullsized":"2023-03-27T10:09:52.098832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101807+0000","last_change":"2023-03-27T10:09:52.097616+0000","last_active":"2023-03-27T10:09:52.101807+0000","last_peered":"2023-03-27T10:09:52.101807+0000","last_clean":"2023-03-27T10:09:52.101807+0000","last_became_active":"2023-03-27T10:09:52.097333+0000","last_became_peered":"2023-03-27T10:09:52.097333+0000","last_unstale":"2023-03-27T10:09:52.101807+0000","last_undegraded":"2023-03-27T10:09:52.101807+0000","last_fullsized":"2023-03-27T10:09:52.101807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077882+0000","last_change":"2023-03-27T10:09:52.093782+0000","last_active":"2023-03-27T10:09:53.077882+0000","last_peered":"2023-03-27T10:09:53.077882+0000","last_clean":"2023-03-27T10:09:53.077882+0000","last_became_active":"2023-03-27T10:09:52.093446+0000","last_became_peered":"2023-03-27T10:09:52.093446+0000","last_unstale":"2023-03-27T10:09:53.077882+0000","last_undegraded":"2023-03-27T10:09:53.077882+0000","last_fullsized":"2023-03-27T10:09:53.077882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:24:48.042121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.092362+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:52.092362+0000","last_peered":"2023-03-27T10:09:52.092362+0000","last_clean":"2023-03-27T10:09:52.092362+0000","last_became_active":"2023-03-27T10:09:52.089580+0000","last_became_peered":"2023-03-27T10:09:52.089580+0000","last_unstale":"2023-03-27T10:09:52.092362+0000","last_undegraded":"2023-03-27T10:09:52.092362+0000","last_fullsized":"2023-03-27T10:09:52.092362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078431+0000","last_change":"2023-03-27T10:09:52.095466+0000","last_active":"2023-03-27T10:09:53.078431+0000","last_peered":"2023-03-27T10:09:53.078431+0000","last_clean":"2023-03-27T10:09:53.078431+0000","last_became_active":"2023-03-27T10:09:52.094721+0000","last_became_peered":"2023-03-27T10:09:52.094721+0000","last_unstale":"2023-03-27T10:09:53.078431+0000","last_undegraded":"2023-03-27T10:09:53.078431+0000","last_fullsized":"2023-03-27T10:09:53.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078298+0000","last_change":"2023-03-27T10:09:52.093525+0000","last_active":"2023-03-27T10:09:53.078298+0000","last_peered":"2023-03-27T10:09:53.078298+0000","last_clean":"2023-03-27T10:09:53.078298+0000","last_became_active":"2023-03-27T10:09:52.093265+0000","last_became_peered":"2023-03-27T10:09:52.093265+0000","last_unstale":"2023-03-27T10:09:53.078298+0000","last_undegraded":"2023-03-27T10:09:53.078298+0000","last_fullsized":"2023-03-27T10:09:53.078298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:53.392900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078673+0000","last_change":"2023-03-27T10:09:52.099661+0000","last_active":"2023-03-27T10:09:53.078673+0000","last_peered":"2023-03-27T10:09:53.078673+0000","last_clean":"2023-03-27T10:09:53.078673+0000","last_became_active":"2023-03-27T10:09:52.098998+0000","last_became_peered":"2023-03-27T10:09:52.098998+0000","last_unstale":"2023-03-27T10:09:53.078673+0000","last_undegraded":"2023-03-27T10:09:53.078673+0000","last_fullsized":"2023-03-27T10:09:53.078673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:33:36.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.094354+0000","last_change":"2023-03-27T10:09:52.090988+0000","last_active":"2023-03-27T10:09:52.094354+0000","last_peered":"2023-03-27T10:09:52.094354+0000","last_clean":"2023-03-27T10:09:52.094354+0000","last_became_active":"2023-03-27T10:09:52.090631+0000","last_became_peered":"2023-03-27T10:09:52.090631+0000","last_unstale":"2023-03-27T10:09:52.094354+0000","last_undegraded":"2023-03-27T10:09:52.094354+0000","last_fullsized":"2023-03-27T10:09:52.094354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.104052+0000","last_change":"2023-03-27T10:09:52.098273+0000","last_active":"2023-03-27T10:09:52.104052+0000","last_peered":"2023-03-27T10:09:52.104052+0000","last_clean":"2023-03-27T10:09:52.104052+0000","last_became_active":"2023-03-27T10:09:52.098119+0000","last_became_peered":"2023-03-27T10:09:52.098119+0000","last_unstale":"2023-03-27T10:09:52.104052+0000","last_undegraded":"2023-03-27T10:09:52.104052+0000","last_fullsized":"2023-03-27T10:09:52.104052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076772+0000","last_change":"2023-03-27T10:09:52.095429+0000","last_active":"2023-03-27T10:09:53.076772+0000","last_peered":"2023-03-27T10:09:53.076772+0000","last_clean":"2023-03-27T10:09:53.076772+0000","last_became_active":"2023-03-27T10:09:52.095162+0000","last_became_peered":"2023-03-27T10:09:52.095162+0000","last_unstale":"2023-03-27T10:09:53.076772+0000","last_undegraded":"2023-03-27T10:09:53.076772+0000","last_fullsized":"2023-03-27T10:09:53.076772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.096273+0000","last_change":"2023-03-27T10:09:52.088996+0000","last_active":"2023-03-27T10:09:52.096273+0000","last_peered":"2023-03-27T10:09:52.096273+0000","last_clean":"2023-03-27T10:09:52.096273+0000","last_became_active":"2023-03-27T10:09:52.088726+0000","last_became_peered":"2023-03-27T10:09:52.088726+0000","last_unstale":"2023-03-27T10:09:52.096273+0000","last_undegraded":"2023-03-27T10:09:52.096273+0000","last_fullsized":"2023-03-27T10:09:52.096273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110648+0000","last_change":"2023-03-27T10:09:52.109336+0000","last_active":"2023-03-27T10:09:52.110648+0000","last_peered":"2023-03-27T10:09:52.110648+0000","last_clean":"2023-03-27T10:09:52.110648+0000","last_became_active":"2023-03-27T10:09:52.108989+0000","last_became_peered":"2023-03-27T10:09:52.108989+0000","last_unstale":"2023-03-27T10:09:52.110648+0000","last_undegraded":"2023-03-27T10:09:52.110648+0000","last_fullsized":"2023-03-27T10:09:52.110648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101598+0000","last_change":"2023-03-27T10:09:52.098826+0000","last_active":"2023-03-27T10:09:52.101598+0000","last_peered":"2023-03-27T10:09:52.101598+0000","last_clean":"2023-03-27T10:09:52.101598+0000","last_became_active":"2023-03-27T10:09:52.097953+0000","last_became_peered":"2023-03-27T10:09:52.097953+0000","last_unstale":"2023-03-27T10:09:52.101598+0000","last_undegraded":"2023-03-27T10:09:52.101598+0000","last_fullsized":"2023-03-27T10:09:52.101598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107482+0000","last_change":"2023-03-27T10:09:52.104784+0000","last_active":"2023-03-27T10:09:52.107482+0000","last_peered":"2023-03-27T10:09:52.107482+0000","last_clean":"2023-03-27T10:09:52.107482+0000","last_became_active":"2023-03-27T10:09:52.104514+0000","last_became_peered":"2023-03-27T10:09:52.104514+0000","last_unstale":"2023-03-27T10:09:52.107482+0000","last_undegraded":"2023-03-27T10:09:52.107482+0000","last_fullsized":"2023-03-27T10:09:52.107482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078137+0000","last_change":"2023-03-27T10:09:51.616324+0000","last_active":"2023-03-27T10:09:53.078137+0000","last_peered":"2023-03-27T10:09:53.078137+0000","last_clean":"2023-03-27T10:09:53.078137+0000","last_became_active":"2023-03-27T10:09:51.616038+0000","last_became_peered":"2023-03-27T10:09:51.616038+0000","last_unstale":"2023-03-27T10:09:53.078137+0000","last_undegraded":"2023-03-27T10:09:53.078137+0000","last_fullsized":"2023-03-27T10:09:53.078137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:20:38.312045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076796+0000","last_change":"2023-03-27T10:09:52.101349+0000","last_active":"2023-03-27T10:09:53.076796+0000","last_peered":"2023-03-27T10:09:53.076796+0000","last_clean":"2023-03-27T10:09:53.076796+0000","last_became_active":"2023-03-27T10:09:52.101052+0000","last_became_peered":"2023-03-27T10:09:52.101052+0000","last_unstale":"2023-03-27T10:09:53.076796+0000","last_undegraded":"2023-03-27T10:09:53.076796+0000","last_fullsized":"2023-03-27T10:09:53.076796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097196+0000","last_change":"2023-03-27T10:09:51.611795+0000","last_active":"2023-03-27T10:09:52.097196+0000","last_peered":"2023-03-27T10:09:52.097196+0000","last_clean":"2023-03-27T10:09:52.097196+0000","last_became_active":"2023-03-27T10:09:51.611060+0000","last_became_peered":"2023-03-27T10:09:51.611060+0000","last_unstale":"2023-03-27T10:09:52.097196+0000","last_undegraded":"2023-03-27T10:09:52.097196+0000","last_fullsized":"2023-03-27T10:09:52.097196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.104020+0000","last_change":"2023-03-27T10:09:52.097761+0000","last_active":"2023-03-27T10:09:52.104020+0000","last_peered":"2023-03-27T10:09:52.104020+0000","last_clean":"2023-03-27T10:09:52.104020+0000","last_became_active":"2023-03-27T10:09:52.097543+0000","last_became_peered":"2023-03-27T10:09:52.097543+0000","last_unstale":"2023-03-27T10:09:52.104020+0000","last_undegraded":"2023-03-27T10:09:52.104020+0000","last_fullsized":"2023-03-27T10:09:52.104020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076491+0000","last_change":"2023-03-27T10:09:51.614621+0000","last_active":"2023-03-27T10:09:53.076491+0000","last_peered":"2023-03-27T10:09:53.076491+0000","last_clean":"2023-03-27T10:09:53.076491+0000","last_became_active":"2023-03-27T10:09:51.613765+0000","last_became_peered":"2023-03-27T10:09:51.613765+0000","last_unstale":"2023-03-27T10:09:53.076491+0000","last_undegraded":"2023-03-27T10:09:53.076491+0000","last_fullsized":"2023-03-27T10:09:53.076491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.093668+0000","last_change":"2023-03-27T10:09:52.087655+0000","last_active":"2023-03-27T10:09:52.093668+0000","last_peered":"2023-03-27T10:09:52.093668+0000","last_clean":"2023-03-27T10:09:52.093668+0000","last_became_active":"2023-03-27T10:09:52.087383+0000","last_became_peered":"2023-03-27T10:09:52.087383+0000","last_unstale":"2023-03-27T10:09:52.093668+0000","last_undegraded":"2023-03-27T10:09:52.093668+0000","last_fullsized":"2023-03-27T10:09:52.093668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:15.162076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.084226+0000","last_change":"2023-03-27T10:09:51.621560+0000","last_active":"2023-03-27T10:09:52.084226+0000","last_peered":"2023-03-27T10:09:52.084226+0000","last_clean":"2023-03-27T10:09:52.084226+0000","last_became_active":"2023-03-27T10:09:51.621122+0000","last_became_peered":"2023-03-27T10:09:51.621122+0000","last_unstale":"2023-03-27T10:09:52.084226+0000","last_undegraded":"2023-03-27T10:09:52.084226+0000","last_fullsized":"2023-03-27T10:09:52.084226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076407+0000","last_change":"2023-03-27T10:09:52.098575+0000","last_active":"2023-03-27T10:09:53.076407+0000","last_peered":"2023-03-27T10:09:53.076407+0000","last_clean":"2023-03-27T10:09:53.076407+0000","last_became_active":"2023-03-27T10:09:52.097932+0000","last_became_peered":"2023-03-27T10:09:52.097932+0000","last_unstale":"2023-03-27T10:09:53.076407+0000","last_undegraded":"2023-03-27T10:09:53.076407+0000","last_fullsized":"2023-03-27T10:09:53.076407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.082675+0000","last_change":"2023-03-27T10:09:51.615898+0000","last_active":"2023-03-27T10:09:52.082675+0000","last_peered":"2023-03-27T10:09:52.082675+0000","last_clean":"2023-03-27T10:09:52.082675+0000","last_became_active":"2023-03-27T10:09:51.614109+0000","last_became_peered":"2023-03-27T10:09:51.614109+0000","last_unstale":"2023-03-27T10:09:52.082675+0000","last_undegraded":"2023-03-27T10:09:52.082675+0000","last_fullsized":"2023-03-27T10:09:52.082675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076484+0000","last_change":"2023-03-27T10:09:52.088791+0000","last_active":"2023-03-27T10:09:53.076484+0000","last_peered":"2023-03-27T10:09:53.076484+0000","last_clean":"2023-03-27T10:09:53.076484+0000","last_became_active":"2023-03-27T10:09:52.088546+0000","last_became_peered":"2023-03-27T10:09:52.088546+0000","last_unstale":"2023-03-27T10:09:53.076484+0000","last_undegraded":"2023-03-27T10:09:53.076484+0000","last_fullsized":"2023-03-27T10:09:53.076484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110086+0000","last_change":"2023-03-27T10:09:51.619965+0000","last_active":"2023-03-27T10:09:52.110086+0000","last_peered":"2023-03-27T10:09:52.110086+0000","last_clean":"2023-03-27T10:09:52.110086+0000","last_became_active":"2023-03-27T10:09:51.619669+0000","last_became_peered":"2023-03-27T10:09:51.619669+0000","last_unstale":"2023-03-27T10:09:52.110086+0000","last_undegraded":"2023-03-27T10:09:52.110086+0000","last_fullsized":"2023-03-27T10:09:52.110086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110628+0000","last_change":"2023-03-27T10:09:52.109249+0000","last_active":"2023-03-27T10:09:52.110628+0000","last_peered":"2023-03-27T10:09:52.110628+0000","last_clean":"2023-03-27T10:09:52.110628+0000","last_became_active":"2023-03-27T10:09:52.108978+0000","last_became_peered":"2023-03-27T10:09:52.108978+0000","last_unstale":"2023-03-27T10:09:52.110628+0000","last_undegraded":"2023-03-27T10:09:52.110628+0000","last_fullsized":"2023-03-27T10:09:52.110628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078791+0000","last_change":"2023-03-27T10:09:51.615701+0000","last_active":"2023-03-27T10:09:53.078791+0000","last_peered":"2023-03-27T10:09:53.078791+0000","last_clean":"2023-03-27T10:09:53.078791+0000","last_became_active":"2023-03-27T10:09:51.615154+0000","last_became_peered":"2023-03-27T10:09:51.615154+0000","last_unstale":"2023-03-27T10:09:53.078791+0000","last_undegraded":"2023-03-27T10:09:53.078791+0000","last_fullsized":"2023-03-27T10:09:53.078791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078630+0000","last_change":"2023-03-27T10:09:52.096016+0000","last_active":"2023-03-27T10:09:53.078630+0000","last_peered":"2023-03-27T10:09:53.078630+0000","last_clean":"2023-03-27T10:09:53.078630+0000","last_became_active":"2023-03-27T10:09:52.095750+0000","last_became_peered":"2023-03-27T10:09:52.095750+0000","last_unstale":"2023-03-27T10:09:53.078630+0000","last_undegraded":"2023-03-27T10:09:53.078630+0000","last_fullsized":"2023-03-27T10:09:53.078630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105470+0000","last_change":"2023-03-27T10:09:51.621889+0000","last_active":"2023-03-27T10:09:52.105470+0000","last_peered":"2023-03-27T10:09:52.105470+0000","last_clean":"2023-03-27T10:09:52.105470+0000","last_became_active":"2023-03-27T10:09:51.621395+0000","last_became_peered":"2023-03-27T10:09:51.621395+0000","last_unstale":"2023-03-27T10:09:52.105470+0000","last_undegraded":"2023-03-27T10:09:52.105470+0000","last_fullsized":"2023-03-27T10:09:52.105470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:24.048712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076636+0000","last_change":"2023-03-27T10:09:52.101533+0000","last_active":"2023-03-27T10:09:53.076636+0000","last_peered":"2023-03-27T10:09:53.076636+0000","last_clean":"2023-03-27T10:09:53.076636+0000","last_became_active":"2023-03-27T10:09:52.101282+0000","last_became_peered":"2023-03-27T10:09:52.101282+0000","last_unstale":"2023-03-27T10:09:53.076636+0000","last_undegraded":"2023-03-27T10:09:53.076636+0000","last_fullsized":"2023-03-27T10:09:53.076636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.082142+0000","last_change":"2023-03-27T10:09:51.617855+0000","last_active":"2023-03-27T10:09:52.082142+0000","last_peered":"2023-03-27T10:09:52.082142+0000","last_clean":"2023-03-27T10:09:52.082142+0000","last_became_active":"2023-03-27T10:09:51.617615+0000","last_became_peered":"2023-03-27T10:09:51.617615+0000","last_unstale":"2023-03-27T10:09:52.082142+0000","last_undegraded":"2023-03-27T10:09:52.082142+0000","last_fullsized":"2023-03-27T10:09:52.082142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107471+0000","last_change":"2023-03-27T10:09:52.104706+0000","last_active":"2023-03-27T10:09:52.107471+0000","last_peered":"2023-03-27T10:09:52.107471+0000","last_clean":"2023-03-27T10:09:52.107471+0000","last_became_active":"2023-03-27T10:09:52.104399+0000","last_became_peered":"2023-03-27T10:09:52.104399+0000","last_unstale":"2023-03-27T10:09:52.107471+0000","last_undegraded":"2023-03-27T10:09:52.107471+0000","last_fullsized":"2023-03-27T10:09:52.107471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.082273+0000","last_change":"2023-03-27T10:09:51.622460+0000","last_active":"2023-03-27T10:09:52.082273+0000","last_peered":"2023-03-27T10:09:52.082273+0000","last_clean":"2023-03-27T10:09:52.082273+0000","last_became_active":"2023-03-27T10:09:51.622173+0000","last_became_peered":"2023-03-27T10:09:51.622173+0000","last_unstale":"2023-03-27T10:09:52.082273+0000","last_undegraded":"2023-03-27T10:09:52.082273+0000","last_fullsized":"2023-03-27T10:09:52.082273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:52.390198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.091661+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:52.091661+0000","last_peered":"2023-03-27T10:09:52.091661+0000","last_clean":"2023-03-27T10:09:52.091661+0000","last_became_active":"2023-03-27T10:09:52.089994+0000","last_became_peered":"2023-03-27T10:09:52.089994+0000","last_unstale":"2023-03-27T10:09:52.091661+0000","last_undegraded":"2023-03-27T10:09:52.091661+0000","last_fullsized":"2023-03-27T10:09:52.091661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105130+0000","last_change":"2023-03-27T10:09:51.617245+0000","last_active":"2023-03-27T10:09:52.105130+0000","last_peered":"2023-03-27T10:09:52.105130+0000","last_clean":"2023-03-27T10:09:52.105130+0000","last_became_active":"2023-03-27T10:09:51.616762+0000","last_became_peered":"2023-03-27T10:09:51.616762+0000","last_unstale":"2023-03-27T10:09:52.105130+0000","last_undegraded":"2023-03-27T10:09:52.105130+0000","last_fullsized":"2023-03-27T10:09:52.105130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076949+0000","last_change":"2023-03-27T10:09:52.095172+0000","last_active":"2023-03-27T10:09:53.076949+0000","last_peered":"2023-03-27T10:09:53.076949+0000","last_clean":"2023-03-27T10:09:53.076949+0000","last_became_active":"2023-03-27T10:09:52.093048+0000","last_became_peered":"2023-03-27T10:09:52.093048+0000","last_unstale":"2023-03-27T10:09:53.076949+0000","last_undegraded":"2023-03-27T10:09:53.076949+0000","last_fullsized":"2023-03-27T10:09:53.076949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105411+0000","last_change":"2023-03-27T10:09:51.622695+0000","last_active":"2023-03-27T10:09:52.105411+0000","last_peered":"2023-03-27T10:09:52.105411+0000","last_clean":"2023-03-27T10:09:52.105411+0000","last_became_active":"2023-03-27T10:09:51.622334+0000","last_became_peered":"2023-03-27T10:09:51.622334+0000","last_unstale":"2023-03-27T10:09:52.105411+0000","last_undegraded":"2023-03-27T10:09:52.105411+0000","last_fullsized":"2023-03-27T10:09:52.105411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:43.245212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.107439+0000","last_change":"2023-03-27T10:09:52.103636+0000","last_active":"2023-03-27T10:09:52.107439+0000","last_peered":"2023-03-27T10:09:52.107439+0000","last_clean":"2023-03-27T10:09:52.107439+0000","last_became_active":"2023-03-27T10:09:52.103345+0000","last_became_peered":"2023-03-27T10:09:52.103345+0000","last_unstale":"2023-03-27T10:09:52.107439+0000","last_undegraded":"2023-03-27T10:09:52.107439+0000","last_fullsized":"2023-03-27T10:09:52.107439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105368+0000","last_change":"2023-03-27T10:09:51.621953+0000","last_active":"2023-03-27T10:09:52.105368+0000","last_peered":"2023-03-27T10:09:52.105368+0000","last_clean":"2023-03-27T10:09:52.105368+0000","last_became_active":"2023-03-27T10:09:51.621630+0000","last_became_peered":"2023-03-27T10:09:51.621630+0000","last_unstale":"2023-03-27T10:09:52.105368+0000","last_undegraded":"2023-03-27T10:09:52.105368+0000","last_fullsized":"2023-03-27T10:09:52.105368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077921+0000","last_change":"2023-03-27T10:09:52.101803+0000","last_active":"2023-03-27T10:09:53.077921+0000","last_peered":"2023-03-27T10:09:53.077921+0000","last_clean":"2023-03-27T10:09:53.077921+0000","last_became_active":"2023-03-27T10:09:52.100140+0000","last_became_peered":"2023-03-27T10:09:52.100140+0000","last_unstale":"2023-03-27T10:09:53.077921+0000","last_undegraded":"2023-03-27T10:09:53.077921+0000","last_fullsized":"2023-03-27T10:09:53.077921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:52:48.138618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.106946+0000","last_change":"2023-03-27T10:09:51.620614+0000","last_active":"2023-03-27T10:09:52.106946+0000","last_peered":"2023-03-27T10:09:52.106946+0000","last_clean":"2023-03-27T10:09:52.106946+0000","last_became_active":"2023-03-27T10:09:51.620331+0000","last_became_peered":"2023-03-27T10:09:51.620331+0000","last_unstale":"2023-03-27T10:09:52.106946+0000","last_undegraded":"2023-03-27T10:09:52.106946+0000","last_fullsized":"2023-03-27T10:09:52.106946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102144+0000","last_change":"2023-03-27T10:09:52.097480+0000","last_active":"2023-03-27T10:09:52.102144+0000","last_peered":"2023-03-27T10:09:52.102144+0000","last_clean":"2023-03-27T10:09:52.102144+0000","last_became_active":"2023-03-27T10:09:52.097210+0000","last_became_peered":"2023-03-27T10:09:52.097210+0000","last_unstale":"2023-03-27T10:09:52.102144+0000","last_undegraded":"2023-03-27T10:09:52.102144+0000","last_fullsized":"2023-03-27T10:09:52.102144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:53:27.358285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.081030+0000","last_change":"2023-03-27T10:09:51.615276+0000","last_active":"2023-03-27T10:09:52.081030+0000","last_peered":"2023-03-27T10:09:52.081030+0000","last_clean":"2023-03-27T10:09:52.081030+0000","last_became_active":"2023-03-27T10:09:51.614739+0000","last_became_peered":"2023-03-27T10:09:51.614739+0000","last_unstale":"2023-03-27T10:09:52.081030+0000","last_undegraded":"2023-03-27T10:09:52.081030+0000","last_fullsized":"2023-03-27T10:09:52.081030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110000+0000","last_change":"2023-03-27T10:09:52.106003+0000","last_active":"2023-03-27T10:09:52.110000+0000","last_peered":"2023-03-27T10:09:52.110000+0000","last_clean":"2023-03-27T10:09:52.110000+0000","last_became_active":"2023-03-27T10:09:52.105235+0000","last_became_peered":"2023-03-27T10:09:52.105235+0000","last_unstale":"2023-03-27T10:09:52.110000+0000","last_undegraded":"2023-03-27T10:09:52.110000+0000","last_fullsized":"2023-03-27T10:09:52.110000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076894+0000","last_change":"2023-03-27T10:09:51.614759+0000","last_active":"2023-03-27T10:09:53.076894+0000","last_peered":"2023-03-27T10:09:53.076894+0000","last_clean":"2023-03-27T10:09:53.076894+0000","last_became_active":"2023-03-27T10:09:51.613946+0000","last_became_peered":"2023-03-27T10:09:51.613946+0000","last_unstale":"2023-03-27T10:09:53.076894+0000","last_undegraded":"2023-03-27T10:09:53.076894+0000","last_fullsized":"2023-03-27T10:09:53.076894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078757+0000","last_change":"2023-03-27T10:09:52.099430+0000","last_active":"2023-03-27T10:09:53.078757+0000","last_peered":"2023-03-27T10:09:53.078757+0000","last_clean":"2023-03-27T10:09:53.078757+0000","last_became_active":"2023-03-27T10:09:52.098704+0000","last_became_peered":"2023-03-27T10:09:52.098704+0000","last_unstale":"2023-03-27T10:09:53.078757+0000","last_undegraded":"2023-03-27T10:09:53.078757+0000","last_fullsized":"2023-03-27T10:09:53.078757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083352+0000","last_change":"2023-03-27T10:09:51.618553+0000","last_active":"2023-03-27T10:09:52.083352+0000","last_peered":"2023-03-27T10:09:52.083352+0000","last_clean":"2023-03-27T10:09:52.083352+0000","last_became_active":"2023-03-27T10:09:51.618221+0000","last_became_peered":"2023-03-27T10:09:51.618221+0000","last_unstale":"2023-03-27T10:09:52.083352+0000","last_undegraded":"2023-03-27T10:09:52.083352+0000","last_fullsized":"2023-03-27T10:09:52.083352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078676+0000","last_change":"2023-03-27T10:09:52.097963+0000","last_active":"2023-03-27T10:09:53.078676+0000","last_peered":"2023-03-27T10:09:53.078676+0000","last_clean":"2023-03-27T10:09:53.078676+0000","last_became_active":"2023-03-27T10:09:52.097246+0000","last_became_peered":"2023-03-27T10:09:52.097246+0000","last_unstale":"2023-03-27T10:09:53.078676+0000","last_undegraded":"2023-03-27T10:09:53.078676+0000","last_fullsized":"2023-03-27T10:09:53.078676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078174+0000","last_change":"2023-03-27T10:09:51.607348+0000","last_active":"2023-03-27T10:09:53.078174+0000","last_peered":"2023-03-27T10:09:53.078174+0000","last_clean":"2023-03-27T10:09:53.078174+0000","last_became_active":"2023-03-27T10:09:51.605922+0000","last_became_peered":"2023-03-27T10:09:51.605922+0000","last_unstale":"2023-03-27T10:09:53.078174+0000","last_undegraded":"2023-03-27T10:09:53.078174+0000","last_fullsized":"2023-03-27T10:09:53.078174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:42:49.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078583+0000","last_change":"2023-03-27T10:09:52.095246+0000","last_active":"2023-03-27T10:09:53.078583+0000","last_peered":"2023-03-27T10:09:53.078583+0000","last_clean":"2023-03-27T10:09:53.078583+0000","last_became_active":"2023-03-27T10:09:52.094368+0000","last_became_peered":"2023-03-27T10:09:52.094368+0000","last_unstale":"2023-03-27T10:09:53.078583+0000","last_undegraded":"2023-03-27T10:09:53.078583+0000","last_fullsized":"2023-03-27T10:09:53.078583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076378+0000","last_change":"2023-03-27T10:09:51.615859+0000","last_active":"2023-03-27T10:09:53.076378+0000","last_peered":"2023-03-27T10:09:53.076378+0000","last_clean":"2023-03-27T10:09:53.076378+0000","last_became_active":"2023-03-27T10:09:51.615589+0000","last_became_peered":"2023-03-27T10:09:51.615589+0000","last_unstale":"2023-03-27T10:09:53.076378+0000","last_undegraded":"2023-03-27T10:09:53.076378+0000","last_fullsized":"2023-03-27T10:09:53.076378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.110141+0000","last_change":"2023-03-27T10:09:52.108218+0000","last_active":"2023-03-27T10:09:52.110141+0000","last_peered":"2023-03-27T10:09:52.110141+0000","last_clean":"2023-03-27T10:09:52.110141+0000","last_became_active":"2023-03-27T10:09:52.107884+0000","last_became_peered":"2023-03-27T10:09:52.107884+0000","last_unstale":"2023-03-27T10:09:52.110141+0000","last_undegraded":"2023-03-27T10:09:52.110141+0000","last_fullsized":"2023-03-27T10:09:52.110141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.602634+0000","last_change":"2023-03-27T10:09:46.107098+0000","last_active":"2023-03-27T10:09:51.602634+0000","last_peered":"2023-03-27T10:09:51.602634+0000","last_clean":"2023-03-27T10:09:51.602634+0000","last_became_active":"2023-03-27T10:09:46.106831+0000","last_became_peered":"2023-03-27T10:09:46.106831+0000","last_unstale":"2023-03-27T10:09:51.602634+0000","last_undegraded":"2023-03-27T10:09:51.602634+0000","last_fullsized":"2023-03-27T10:09:51.602634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083641+0000","last_change":"2023-03-27T10:09:51.614610+0000","last_active":"2023-03-27T10:09:52.083641+0000","last_peered":"2023-03-27T10:09:52.083641+0000","last_clean":"2023-03-27T10:09:52.083641+0000","last_became_active":"2023-03-27T10:09:51.614320+0000","last_became_peered":"2023-03-27T10:09:51.614320+0000","last_unstale":"2023-03-27T10:09:52.083641+0000","last_undegraded":"2023-03-27T10:09:52.083641+0000","last_fullsized":"2023-03-27T10:09:52.083641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.104202+0000","last_change":"2023-03-27T10:09:52.102379+0000","last_active":"2023-03-27T10:09:52.104202+0000","last_peered":"2023-03-27T10:09:52.104202+0000","last_clean":"2023-03-27T10:09:52.104202+0000","last_became_active":"2023-03-27T10:09:52.102073+0000","last_became_peered":"2023-03-27T10:09:52.102073+0000","last_unstale":"2023-03-27T10:09:52.104202+0000","last_undegraded":"2023-03-27T10:09:52.104202+0000","last_fullsized":"2023-03-27T10:09:52.104202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.601745+0000","last_change":"2023-03-27T10:09:46.107305+0000","last_active":"2023-03-27T10:09:51.601745+0000","last_peered":"2023-03-27T10:09:51.601745+0000","last_clean":"2023-03-27T10:09:51.601745+0000","last_became_active":"2023-03-27T10:09:46.107038+0000","last_became_peered":"2023-03-27T10:09:46.107038+0000","last_unstale":"2023-03-27T10:09:51.601745+0000","last_undegraded":"2023-03-27T10:09:51.601745+0000","last_fullsized":"2023-03-27T10:09:51.601745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078493+0000","last_change":"2023-03-27T10:09:51.619230+0000","last_active":"2023-03-27T10:09:53.078493+0000","last_peered":"2023-03-27T10:09:53.078493+0000","last_clean":"2023-03-27T10:09:53.078493+0000","last_became_active":"2023-03-27T10:09:51.618937+0000","last_became_peered":"2023-03-27T10:09:51.618937+0000","last_unstale":"2023-03-27T10:09:53.078493+0000","last_undegraded":"2023-03-27T10:09:53.078493+0000","last_fullsized":"2023-03-27T10:09:53.078493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:22:21.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101646+0000","last_change":"2023-03-27T10:09:52.099004+0000","last_active":"2023-03-27T10:09:52.101646+0000","last_peered":"2023-03-27T10:09:52.101646+0000","last_clean":"2023-03-27T10:09:52.101646+0000","last_became_active":"2023-03-27T10:09:52.098396+0000","last_became_peered":"2023-03-27T10:09:52.098396+0000","last_unstale":"2023-03-27T10:09:52.101646+0000","last_undegraded":"2023-03-27T10:09:52.101646+0000","last_fullsized":"2023-03-27T10:09:52.101646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.076320+0000","last_change":"2023-03-27T10:09:46.326263+0000","last_active":"2023-03-27T10:09:52.076320+0000","last_peered":"2023-03-27T10:09:52.076320+0000","last_clean":"2023-03-27T10:09:52.076320+0000","last_became_active":"2023-03-27T10:09:46.325963+0000","last_became_peered":"2023-03-27T10:09:46.325963+0000","last_unstale":"2023-03-27T10:09:52.076320+0000","last_undegraded":"2023-03-27T10:09:52.076320+0000","last_fullsized":"2023-03-27T10:09:52.076320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.099686+0000","last_change":"2023-03-27T10:09:51.614527+0000","last_active":"2023-03-27T10:09:52.099686+0000","last_peered":"2023-03-27T10:09:52.099686+0000","last_clean":"2023-03-27T10:09:52.099686+0000","last_became_active":"2023-03-27T10:09:51.614208+0000","last_became_peered":"2023-03-27T10:09:51.614208+0000","last_unstale":"2023-03-27T10:09:52.099686+0000","last_undegraded":"2023-03-27T10:09:52.099686+0000","last_fullsized":"2023-03-27T10:09:52.099686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.101254+0000","last_change":"2023-03-27T10:09:52.096517+0000","last_active":"2023-03-27T10:09:52.101254+0000","last_peered":"2023-03-27T10:09:52.101254+0000","last_clean":"2023-03-27T10:09:52.101254+0000","last_became_active":"2023-03-27T10:09:52.096184+0000","last_became_peered":"2023-03-27T10:09:52.096184+0000","last_unstale":"2023-03-27T10:09:52.101254+0000","last_undegraded":"2023-03-27T10:09:52.101254+0000","last_fullsized":"2023-03-27T10:09:52.101254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.601700+0000","last_change":"2023-03-27T10:09:46.106690+0000","last_active":"2023-03-27T10:09:51.601700+0000","last_peered":"2023-03-27T10:09:51.601700+0000","last_clean":"2023-03-27T10:09:51.601700+0000","last_became_active":"2023-03-27T10:09:46.106393+0000","last_became_peered":"2023-03-27T10:09:46.106393+0000","last_unstale":"2023-03-27T10:09:51.601700+0000","last_undegraded":"2023-03-27T10:09:51.601700+0000","last_fullsized":"2023-03-27T10:09:51.601700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.610552+0000","last_change":"2023-03-27T10:09:40.691310+0000","last_active":"2023-03-27T10:09:51.610552+0000","last_peered":"2023-03-27T10:09:51.610552+0000","last_clean":"2023-03-27T10:09:51.610552+0000","last_became_active":"2023-03-27T10:09:40.690248+0000","last_became_peered":"2023-03-27T10:09:40.690248+0000","last_unstale":"2023-03-27T10:09:51.610552+0000","last_undegraded":"2023-03-27T10:09:51.610552+0000","last_fullsized":"2023-03-27T10:09:51.610552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_clean_scrub_stamp":"2023-03-27T10:09:39.335229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:58:29.036302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076523+0000","last_change":"2023-03-27T10:09:51.612759+0000","last_active":"2023-03-27T10:09:53.076523+0000","last_peered":"2023-03-27T10:09:53.076523+0000","last_clean":"2023-03-27T10:09:53.076523+0000","last_became_active":"2023-03-27T10:09:51.612495+0000","last_became_peered":"2023-03-27T10:09:51.612495+0000","last_unstale":"2023-03-27T10:09:53.076523+0000","last_undegraded":"2023-03-27T10:09:53.076523+0000","last_fullsized":"2023-03-27T10:09:53.076523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102717+0000","last_change":"2023-03-27T10:09:52.100115+0000","last_active":"2023-03-27T10:09:52.102717+0000","last_peered":"2023-03-27T10:09:52.102717+0000","last_clean":"2023-03-27T10:09:52.102717+0000","last_became_active":"2023-03-27T10:09:52.099833+0000","last_became_peered":"2023-03-27T10:09:52.099833+0000","last_unstale":"2023-03-27T10:09:52.102717+0000","last_undegraded":"2023-03-27T10:09:52.102717+0000","last_fullsized":"2023-03-27T10:09:52.102717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:02:14.752486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.610714+0000","last_change":"2023-03-27T10:09:46.108163+0000","last_active":"2023-03-27T10:09:51.610714+0000","last_peered":"2023-03-27T10:09:51.610714+0000","last_clean":"2023-03-27T10:09:51.610714+0000","last_became_active":"2023-03-27T10:09:46.107807+0000","last_became_peered":"2023-03-27T10:09:46.107807+0000","last_unstale":"2023-03-27T10:09:51.610714+0000","last_undegraded":"2023-03-27T10:09:51.610714+0000","last_fullsized":"2023-03-27T10:09:51.610714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.081140+0000","last_change":"2023-03-27T10:09:51.620513+0000","last_active":"2023-03-27T10:09:52.081140+0000","last_peered":"2023-03-27T10:09:52.081140+0000","last_clean":"2023-03-27T10:09:52.081140+0000","last_became_active":"2023-03-27T10:09:51.620285+0000","last_became_peered":"2023-03-27T10:09:51.620285+0000","last_unstale":"2023-03-27T10:09:52.081140+0000","last_undegraded":"2023-03-27T10:09:52.081140+0000","last_fullsized":"2023-03-27T10:09:52.081140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.109724+0000","last_change":"2023-03-27T10:09:52.103681+0000","last_active":"2023-03-27T10:09:52.109724+0000","last_peered":"2023-03-27T10:09:52.109724+0000","last_clean":"2023-03-27T10:09:52.109724+0000","last_became_active":"2023-03-27T10:09:52.103419+0000","last_became_peered":"2023-03-27T10:09:52.103419+0000","last_unstale":"2023-03-27T10:09:52.109724+0000","last_undegraded":"2023-03-27T10:09:52.109724+0000","last_fullsized":"2023-03-27T10:09:52.109724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.612157+0000","last_change":"2023-03-27T10:09:46.107100+0000","last_active":"2023-03-27T10:09:51.612157+0000","last_peered":"2023-03-27T10:09:51.612157+0000","last_clean":"2023-03-27T10:09:51.612157+0000","last_became_active":"2023-03-27T10:09:46.106766+0000","last_became_peered":"2023-03-27T10:09:46.106766+0000","last_unstale":"2023-03-27T10:09:51.612157+0000","last_undegraded":"2023-03-27T10:09:51.612157+0000","last_fullsized":"2023-03-27T10:09:51.612157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:44:01.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097652+0000","last_change":"2023-03-27T10:09:51.611165+0000","last_active":"2023-03-27T10:09:52.097652+0000","last_peered":"2023-03-27T10:09:52.097652+0000","last_clean":"2023-03-27T10:09:52.097652+0000","last_became_active":"2023-03-27T10:09:51.610854+0000","last_became_peered":"2023-03-27T10:09:51.610854+0000","last_unstale":"2023-03-27T10:09:52.097652+0000","last_undegraded":"2023-03-27T10:09:52.097652+0000","last_fullsized":"2023-03-27T10:09:52.097652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.091916+0000","last_change":"2023-03-27T10:09:52.088129+0000","last_active":"2023-03-27T10:09:52.091916+0000","last_peered":"2023-03-27T10:09:52.091916+0000","last_clean":"2023-03-27T10:09:52.091916+0000","last_became_active":"2023-03-27T10:09:52.087826+0000","last_became_peered":"2023-03-27T10:09:52.087826+0000","last_unstale":"2023-03-27T10:09:52.091916+0000","last_undegraded":"2023-03-27T10:09:52.091916+0000","last_fullsized":"2023-03-27T10:09:52.091916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077036+0000","last_change":"2023-03-27T10:09:51.614313+0000","last_active":"2023-03-27T10:09:53.077036+0000","last_peered":"2023-03-27T10:09:53.077036+0000","last_clean":"2023-03-27T10:09:53.077036+0000","last_became_active":"2023-03-27T10:09:51.613995+0000","last_became_peered":"2023-03-27T10:09:51.613995+0000","last_unstale":"2023-03-27T10:09:53.077036+0000","last_undegraded":"2023-03-27T10:09:53.077036+0000","last_fullsized":"2023-03-27T10:09:53.077036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.603077+0000","last_change":"2023-03-27T10:09:46.108779+0000","last_active":"2023-03-27T10:09:51.603077+0000","last_peered":"2023-03-27T10:09:51.603077+0000","last_clean":"2023-03-27T10:09:51.603077+0000","last_became_active":"2023-03-27T10:09:46.108307+0000","last_became_peered":"2023-03-27T10:09:46.108307+0000","last_unstale":"2023-03-27T10:09:51.603077+0000","last_undegraded":"2023-03-27T10:09:51.603077+0000","last_fullsized":"2023-03-27T10:09:51.603077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076313+0000","last_change":"2023-03-27T10:09:52.089355+0000","last_active":"2023-03-27T10:09:53.076313+0000","last_peered":"2023-03-27T10:09:53.076313+0000","last_clean":"2023-03-27T10:09:53.076313+0000","last_became_active":"2023-03-27T10:09:52.089075+0000","last_became_peered":"2023-03-27T10:09:52.089075+0000","last_unstale":"2023-03-27T10:09:53.076313+0000","last_undegraded":"2023-03-27T10:09:53.076313+0000","last_fullsized":"2023-03-27T10:09:53.076313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-03-27T10:09:51.606687+0000","last_change":"2023-03-27T10:09:46.108791+0000","last_active":"2023-03-27T10:09:51.606687+0000","last_peered":"2023-03-27T10:09:51.606687+0000","last_clean":"2023-03-27T10:09:51.606687+0000","last_became_active":"2023-03-27T10:09:46.108203+0000","last_became_peered":"2023-03-27T10:09:46.108203+0000","last_unstale":"2023-03-27T10:09:51.606687+0000","last_undegraded":"2023-03-27T10:09:51.606687+0000","last_fullsized":"2023-03-27T10:09:51.606687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083550+0000","last_change":"2023-03-27T10:09:51.617246+0000","last_active":"2023-03-27T10:09:52.083550+0000","last_peered":"2023-03-27T10:09:52.083550+0000","last_clean":"2023-03-27T10:09:52.083550+0000","last_became_active":"2023-03-27T10:09:51.616745+0000","last_became_peered":"2023-03-27T10:09:51.616745+0000","last_unstale":"2023-03-27T10:09:52.083550+0000","last_undegraded":"2023-03-27T10:09:52.083550+0000","last_fullsized":"2023-03-27T10:09:52.083550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078179+0000","last_change":"2023-03-27T10:09:52.100091+0000","last_active":"2023-03-27T10:09:53.078179+0000","last_peered":"2023-03-27T10:09:53.078179+0000","last_clean":"2023-03-27T10:09:53.078179+0000","last_became_active":"2023-03-27T10:09:52.099822+0000","last_became_peered":"2023-03-27T10:09:52.099822+0000","last_unstale":"2023-03-27T10:09:53.078179+0000","last_undegraded":"2023-03-27T10:09:53.078179+0000","last_fullsized":"2023-03-27T10:09:53.078179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105474+0000","last_change":"2023-03-27T10:09:51.624415+0000","last_active":"2023-03-27T10:09:52.105474+0000","last_peered":"2023-03-27T10:09:52.105474+0000","last_clean":"2023-03-27T10:09:52.105474+0000","last_became_active":"2023-03-27T10:09:51.624151+0000","last_became_peered":"2023-03-27T10:09:51.624151+0000","last_unstale":"2023-03-27T10:09:52.105474+0000","last_undegraded":"2023-03-27T10:09:52.105474+0000","last_fullsized":"2023-03-27T10:09:52.105474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078453+0000","last_change":"2023-03-27T10:09:52.097854+0000","last_active":"2023-03-27T10:09:53.078453+0000","last_peered":"2023-03-27T10:09:53.078453+0000","last_clean":"2023-03-27T10:09:53.078453+0000","last_became_active":"2023-03-27T10:09:52.097592+0000","last_became_peered":"2023-03-27T10:09:52.097592+0000","last_unstale":"2023-03-27T10:09:53.078453+0000","last_undegraded":"2023-03-27T10:09:53.078453+0000","last_fullsized":"2023-03-27T10:09:53.078453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105707+0000","last_change":"2023-03-27T10:09:51.620648+0000","last_active":"2023-03-27T10:09:52.105707+0000","last_peered":"2023-03-27T10:09:52.105707+0000","last_clean":"2023-03-27T10:09:52.105707+0000","last_became_active":"2023-03-27T10:09:51.620327+0000","last_became_peered":"2023-03-27T10:09:51.620327+0000","last_unstale":"2023-03-27T10:09:52.105707+0000","last_undegraded":"2023-03-27T10:09:52.105707+0000","last_fullsized":"2023-03-27T10:09:52.105707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078428+0000","last_change":"2023-03-27T10:09:52.083060+0000","last_active":"2023-03-27T10:09:53.078428+0000","last_peered":"2023-03-27T10:09:53.078428+0000","last_clean":"2023-03-27T10:09:53.078428+0000","last_became_active":"2023-03-27T10:09:52.082804+0000","last_became_peered":"2023-03-27T10:09:52.082804+0000","last_unstale":"2023-03-27T10:09:53.078428+0000","last_undegraded":"2023-03-27T10:09:53.078428+0000","last_fullsized":"2023-03-27T10:09:53.078428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.105416+0000","last_change":"2023-03-27T10:09:51.620593+0000","last_active":"2023-03-27T10:09:52.105416+0000","last_peered":"2023-03-27T10:09:52.105416+0000","last_clean":"2023-03-27T10:09:52.105416+0000","last_became_active":"2023-03-27T10:09:51.620287+0000","last_became_peered":"2023-03-27T10:09:51.620287+0000","last_unstale":"2023-03-27T10:09:52.105416+0000","last_undegraded":"2023-03-27T10:09:52.105416+0000","last_fullsized":"2023-03-27T10:09:52.105416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078402+0000","last_change":"2023-03-27T10:09:52.080606+0000","last_active":"2023-03-27T10:09:53.078402+0000","last_peered":"2023-03-27T10:09:53.078402+0000","last_clean":"2023-03-27T10:09:53.078402+0000","last_became_active":"2023-03-27T10:09:52.080331+0000","last_became_peered":"2023-03-27T10:09:52.080331+0000","last_unstale":"2023-03-27T10:09:53.078402+0000","last_undegraded":"2023-03-27T10:09:53.078402+0000","last_fullsized":"2023-03-27T10:09:53.078402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076857+0000","last_change":"2023-03-27T10:09:51.616366+0000","last_active":"2023-03-27T10:09:53.076857+0000","last_peered":"2023-03-27T10:09:53.076857+0000","last_clean":"2023-03-27T10:09:53.076857+0000","last_became_active":"2023-03-27T10:09:51.615908+0000","last_became_peered":"2023-03-27T10:09:51.615908+0000","last_unstale":"2023-03-27T10:09:53.076857+0000","last_undegraded":"2023-03-27T10:09:53.076857+0000","last_fullsized":"2023-03-27T10:09:53.076857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076487+0000","last_change":"2023-03-27T10:09:52.102730+0000","last_active":"2023-03-27T10:09:53.076487+0000","last_peered":"2023-03-27T10:09:53.076487+0000","last_clean":"2023-03-27T10:09:53.076487+0000","last_became_active":"2023-03-27T10:09:52.102450+0000","last_became_peered":"2023-03-27T10:09:52.102450+0000","last_unstale":"2023-03-27T10:09:53.076487+0000","last_undegraded":"2023-03-27T10:09:53.076487+0000","last_fullsized":"2023-03-27T10:09:53.076487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.096625+0000","last_change":"2023-03-27T10:09:51.621408+0000","last_active":"2023-03-27T10:09:52.096625+0000","last_peered":"2023-03-27T10:09:52.096625+0000","last_clean":"2023-03-27T10:09:52.096625+0000","last_became_active":"2023-03-27T10:09:51.620743+0000","last_became_peered":"2023-03-27T10:09:51.620743+0000","last_unstale":"2023-03-27T10:09:52.096625+0000","last_undegraded":"2023-03-27T10:09:52.096625+0000","last_fullsized":"2023-03-27T10:09:52.096625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077753+0000","last_change":"2023-03-27T10:09:52.088963+0000","last_active":"2023-03-27T10:09:53.077753+0000","last_peered":"2023-03-27T10:09:53.077753+0000","last_clean":"2023-03-27T10:09:53.077753+0000","last_became_active":"2023-03-27T10:09:52.088695+0000","last_became_peered":"2023-03-27T10:09:52.088695+0000","last_unstale":"2023-03-27T10:09:53.077753+0000","last_undegraded":"2023-03-27T10:09:53.077753+0000","last_fullsized":"2023-03-27T10:09:53.077753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102986+0000","last_change":"2023-03-27T10:09:52.098801+0000","last_active":"2023-03-27T10:09:52.102986+0000","last_peered":"2023-03-27T10:09:52.102986+0000","last_clean":"2023-03-27T10:09:52.102986+0000","last_became_active":"2023-03-27T10:09:52.098214+0000","last_became_peered":"2023-03-27T10:09:52.098214+0000","last_unstale":"2023-03-27T10:09:52.102986+0000","last_undegraded":"2023-03-27T10:09:52.102986+0000","last_fullsized":"2023-03-27T10:09:52.102986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076365+0000","last_change":"2023-03-27T10:09:52.101353+0000","last_active":"2023-03-27T10:09:53.076365+0000","last_peered":"2023-03-27T10:09:53.076365+0000","last_clean":"2023-03-27T10:09:53.076365+0000","last_became_active":"2023-03-27T10:09:52.101060+0000","last_became_peered":"2023-03-27T10:09:52.101060+0000","last_unstale":"2023-03-27T10:09:53.076365+0000","last_undegraded":"2023-03-27T10:09:53.076365+0000","last_fullsized":"2023-03-27T10:09:53.076365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078027+0000","last_change":"2023-03-27T10:09:52.090063+0000","last_active":"2023-03-27T10:09:53.078027+0000","last_peered":"2023-03-27T10:09:53.078027+0000","last_clean":"2023-03-27T10:09:53.078027+0000","last_became_active":"2023-03-27T10:09:52.089785+0000","last_became_peered":"2023-03-27T10:09:52.089785+0000","last_unstale":"2023-03-27T10:09:53.078027+0000","last_undegraded":"2023-03-27T10:09:53.078027+0000","last_fullsized":"2023-03-27T10:09:53.078027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:23:37.734370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076654+0000","last_change":"2023-03-27T10:09:52.102062+0000","last_active":"2023-03-27T10:09:53.076654+0000","last_peered":"2023-03-27T10:09:53.076654+0000","last_clean":"2023-03-27T10:09:53.076654+0000","last_became_active":"2023-03-27T10:09:52.101762+0000","last_became_peered":"2023-03-27T10:09:52.101762+0000","last_unstale":"2023-03-27T10:09:53.076654+0000","last_undegraded":"2023-03-27T10:09:53.076654+0000","last_fullsized":"2023-03-27T10:09:53.076654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.102774+0000","last_change":"2023-03-27T10:09:52.100627+0000","last_active":"2023-03-27T10:09:52.102774+0000","last_peered":"2023-03-27T10:09:52.102774+0000","last_clean":"2023-03-27T10:09:52.102774+0000","last_became_active":"2023-03-27T10:09:52.100237+0000","last_became_peered":"2023-03-27T10:09:52.100237+0000","last_unstale":"2023-03-27T10:09:52.102774+0000","last_undegraded":"2023-03-27T10:09:52.102774+0000","last_fullsized":"2023-03-27T10:09:52.102774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7936,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363904,"statfs":{"total":96636764160,"available":96628637696,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":679465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":87333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":678267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":88937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":87969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":87333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-27T10:09:56.848 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-27T10:09:56.849 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-27T10:09:56.849 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-27T10:09:56.850 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-27T10:09:56.850 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-27T10:09:57.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.068+0000 7f37c07ff700 1 Processor -- start 2023-03-27T10:09:57.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.068+0000 7f37c07ff700 1 -- start start 2023-03-27T10:09:57.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37c07ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37b815c8f0 0x7f37b806f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37c07ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b80cb3a0 con 0x7f37b80cd760 2023-03-27T10:09:57.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37c07ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b806b9a0 con 0x7f37b806be30 2023-03-27T10:09:57.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37c07ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b8070220 con 0x7f37b815c8f0 2023-03-27T10:09:57.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37bdd9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37b815c8f0 0x7f37b806f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37bdd9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37b815c8f0 0x7f37b806f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40504/0 (socket says 172.21.15.172:40504) 2023-03-27T10:09:57.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37be59b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f37b80cd760 0x7f37b80cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53012/0 (socket says 172.21.15.172:53012) 2023-03-27T10:09:57.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.069+0000 7f37bdd9a700 1 -- 172.21.15.172:0/1936490381 learned_addr learned my addr 172.21.15.172:0/1936490381 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:57.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bdd9a700 1 -- 172.21.15.172:0/1936490381 >> v1:172.21.15.191:6789/0 conn(0x7f37b806be30 legacy=0x7f37b806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:57.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bdd9a700 1 -- 172.21.15.172:0/1936490381 >> v1:172.21.15.172:6789/0 conn(0x7f37b80cd760 legacy=0x7f37b80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bdd9a700 1 -- 172.21.15.172:0/1936490381 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80d07b0 con 0x7f37b815c8f0 2023-03-27T10:09:57.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bdd9a700 1 --2- 172.21.15.172:0/1936490381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b815c8f0 0x7f37b806f710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098f0 tx=0x7f37a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507968cb63b9c678 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bd599700 1 -- 172.21.15.172:0/1936490381 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8004230 con 0x7f37b815c8f0 2023-03-27T10:09:57.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bd599700 1 -- 172.21.15.172:0/1936490381 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8004390 con 0x7f37b815c8f0 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.070+0000 7f37bd599700 1 -- 172.21.15.172:0/1936490381 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80036a0 con 0x7f37b815c8f0 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 -- 172.21.15.172:0/1936490381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b815c8f0 msgr2=0x7f37b806f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 --2- 172.21.15.172:0/1936490381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b815c8f0 0x7f37b806f710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37a80098f0 tx=0x7f37a8009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 -- 172.21.15.172:0/1936490381 shutdown_connections 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 --2- 172.21.15.172:0/1936490381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b815c8f0 0x7f37b806f710 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 -- 172.21.15.172:0/1936490381 >> 172.21.15.172:0/1936490381 conn(0x7f37b806dd60 msgr2=0x7f37b806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:57.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 -- 172.21.15.172:0/1936490381 shutdown_connections 2023-03-27T10:09:57.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.071+0000 7f37c07ff700 1 -- 172.21.15.172:0/1936490381 wait complete. 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.072+0000 7f37c07ff700 1 Processor -- start 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 -- start start 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 0x7f37b8153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37b80cd760 0x7f37b8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37b815c8f0 0x7f37b8158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81541f0 con 0x7f37b806be30 2023-03-27T10:09:57.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80b25f0 con 0x7f37b80cd760 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.073+0000 7f37c07ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80b28d0 con 0x7f37b815c8f0 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 0x7f37b8153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 0x7f37b8153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40516/0 (socket says 172.21.15.172:40516) 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 -- 172.21.15.172:0/3713977873 learned_addr learned my addr 172.21.15.172:0/3713977873 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37bdd9a700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37b80cd760 0x7f37b8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37bed9c700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37b815c8f0 0x7f37b8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 -- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37b815c8f0 msgr2=0x7f37b8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37b815c8f0 0x7f37b8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 -- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37b80cd760 msgr2=0x7f37b8157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37b80cd760 0x7f37b8157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 -- 172.21.15.172:0/3713977873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009550 con 0x7f37b806be30 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37bed9c700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37b815c8f0 0x7f37b8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37bdd9a700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37b80cd760 0x7f37b8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37be59b700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 0x7f37b8153cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c430 tx=0x7f37b400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4005cb0 con 0x7f37b806be30 2023-03-27T10:09:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.074+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4005e10 con 0x7f37b806be30 2023-03-27T10:09:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.075+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b806b350 con 0x7f37b806be30 2023-03-27T10:09:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.075+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40072d0 con 0x7f37b806be30 2023-03-27T10:09:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.075+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b80d0a90 con 0x7f37b806be30 2023-03-27T10:09:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.076+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b806b630 con 0x7f37b806be30 2023-03-27T10:09:57.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.076+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f37b4019030 con 0x7f37b806be30 2023-03-27T10:09:57.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.078+0000 7f37aeffd700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f379c066e30 0x7f379c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.078+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37b4083450 con 0x7f37b806be30 2023-03-27T10:09:57.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.078+0000 7f37bdd9a700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f379c066e30 0x7f379c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.079+0000 7f37bdd9a700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f379c066e30 0x7f379c0692e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37b815ccc0 tx=0x7f37a8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.082+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f37b404b4f0 con 0x7f37b806be30 2023-03-27T10:09:57.285 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T10:09:57.287+0000 7f85877f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-27T10:09:57.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.324+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f37b8074290 con 0x7f37b806be30 2023-03-27T10:09:57.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.327+0000 7f37aeffd700 1 -- 172.21.15.172:0/3713977873 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163991 (secure 0 0 0) 0x7f37b40490b0 con 0x7f37b806be30 2023-03-27T10:09:57.327 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:57.328 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f379c066e30 msgr2=0x7f379c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f379c066e30 0x7f379c0692e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37b815ccc0 tx=0x7f37a8008030 comp rx=0 tx=0).stop 2023-03-27T10:09:57.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 msgr2=0x7f37b8153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 0x7f37b8153cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c430 tx=0x7f37b400c7f0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 shutdown_connections 2023-03-27T10:09:57.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37b815c8f0 0x7f37b8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b806be30 0x7f37b8153cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f379c066e30 0x7f379c0692e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 --2- 172.21.15.172:0/3713977873 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37b80cd760 0x7f37b8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 >> 172.21.15.172:0/3713977873 conn(0x7f37b806dd60 msgr2=0x7f37b806f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:57.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 shutdown_connections 2023-03-27T10:09:57.330 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.330+0000 7f37c07ff700 1 -- 172.21.15.172:0/3713977873 wait complete. 2023-03-27T10:09:57.346 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":109700},{"type":"v1","addr":"172.21.15.191:6833","nonce":109700}]},"active_addr":"172.21.15.191:6833/109700","active_change":"2023-03-27T10:09:31.262690+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4112,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":1234359270}]},{"addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2798902827}]},{"addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":702064024}]},{"addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2946533644}]}]}} 2023-03-27T10:09:57.350 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-27T10:09:57.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-27T10:09:57.351 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:57.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.537+0000 7f5d6efff700 1 Processor -- start 2023-03-27T10:09:57.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.537+0000 7f5d6efff700 1 -- start start 2023-03-27T10:09:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.538+0000 7f5d6efff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5d680d0b90 0x7f5d680ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.538+0000 7f5d6efff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 0x7f5d680d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d6efff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d680d14a0 con 0x7f5d680cd610 2023-03-27T10:09:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d6efff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d680cebc0 con 0x7f5d680d0b90 2023-03-27T10:09:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d6efff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680ceea0 con 0x7f5d6815ca20 2023-03-27T10:09:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d6d59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5d680cd610 0x7f5d680cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53014/0 (socket says 172.21.15.172:53014) 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d6d59c700 1 -- 172.21.15.172:0/1184677140 learned_addr learned my addr 172.21.15.172:0/1184677140 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d6cd9b700 1 --2- 172.21.15.172:0/1184677140 >> v2:172.21.15.191:3300/0 conn(0x7f5d680d0b90 0x7f5d680ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d67fff700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 0x7f5d680d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015828990 0 0) 0x7f5d680d14a0 con 0x7f5d680cd610 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d580035b0 con 0x7f5d680cd610 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041246731 0 0) 0x7f5d580035b0 con 0x7f5d680cd610 2023-03-27T10:09:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 msgr2=0x7f5d680d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 0x7f5d680d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 >> v2:172.21.15.191:3300/0 conn(0x7f5d680d0b90 msgr2=0x7f5d680ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 --2- 172.21.15.172:0/1184677140 >> v2:172.21.15.191:3300/0 conn(0x7f5d680d0b90 0x7f5d680ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680cf180 con 0x7f5d680cd610 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.539+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7f5d600019f0 con 0x7f5d680cd610 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 >> v1:172.21.15.172:6789/0 conn(0x7f5d680cd610 legacy=0x7f5d680cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d58003a70 0x7f5d58003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d58004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 0x7f5d58005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680cebc0 con 0x7f5d58004850 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680ceea0 con 0x7f5d58003a70 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5800ba40 con 0x7f5d6815ca20 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d67fff700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d58004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d6cd9b700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d58003a70 0x7f5d58003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d6d59c700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 0x7f5d58005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d67fff700 1 -- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 msgr2=0x7f5d58005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d67fff700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d6815ca20 0x7f5d58005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d67fff700 1 -- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d58003a70 msgr2=0x7f5d58003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d67fff700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d58003a70 0x7f5d58003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.540+0000 7f5d67fff700 1 -- 172.21.15.172:0/1184677140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d580035b0 con 0x7f5d58004850 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d67fff700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d58004cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009b30 tx=0x7f5d58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07ebbd95ec55b9a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400e6c0 con 0x7f5d58004850 2023-03-27T10:09:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400e820 con 0x7f5d58004850 2023-03-27T10:09:57.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d677fe700 1 -- 172.21.15.172:0/1184677140 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400eb90 con 0x7f5d58004850 2023-03-27T10:09:57.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6efff700 1 -- 172.21.15.172:0/1184677140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 msgr2=0x7f5d58004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6efff700 1 --2- 172.21.15.172:0/1184677140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d58004cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009b30 tx=0x7f5d58005880 comp rx=0 tx=0).stop 2023-03-27T10:09:57.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6d59c700 1 -- 172.21.15.172:0/1184677140 reap_dead start 2023-03-27T10:09:57.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6efff700 1 -- 172.21.15.172:0/1184677140 shutdown_connections 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6efff700 1 -- 172.21.15.172:0/1184677140 >> 172.21.15.172:0/1184677140 conn(0x7f5d680721f0 msgr2=0x7f5d6809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6efff700 1 -- 172.21.15.172:0/1184677140 shutdown_connections 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.541+0000 7f5d6efff700 1 -- 172.21.15.172:0/1184677140 wait complete. 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.544+0000 7f5d6efff700 1 Processor -- start 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.544+0000 7f5d6efff700 1 -- start start 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6efff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d681f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6efff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d680b4b20 0x7f5d681f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6efff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d681f5ee0 0x7f5d681f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6efff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d681e4ee0 con 0x7f5d58004850 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6efff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680b7140 con 0x7f5d681f5ee0 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6efff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680b5090 con 0x7f5d680b4b20 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.545+0000 7f5d6cd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d681f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d681f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40528/0 (socket says 172.21.15.172:40528) 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 -- 172.21.15.172:0/3817266498 learned_addr learned my addr 172.21.15.172:0/3817266498 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:57.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d67fff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d680b4b20 0x7f5d681f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6d59c700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d681f5ee0 0x7f5d681f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 -- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d680b4b20 msgr2=0x7f5d681f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d680b4b20 0x7f5d681f59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 -- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d681f5ee0 msgr2=0x7f5d681f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d681f5ee0 0x7f5d681f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 -- 172.21.15.172:0/3817266498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680afc50 con 0x7f5d58004850 2023-03-27T10:09:57.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6d59c700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d681f5ee0 0x7f5d681f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6cd9b700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d681f1df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c011a70 tx=0x7f5d5c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c005a20 con 0x7f5d58004850 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c005b80 con 0x7f5d58004850 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c00fa00 con 0x7f5d58004850 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.546+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d680cf460 con 0x7f5d58004850 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.547+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d680d2d30 con 0x7f5d58004850 2023-03-27T10:09:57.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.547+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d681e5180 con 0x7f5d58004850 2023-03-27T10:09:57.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.548+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f5d5c024070 con 0x7f5d58004850 2023-03-27T10:09:57.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.549+0000 7f5d657fa700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5d4c066e30 0x7f5d4c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.550+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d5c0846d0 con 0x7f5d58004850 2023-03-27T10:09:57.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.550+0000 7f5d67fff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5d4c066e30 0x7f5d4c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.550+0000 7f5d67fff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5d4c066e30 0x7f5d4c0692e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d540090b0 tx=0x7f5d54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.553+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f5d5c051910 con 0x7f5d58004850 2023-03-27T10:09:57.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.742+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d68074290 con 0x7f5d58004850 2023-03-27T10:09:57.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.743+0000 7f5d657fa700 1 -- 172.21.15.172:0/3817266498 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f5d5c022020 con 0x7f5d58004850 2023-03-27T10:09:57.742 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:57.743 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:57.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5d4c066e30 msgr2=0x7f5d4c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5d4c066e30 0x7f5d4c0692e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d540090b0 tx=0x7f5d54008030 comp rx=0 tx=0).stop 2023-03-27T10:09:57.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 msgr2=0x7f5d681f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d681f1df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c011a70 tx=0x7f5d5c011e30 comp rx=0 tx=0).stop 2023-03-27T10:09:57.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 shutdown_connections 2023-03-27T10:09:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5d4c066e30 0x7f5d4c0692e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d681f5ee0 0x7f5d681f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d58004850 0x7f5d681f1df0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 --2- 172.21.15.172:0/3817266498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d680b4b20 0x7f5d681f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 >> 172.21.15.172:0/3817266498 conn(0x7f5d680721f0 msgr2=0x7f5d681e1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:57.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 shutdown_connections 2023-03-27T10:09:57.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.746+0000 7f5d6efff700 1 -- 172.21.15.172:0/3817266498 wait complete. 2023-03-27T10:09:57.762 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-27T10:09:57.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:09:57.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.949+0000 7f7f173ff700 1 Processor -- start 2023-03-27T10:09:57.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.949+0000 7f7f173ff700 1 -- start start 2023-03-27T10:09:57.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f173ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7f100cd760 0x7f7f100cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f173ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f1015c8f0 0x7f7f1006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f173ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100cb3a0 con 0x7f7f100b27d0 2023-03-27T10:09:57.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f173ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1006b9a0 con 0x7f7f1015c8f0 2023-03-27T10:09:57.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f173ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f10070220 con 0x7f7f100cd760 2023-03-27T10:09:57.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1499a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f1015c8f0 0x7f7f1006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1499a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f1015c8f0 0x7f7f1006f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40534/0 (socket says 172.21.15.172:40534) 2023-03-27T10:09:57.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1499a700 1 -- 172.21.15.172:0/3903655968 learned_addr learned my addr 172.21.15.172:0/3903655968 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:57.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1519b700 1 --2- 172.21.15.172:0/3903655968 >> v2:172.21.15.191:3300/0 conn(0x7f7f100cd760 0x7f7f100cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1499a700 1 -- 172.21.15.172:0/3903655968 >> v2:172.21.15.191:3300/0 conn(0x7f7f100cd760 msgr2=0x7f7f100cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:57.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1499a700 1 --2- 172.21.15.172:0/3903655968 >> v2:172.21.15.191:3300/0 conn(0x7f7f100cd760 0x7f7f100cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.950+0000 7f7f1499a700 1 -- 172.21.15.172:0/3903655968 >> v1:172.21.15.191:6789/0 conn(0x7f7f100b27d0 legacy=0x7f7f100b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.952 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f1499a700 1 -- 172.21.15.172:0/3903655968 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100ce070 con 0x7f7f1015c8f0 2023-03-27T10:09:57.952 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f1499a700 1 --2- 172.21.15.172:0/3903655968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f1015c8f0 0x7f7f1006f710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7f10071ad0 tx=0x7f7f00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86dc67dfc51ab62 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.952 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f07fff700 1 -- 172.21.15.172:0/3903655968 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000b870 con 0x7f7f1015c8f0 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f07fff700 1 -- 172.21.15.172:0/3903655968 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0000b9d0 con 0x7f7f1015c8f0 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f07fff700 1 -- 172.21.15.172:0/3903655968 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000bd60 con 0x7f7f1015c8f0 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f173ff700 1 -- 172.21.15.172:0/3903655968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f1015c8f0 msgr2=0x7f7f1006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.951+0000 7f7f173ff700 1 --2- 172.21.15.172:0/3903655968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f1015c8f0 0x7f7f1006f710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7f10071ad0 tx=0x7f7f00009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.952+0000 7f7f173ff700 1 -- 172.21.15.172:0/3903655968 shutdown_connections 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.952+0000 7f7f173ff700 1 --2- 172.21.15.172:0/3903655968 >> v2:172.21.15.191:3300/0 conn(0x7f7f100cd760 0x7f7f100cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.952+0000 7f7f173ff700 1 --2- 172.21.15.172:0/3903655968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f1015c8f0 0x7f7f1006f710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.954 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.952+0000 7f7f173ff700 1 -- 172.21.15.172:0/3903655968 >> 172.21.15.172:0/3903655968 conn(0x7f7f1006dd60 msgr2=0x7f7f1006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:57.954 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.952+0000 7f7f173ff700 1 -- 172.21.15.172:0/3903655968 shutdown_connections 2023-03-27T10:09:57.954 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.952+0000 7f7f173ff700 1 -- 172.21.15.172:0/3903655968 wait complete. 2023-03-27T10:09:57.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.953+0000 7f7f173ff700 1 Processor -- start 2023-03-27T10:09:57.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.953+0000 7f7f173ff700 1 -- start start 2023-03-27T10:09:57.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.954+0000 7f7f173ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100b27d0 0x7f7f100c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.954+0000 7f7f173ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 0x7f7f100b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.954+0000 7f7f173ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f1015c8f0 0x7f7f100b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.954+0000 7f7f173ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1015f940 con 0x7f7f100cd760 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.954+0000 7f7f173ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1015ecc0 con 0x7f7f100b27d0 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.954+0000 7f7f173ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1015efa0 con 0x7f7f1015c8f0 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 0x7f7f100b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 0x7f7f100b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40544/0 (socket says 172.21.15.172:40544) 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 -- 172.21.15.172:0/2898070338 learned_addr learned my addr 172.21.15.172:0/2898070338 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:57.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1519b700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100b27d0 0x7f7f100c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1599c700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f1015c8f0 0x7f7f100b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 -- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f1015c8f0 msgr2=0x7f7f100b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f1015c8f0 0x7f7f100b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 -- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100b27d0 msgr2=0x7f7f100c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100b27d0 0x7f7f100c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 -- 172.21.15.172:0/2898070338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009550 con 0x7f7f100cd760 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1599c700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f1015c8f0 0x7f7f100b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:57.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f1499a700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 0x7f7f100b2ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f00000c00 tx=0x7f7f00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00004540 con 0x7f7f100cd760 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.955+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f000036a0 con 0x7f7f100cd760 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.956+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f100d0a90 con 0x7f7f100cd760 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.956+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00003a30 con 0x7f7f100cd760 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.956+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f100d07b0 con 0x7f7f100cd760 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.957+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1006b350 con 0x7f7f100cd760 2023-03-27T10:09:57.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.957+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7f0000f050 con 0x7f7f100cd760 2023-03-27T10:09:57.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.958+0000 7f7f05ffb700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7ef4066e30 0x7f7ef40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:57.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.958+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f00085bb0 con 0x7f7f100cd760 2023-03-27T10:09:57.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.959+0000 7f7f1519b700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7ef4066e30 0x7f7ef40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:57.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.959+0000 7f7f1519b700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7ef4066e30 0x7f7ef40692e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00b9b0 tx=0x7f7f0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:57.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:57.962+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f7f00052df0 con 0x7f7f100cd760 2023-03-27T10:09:58.149 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.151+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f1015fa80 con 0x7f7f100cd760 2023-03-27T10:09:58.150 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.152+0000 7f7f05ffb700 1 -- 172.21.15.172:0/2898070338 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f7f1015fa80 con 0x7f7f100cd760 2023-03-27T10:09:58.151 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:09:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:09:58.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7ef4066e30 msgr2=0x7f7ef40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7ef4066e30 0x7f7ef40692e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00b9b0 tx=0x7f7f0c008040 comp rx=0 tx=0).stop 2023-03-27T10:09:58.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 msgr2=0x7f7f100b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 0x7f7f100b2ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f00000c00 tx=0x7f7f00004750 comp rx=0 tx=0).stop 2023-03-27T10:09:58.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 shutdown_connections 2023-03-27T10:09:58.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f1015c8f0 0x7f7f100b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7ef4066e30 0x7f7ef40692e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f100b27d0 0x7f7f100c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 --2- 172.21.15.172:0/2898070338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f100cd760 0x7f7f100b2ba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 >> 172.21.15.172:0/2898070338 conn(0x7f7f1006dd60 msgr2=0x7f7f1006f710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 shutdown_connections 2023-03-27T10:09:58.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.154+0000 7f7f173ff700 1 -- 172.21.15.172:0/2898070338 wait complete. 2023-03-27T10:09:58.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-27T10:09:58.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-03-27T10:09:58.172 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-03-27T10:09:58.172 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-03-27T10:09:58.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-03-27T10:09:58.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-03-27T10:09:58.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-03-27T10:09:58.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-03-27T10:09:58.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.499+0000 7f0dba7ff700 1 Processor -- start 2023-03-27T10:09:58.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.499+0000 7f0dba7ff700 1 -- start start 2023-03-27T10:09:58.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.502+0000 7f0dba7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0db40c1d10 0x7f0db41652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.502+0000 7f0dba7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406c1d0 con 0x7f0db406fa10 2023-03-27T10:09:58.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.502+0000 7f0dba7ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db4162220 con 0x7f0db4160fc0 2023-03-27T10:09:58.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.502+0000 7f0dba7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db4071870 con 0x7f0db40c1d10 2023-03-27T10:09:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.503+0000 7f0db3fff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f0db4160fc0 0x7f0db4164be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48412/0 (socket says 172.21.15.172:48412) 2023-03-27T10:09:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.503+0000 7f0db3fff700 1 -- 172.21.15.172:0/3046310717 learned_addr learned my addr 172.21.15.172:0/3046310717 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.504+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467559420 0 0) 0x7f0db4162220 con 0x7f0db4160fc0 2023-03-27T10:09:58.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.504+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d9c0035b0 con 0x7f0db4160fc0 2023-03-27T10:09:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1074570343 0 0) 0x7f0d9c0035b0 con 0x7f0db4160fc0 2023-03-27T10:09:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 >> v2:172.21.15.172:3300/0 conn(0x7f0db40c1d10 msgr2=0x7f0db41652f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-27T10:09:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 --2- 172.21.15.172:0/3046310717 >> v2:172.21.15.172:3300/0 conn(0x7f0db40c1d10 0x7f0db41652f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 >> v1:172.21.15.172:6789/0 conn(0x7f0db406fa10 legacy=0x7f0db406fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 --> v1:172.21.15.191:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4071b50 con 0x7f0db4160fc0 2023-03-27T10:09:58.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 <== mon.1 v1:172.21.15.191:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7f0dac0019f0 con 0x7f0db4160fc0 2023-03-27T10:09:58.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 >> v1:172.21.15.191:6789/0 conn(0x7f0db4160fc0 legacy=0x7f0db4164be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0d9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d9c004850 0x7f0d9c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d9c005400 0x7f0d9c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4071870 con 0x7f0d9c005400 2023-03-27T10:09:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c00c2a0 con 0x7f0d9c004850 2023-03-27T10:09:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.505+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c00c460 con 0x7f0d9c003a00 2023-03-27T10:09:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0d9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db8d9c700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d9c005400 0x7f0d9c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db3fff700 1 -- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d9c004850 msgr2=0x7f0d9c004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-27T10:09:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d9c004850 0x7f0d9c004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db3fff700 1 -- 172.21.15.172:0/3046310717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d9c005400 msgr2=0x7f0d9c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d9c005400 0x7f0d9c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db3fff700 1 -- 172.21.15.172:0/3046310717 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4071b50 con 0x7f0d9c003a00 2023-03-27T10:09:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.506+0000 7f0db8d9c700 1 -- 172.21.15.172:0/3046310717 reap_dead start 2023-03-27T10:09:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.507+0000 7f9357dff700 1 Processor -- start 2023-03-27T10:09:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.507+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0d9c003e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00a870 tx=0x7f0d9c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76ab4075efb4e1f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.507+0000 7f9357dff700 1 -- start start 2023-03-27T10:09:58.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.508+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac012600 con 0x7f0d9c003a00 2023-03-27T10:09:58.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.508+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac012760 con 0x7f0d9c003a00 2023-03-27T10:09:58.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.508+0000 7f0db2ffd700 1 -- 172.21.15.172:0/3046310717 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac012ad0 con 0x7f0d9c003a00 2023-03-27T10:09:58.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 msgr2=0x7f0d9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f0dba7ff700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0d9c003e10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00a870 tx=0x7f0d9c005880 comp rx=0 tx=0).stop 2023-03-27T10:09:58.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f9357dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f935006dff0 0x7f93500c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f9357dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9350159c10 0x7f93500ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f9357dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500cafa0 con 0x7f93500cf280 2023-03-27T10:09:58.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f9357dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935015d770 con 0x7f9350159c10 2023-03-27T10:09:58.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.509+0000 7f9357dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500cb280 con 0x7f935006dff0 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f935006dff0 0x7f93500c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f935006dff0 0x7f93500c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:57958/0 (socket says 172.21.15.172:57958) 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 -- 172.21.15.172:0/2933424932 learned_addr learned my addr 172.21.15.172:0/2933424932 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 -- 172.21.15.172:0/2933424932 >> v2:172.21.15.172:3300/0 conn(0x7f9350159c10 msgr2=0x7f93500ced40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 --2- 172.21.15.172:0/2933424932 >> v2:172.21.15.172:3300/0 conn(0x7f9350159c10 0x7f93500ced40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 -- 172.21.15.172:0/2933424932 >> v1:172.21.15.191:6789/0 conn(0x7f93500cf280 legacy=0x7f93500cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.510+0000 7f9355b9b700 1 -- 172.21.15.172:0/2933424932 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500cdc50 con 0x7f935006dff0 2023-03-27T10:09:58.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3046310717 shutdown_connections 2023-03-27T10:09:58.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f0dba7ff700 1 --2- 172.21.15.172:0/3046310717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0d9c003e10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3046310717 >> 172.21.15.172:0/3046310717 conn(0x7f0db406d510 msgr2=0x7f0db406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f9355b9b700 1 --2- 172.21.15.172:0/2933424932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f935006dff0 0x7f93500c9180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f935006e590 tx=0x7f9340009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9302241e171c2d02 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3046310717 shutdown_connections 2023-03-27T10:09:58.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.512+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3046310717 wait complete. 2023-03-27T10:09:58.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.514+0000 7f0dba7ff700 1 Processor -- start 2023-03-27T10:09:58.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.515+0000 7f0dba7ff700 1 -- start start 2023-03-27T10:09:58.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f0dba7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0db40c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f0dba7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db40b3af0 0x7f0db40b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f0dba7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0db41f5a90 0x7f0db41f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f0dba7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40c70c0 con 0x7f0db40b3af0 2023-03-27T10:09:58.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f0dba7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40c6350 con 0x7f0db41f5a90 2023-03-27T10:09:58.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f0dba7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40b4480 con 0x7f0d9c003a00 2023-03-27T10:09:58.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f9354b99700 1 -- 172.21.15.172:0/2933424932 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000b870 con 0x7f935006dff0 2023-03-27T10:09:58.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f9354b99700 1 -- 172.21.15.172:0/2933424932 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934000b9d0 con 0x7f935006dff0 2023-03-27T10:09:58.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.511+0000 7f9354b99700 1 -- 172.21.15.172:0/2933424932 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000bd60 con 0x7f935006dff0 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.512+0000 7f9357dff700 1 -- 172.21.15.172:0/2933424932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f935006dff0 msgr2=0x7f93500c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.512+0000 7f9357dff700 1 --2- 172.21.15.172:0/2933424932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f935006dff0 0x7f93500c9180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f935006e590 tx=0x7f9340009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.514+0000 7f9357dff700 1 -- 172.21.15.172:0/2933424932 shutdown_connections 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.514+0000 7f9357dff700 1 --2- 172.21.15.172:0/2933424932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f935006dff0 0x7f93500c9180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.514+0000 7f9357dff700 1 --2- 172.21.15.172:0/2933424932 >> v2:172.21.15.172:3300/0 conn(0x7f9350159c10 0x7f93500ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.514+0000 7f9357dff700 1 -- 172.21.15.172:0/2933424932 >> 172.21.15.172:0/2933424932 conn(0x7f935006d510 msgr2=0x7f935006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f9357dff700 1 -- 172.21.15.172:0/2933424932 shutdown_connections 2023-03-27T10:09:58.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.516+0000 7f9357dff700 1 -- 172.21.15.172:0/2933424932 wait complete. 2023-03-27T10:09:58.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0db40c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0db40c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55788/0 (socket says 172.21.15.172:55788) 2023-03-27T10:09:58.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db3fff700 1 -- 172.21.15.172:0/3297955989 learned_addr learned my addr 172.21.15.172:0/3297955989 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db8d9c700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0db41f5a90 0x7f0db41f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db37fe700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db40b3af0 0x7f0db40b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db3fff700 1 -- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0db41f5a90 msgr2=0x7f0db41f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0db41f5a90 0x7f0db41f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.517+0000 7f0db3fff700 1 -- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db40b3af0 msgr2=0x7f0db40b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db40b3af0 0x7f0db40b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db3fff700 1 -- 172.21.15.172:0/3297955989 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db406c700 con 0x7f0d9c003a00 2023-03-27T10:09:58.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db37fe700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db40b3af0 0x7f0db40b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:58.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db3fff700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0db40c5e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00ae60 tx=0x7f0dac001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac001f30 con 0x7f0d9c003a00 2023-03-27T10:09:58.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac01e600 con 0x7f0d9c003a00 2023-03-27T10:09:58.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.518+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac01e9b0 con 0x7f0d9c003a00 2023-03-27T10:09:58.523 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.519+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db406c420 con 0x7f0d9c003a00 2023-03-27T10:09:58.523 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.519+0000 7f9357dff700 1 Processor -- start 2023-03-27T10:09:58.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.519+0000 7f9357dff700 1 -- start start 2023-03-27T10:09:58.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41626b0 con 0x7f0d9c003a00 2023-03-27T10:09:58.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f9357dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f935006dff0 0x7f93500c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f9357dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9350159c10 0x7f935015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f9357dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f935015ae10 0x7f935015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f9357dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500c5100 con 0x7f935006dff0 2023-03-27T10:09:58.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f9357dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500c4e20 con 0x7f9350159c10 2023-03-27T10:09:58.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.520+0000 7f9357dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935014c7b0 con 0x7f935015ae10 2023-03-27T10:09:58.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.521+0000 7f935639c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f935015ae10 0x7f935015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.521+0000 7f935639c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f935015ae10 0x7f935015a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55792/0 (socket says 172.21.15.172:55792) 2023-03-27T10:09:58.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.521+0000 7f935639c700 1 -- 172.21.15.172:0/644951468 learned_addr learned my addr 172.21.15.172:0/644951468 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.522+0000 7f9355b9b700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f935006dff0 0x7f93500c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.521+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0db4074300 con 0x7f0d9c003a00 2023-03-27T10:09:58.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.522+0000 7f935539a700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9350159c10 0x7f935015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.522+0000 7f7613dff700 1 Processor -- start 2023-03-27T10:09:58.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.522+0000 7fe4eefff700 1 Processor -- start 2023-03-27T10:09:58.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.522+0000 7fe4eefff700 1 -- start start 2023-03-27T10:09:58.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.523+0000 7f935639c700 1 -- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9350159c10 msgr2=0x7f935015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.523+0000 7f935639c700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9350159c10 0x7f935015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.523+0000 7f935639c700 1 -- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f935006dff0 msgr2=0x7f93500c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.523+0000 7f935639c700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f935006dff0 0x7f93500c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.523+0000 7f935639c700 1 -- 172.21.15.172:0/644951468 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009550 con 0x7f935015ae10 2023-03-27T10:09:58.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.522+0000 7f7613dff700 1 -- start start 2023-03-27T10:09:58.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.523+0000 7fe4eefff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e80cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7fe4eefff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e806ff00 con 0x7fe4e80703e0 2023-03-27T10:09:58.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7fe4eefff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e80cf3d0 con 0x7fe4e808a570 2023-03-27T10:09:58.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7fe4eefff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80cbaa0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7fe4ecd9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e80cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7fe4ecd9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e80cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55806/0 (socket says 172.21.15.172:55806) 2023-03-27T10:09:58.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7fe4ecd9b700 1 -- 172.21.15.172:0/3975925393 learned_addr learned my addr 172.21.15.172:0/3975925393 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7fe4ecd9b700 1 -- 172.21.15.172:0/3975925393 >> v1:172.21.15.191:6789/0 conn(0x7fe4e808a570 legacy=0x7fe4e80cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7fe4ecd9b700 1 -- 172.21.15.172:0/3975925393 >> v1:172.21.15.172:6789/0 conn(0x7fe4e80703e0 legacy=0x7fe4e8070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7fe4ecd9b700 1 -- 172.21.15.172:0/3975925393 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80cbd80 con 0x7fe4e80ceac0 2023-03-27T10:09:58.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7fe4e77fe700 1 -- 172.21.15.172:0/3975925393 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611056465 0 0) 0x7fe4e806ff00 con 0x7fe4e80703e0 2023-03-27T10:09:58.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7f7613dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c06dff0 0x7f760c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f7613dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f760c0cc700 0x7f760c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f7613dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0cd0a0 con 0x7f760c159c10 2023-03-27T10:09:58.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f7613dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c15d770 con 0x7f760c0cc700 2023-03-27T10:09:58.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f7613dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0cf450 con 0x7f760c06dff0 2023-03-27T10:09:58.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7fe4ecd9b700 1 --2- 172.21.15.172:0/3975925393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e80cee90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009e80 tx=0x7fe4e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485a24958ac86487 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f935639c700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f935015ae10 0x7f935015a740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f934800cbc0 tx=0x7f934800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7fe4e77fe700 1 -- 172.21.15.172:0/3975925393 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000e070 con 0x7fe4e80ceac0 2023-03-27T10:09:58.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7fe4e77fe700 1 -- 172.21.15.172:0/3975925393 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0003a20 con 0x7fe4e80ceac0 2023-03-27T10:09:58.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7fe4e77fe700 1 -- 172.21.15.172:0/3975925393 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0003dd0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f761139a700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f760c159c10 0x7f760c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48448/0 (socket says 172.21.15.172:48448) 2023-03-27T10:09:58.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f761139a700 1 -- 172.21.15.172:0/3427415217 learned_addr learned my addr 172.21.15.172:0/3427415217 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:58.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.524+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0dac024030 con 0x7f0d9c003a00 2023-03-27T10:09:58.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f0db0ff9700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0da0066f00 0x7f0da00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.525+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0dac086740 con 0x7f0d9c003a00 2023-03-27T10:09:58.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f0db0ff9700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] conn(0x7f0da006f7b0 0x7f0da0071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 --> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0da0072270 con 0x7f0da006f7b0 2023-03-27T10:09:58.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dac086af0 con 0x7f0d9c003a00 2023-03-27T10:09:58.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f761239c700 1 --2- 172.21.15.172:0/3427415217 >> v2:172.21.15.172:3300/0 conn(0x7f760c0cc700 0x7f760c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f0db37fe700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0da0066f00 0x7f0da00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 -- 172.21.15.172:0/3975925393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 msgr2=0x7fe4e80cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 --2- 172.21.15.172:0/3975925393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e80cee90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009e80 tx=0x7fe4e000b330 comp rx=0 tx=0).stop 2023-03-27T10:09:58.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f7611b9b700 1 --2- 172.21.15.172:0/3427415217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c06dff0 0x7f760c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.526+0000 7f7610b99700 1 -- 172.21.15.172:0/3427415217 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275331551 0 0) 0x7f760c0cd0a0 con 0x7f760c159c10 2023-03-27T10:09:58.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f7610b99700 1 -- 172.21.15.172:0/3427415217 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f80035b0 con 0x7f760c159c10 2023-03-27T10:09:58.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f0db8d9c700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] conn(0x7f0da006f7b0 0x7f0da0071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f1c58dff700 1 Processor -- start 2023-03-27T10:09:58.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f1c58dff700 1 -- start start 2023-03-27T10:09:58.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 -- 172.21.15.172:0/3975925393 shutdown_connections 2023-03-27T10:09:58.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 --2- 172.21.15.172:0/3975925393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e80cee90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 -- 172.21.15.172:0/3975925393 >> 172.21.15.172:0/3975925393 conn(0x7fe4e806d510 msgr2=0x7fe4e806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 -- 172.21.15.172:0/3975925393 shutdown_connections 2023-03-27T10:09:58.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f761239c700 1 -- 172.21.15.172:0/3427415217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c06dff0 msgr2=0x7f760c0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f761239c700 1 --2- 172.21.15.172:0/3427415217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c06dff0 0x7f760c0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f761239c700 1 -- 172.21.15.172:0/3427415217 >> v1:172.21.15.191:6789/0 conn(0x7f760c159c10 legacy=0x7f760c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f761239c700 1 -- 172.21.15.172:0/3427415217 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0cafa0 con 0x7f760c0cc700 2023-03-27T10:09:58.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7f761239c700 1 --2- 172.21.15.172:0/3427415217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 0x7f760c0ccb60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7604009840 tx=0x7f7604009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad74b37cdbc8518 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f0db37fe700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0da0066f00 0x7f0da00693b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0db40686b0 tx=0x7f0da4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348003c00 con 0x7f935015ae10 2023-03-27T10:09:58.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9348003d60 con 0x7f935015ae10 2023-03-27T10:09:58.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800aae0 con 0x7f935015ae10 2023-03-27T10:09:58.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935015a070 con 0x7f935015ae10 2023-03-27T10:09:58.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f0db8d9c700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] conn(0x7f0da006f7b0 0x7f0da0071bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f7610b99700 1 -- 172.21.15.172:0/3427415217 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604011830 con 0x7f760c0cc700 2023-03-27T10:09:58.549 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f7610b99700 1 -- 172.21.15.172:0/3427415217 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604011990 con 0x7f760c0cc700 2023-03-27T10:09:58.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.528+0000 7f7610b99700 1 -- 172.21.15.172:0/3427415217 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604011d00 con 0x7f760c0cc700 2023-03-27T10:09:58.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93500cdf30 con 0x7f935015ae10 2023-03-27T10:09:58.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7f1c58dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 0x7f1c54164be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7f1c58dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c5406fa10 0x7f1c5406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7f1c58dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5406c1d0 con 0x7f1c540c1d10 2023-03-27T10:09:58.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7f1c58dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c54162220 con 0x7f1c5406fa10 2023-03-27T10:09:58.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7f1c58dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54071870 con 0x7f1c54160fc0 2023-03-27T10:09:58.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f1c5259c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 0x7f1c54164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.527+0000 7fe4eefff700 1 -- 172.21.15.172:0/3975925393 wait complete. 2023-03-27T10:09:58.553 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7fe4eefff700 1 Processor -- start 2023-03-27T10:09:58.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f7613dff700 1 -- 172.21.15.172:0/3427415217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 msgr2=0x7f760c0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f7613dff700 1 --2- 172.21.15.172:0/3427415217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 0x7f760c0ccb60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7604009840 tx=0x7f7604009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:58.554 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f7613dff700 1 -- 172.21.15.172:0/3427415217 shutdown_connections 2023-03-27T10:09:58.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f7613dff700 1 --2- 172.21.15.172:0/3427415217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 0x7f760c0ccb60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f7613dff700 1 --2- 172.21.15.172:0/3427415217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c06dff0 0x7f760c0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f7613dff700 1 -- 172.21.15.172:0/3427415217 >> 172.21.15.172:0/3427415217 conn(0x7f760c06d510 msgr2=0x7f760c06d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.529+0000 7fa6fe3ff700 1 Processor -- start 2023-03-27T10:09:58.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f1c5259c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 0x7f1c54164be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55828/0 (socket says 172.21.15.172:55828) 2023-03-27T10:09:58.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f1c5259c700 1 -- 172.21.15.172:0/2790442978 learned_addr learned my addr 172.21.15.172:0/2790442978 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f1c5259c700 1 -- 172.21.15.172:0/2790442978 >> v2:172.21.15.172:3300/0 conn(0x7f1c5406fa10 msgr2=0x7f1c5406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f1c5259c700 1 --2- 172.21.15.172:0/2790442978 >> v2:172.21.15.172:3300/0 conn(0x7f1c5406fa10 0x7f1c5406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f1c5259c700 1 -- 172.21.15.172:0/2790442978 >> v1:172.21.15.172:6789/0 conn(0x7f1c540c1d10 legacy=0x7f1c54165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f1c5259c700 1 -- 172.21.15.172:0/2790442978 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54071b50 con 0x7f1c54160fc0 2023-03-27T10:09:58.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f7613dff700 1 -- 172.21.15.172:0/3427415217 shutdown_connections 2023-03-27T10:09:58.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== osd.0 v2:172.21.15.172:6800/110158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f0da0072270 con 0x7f0da006f7b0 2023-03-27T10:09:58.559 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f1c5259c700 1 --2- 172.21.15.172:0/2790442978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 0x7f1c54164be0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098f0 tx=0x7f1c44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84e68d3564e9442f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.559 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7fe4eefff700 1 -- start start 2023-03-27T10:09:58.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4eefff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4e80703e0 0x7fe4e80c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4eefff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4e808a570 0x7fe4e80b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4eefff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e816ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4eefff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80b03f0 con 0x7fe4e808a570 2023-03-27T10:09:58.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4eefff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80af7e0 con 0x7fe4e80703e0 2023-03-27T10:09:58.561 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4eefff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80afac0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.561 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.530+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93500cabc0 con 0x7f935015ae10 2023-03-27T10:09:58.561 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f9348010050 con 0x7f935015ae10 2023-03-27T10:09:58.561 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7f1c5159a700 1 -- 172.21.15.172:0/2790442978 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44004230 con 0x7f1c54160fc0 2023-03-27T10:09:58.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7f1c5159a700 1 -- 172.21.15.172:0/2790442978 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44004390 con 0x7f1c54160fc0 2023-03-27T10:09:58.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7f1c5159a700 1 -- 172.21.15.172:0/2790442978 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c440036a0 con 0x7f1c54160fc0 2023-03-27T10:09:58.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4e7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4e808a570 0x7fe4e80b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4e7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4e808a570 0x7fe4e80b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40602/0 (socket says 172.21.15.172:40602) 2023-03-27T10:09:58.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4e7fff700 1 -- 172.21.15.172:0/2292540099 learned_addr learned my addr 172.21.15.172:0/2292540099 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.532+0000 7fe4ed59c700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e816ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fe4ecd9b700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4e80703e0 0x7fe4e80c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fe4ed59c700 1 -- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4e80703e0 msgr2=0x7fe4e80c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fe4ed59c700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4e80703e0 0x7fe4e80c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fe4ed59c700 1 -- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4e808a570 msgr2=0x7fe4e80b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fe4ed59c700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4e808a570 0x7fe4e80b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fe4ed59c700 1 -- 172.21.15.172:0/2292540099 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0009b30 con 0x7fe4e80ceac0 2023-03-27T10:09:58.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7fa6fe3ff700 1 -- start start 2023-03-27T10:09:58.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fa6fe3ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6f8070b10 0x7fa6f806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fa6fe3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa6f8165360 0x7fa6f806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fa6fe3ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f8071740 con 0x7fa6f81657d0 2023-03-27T10:09:58.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fa6fe3ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f8164ed0 con 0x7fa6f8070b10 2023-03-27T10:09:58.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.533+0000 7fa6fe3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f8164ba0 con 0x7fa6f8165360 2023-03-27T10:09:58.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7f1c58dff700 1 -- 172.21.15.172:0/2790442978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 msgr2=0x7f1c54164be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7f1c58dff700 1 --2- 172.21.15.172:0/2790442978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 0x7f1c54164be0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098f0 tx=0x7f1c44009c00 comp rx=0 tx=0).stop 2023-03-27T10:09:58.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fe4ed59c700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e816ae60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c450 tx=0x7fe4dc00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.566 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fbdb2fff700 1 Processor -- start 2023-03-27T10:09:58.566 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7f93467fc700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9334066e80 0x7f9334069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9348084350 con 0x7f935015ae10 2023-03-27T10:09:58.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f93467fc700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] conn(0x7f933406f730 0x7f9334071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 --> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93340721f0 con 0x7f933406f730 2023-03-27T10:09:58.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93480846c0 con 0x7f935015ae10 2023-03-27T10:09:58.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fa6fc99c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa6f81657d0 0x7fa6f806ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53060/0 (socket says 172.21.15.172:53060) 2023-03-27T10:09:58.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fa6fc99c700 1 -- 172.21.15.172:0/1343633609 learned_addr learned my addr 172.21.15.172:0/1343633609 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:58.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fa6f77fe700 1 --2- 172.21.15.172:0/1343633609 >> v2:172.21.15.191:3300/0 conn(0x7fa6f8165360 0x7fa6f806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fa6f7fff700 1 --2- 172.21.15.172:0/1343633609 >> v2:172.21.15.172:3300/0 conn(0x7fa6f8070b10 0x7fa6f806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fa6f77fe700 1 -- 172.21.15.172:0/1343633609 >> v2:172.21.15.172:3300/0 conn(0x7fa6f8070b10 msgr2=0x7fa6f806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fa6f77fe700 1 --2- 172.21.15.172:0/1343633609 >> v2:172.21.15.172:3300/0 conn(0x7fa6f8070b10 0x7fa6f806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fa6f77fe700 1 -- 172.21.15.172:0/1343633609 >> v1:172.21.15.172:6789/0 conn(0x7fa6f81657d0 legacy=0x7fa6f806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f9355b9b700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9334066e80 0x7f9334069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f1c58dff700 1 -- 172.21.15.172:0/2790442978 shutdown_connections 2023-03-27T10:09:58.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f1c58dff700 1 --2- 172.21.15.172:0/2790442978 >> v2:172.21.15.172:3300/0 conn(0x7f1c5406fa10 0x7f1c5406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f1c58dff700 1 --2- 172.21.15.172:0/2790442978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c54160fc0 0x7f1c54164be0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f1c58dff700 1 -- 172.21.15.172:0/2790442978 >> 172.21.15.172:0/2790442978 conn(0x7f1c5406d510 msgr2=0x7f1c5406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f1c58dff700 1 -- 172.21.15.172:0/2790442978 shutdown_connections 2023-03-27T10:09:58.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0054e0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00ce70 con 0x7fe4e80ceac0 2023-03-27T10:09:58.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0038a0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e80cc340 con 0x7fe4e80ceac0 2023-03-27T10:09:58.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e80cc060 con 0x7fe4e80ceac0 2023-03-27T10:09:58.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fa6f6ffd700 1 -- 172.21.15.172:0/1343633609 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640343202 0 0) 0x7fa6f8071740 con 0x7fa6f81657d0 2023-03-27T10:09:58.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7fa6f77fe700 1 -- 172.21.15.172:0/1343633609 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8071990 con 0x7fa6f8165360 2023-03-27T10:09:58.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7fbdb2fff700 1 -- start start 2023-03-27T10:09:58.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7fa6f77fe700 1 --2- 172.21.15.172:0/1343633609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8165360 0x7fa6f806fa10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806dc70 tx=0x7fa6ec009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaf2003c40168879 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f935539a700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] conn(0x7f933406f730 0x7f9334071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.574 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4c8000fc0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.531+0000 7f7613dff700 1 -- 172.21.15.172:0/3427415217 wait complete. 2023-03-27T10:09:58.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7f7613dff700 1 Processor -- start 2023-03-27T10:09:58.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.534+0000 7f7613dff700 1 -- start start 2023-03-27T10:09:58.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f7613dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f760c06dff0 0x7f760c169430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f7613dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 0x7f760c16ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f7613dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c159c10 0x7f760c16b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f7613dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c169cf0 con 0x7f760c0cc700 2023-03-27T10:09:58.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f7613dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c169fd0 con 0x7f760c06dff0 2023-03-27T10:09:58.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.535+0000 7f7613dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c16a2b0 con 0x7f760c159c10 2023-03-27T10:09:58.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f7611b9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f760c06dff0 0x7f760c169430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f7611b9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f760c06dff0 0x7f760c169430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:57996/0 (socket says 172.21.15.172:57996) 2023-03-27T10:09:58.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f7611b9b700 1 -- 172.21.15.172:0/2202859058 learned_addr learned my addr 172.21.15.172:0/2202859058 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f761239c700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c159c10 0x7f760c16b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f761139a700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 0x7f760c16ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f7611b9b700 1 -- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c159c10 msgr2=0x7f760c16b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f7611b9b700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f760c159c10 0x7f760c16b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f7611b9b700 1 -- 172.21.15.172:0/2202859058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 msgr2=0x7f760c16ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f7611b9b700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f760c0cc700 0x7f760c16ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f7611b9b700 1 -- 172.21.15.172:0/2202859058 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040094a0 con 0x7f760c06dff0 2023-03-27T10:09:58.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f7611b9b700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f760c06dff0 0x7f760c169430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f760000e810 tx=0x7f760000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fbdb2fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbdac070120 0x7fbdac161810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fbdb2fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac071740 con 0x7fbdac070b10 2023-03-27T10:09:58.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fbdb2fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac164ed0 con 0x7fbdac06c960 2023-03-27T10:09:58.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fbdb2fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac165a70 con 0x7fbdac070120 2023-03-27T10:09:58.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fbdabfff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fbdac06c960 0x7fbdac06fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48460/0 (socket says 172.21.15.172:48460) 2023-03-27T10:09:58.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fbdabfff700 1 -- 172.21.15.172:0/3083055713 learned_addr learned my addr 172.21.15.172:0/3083055713 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:58.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7fa6f6ffd700 1 -- 172.21.15.172:0/1343633609 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec011830 con 0x7fa6f8165360 2023-03-27T10:09:58.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fa6f6ffd700 1 -- 172.21.15.172:0/1343633609 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec011990 con 0x7fa6f8165360 2023-03-27T10:09:58.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7fa6f6ffd700 1 -- 172.21.15.172:0/1343633609 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec011d20 con 0x7fa6f8165360 2023-03-27T10:09:58.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1343633609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8165360 msgr2=0x7fa6f806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7fa6fe3ff700 1 --2- 172.21.15.172:0/1343633609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8165360 0x7fa6f806fa10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806dc70 tx=0x7fa6ec009b20 comp rx=0 tx=0).stop 2023-03-27T10:09:58.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.537+0000 7f9355b9b700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9334066e80 0x7f9334069330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9340014040 tx=0x7f9340008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7f935539a700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] conn(0x7f933406f730 0x7f9334071b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.536+0000 7f1c58dff700 1 -- 172.21.15.172:0/2790442978 wait complete. 2023-03-27T10:09:58.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.539+0000 7f1c58dff700 1 Processor -- start 2023-03-27T10:09:58.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.539+0000 7fbdb159c700 1 --2- 172.21.15.172:0/3083055713 >> v2:172.21.15.191:3300/0 conn(0x7fbdac070120 0x7fbdac161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.539+0000 7f1c58dff700 1 -- start start 2023-03-27T10:09:58.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.539+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032403382 0 0) 0x7fbdac071740 con 0x7fbdac070b10 2023-03-27T10:09:58.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.539+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd940035b0 con 0x7fbdac070b10 2023-03-27T10:09:58.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== osd.1 v2:172.21.15.172:6816/110160 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f93340721f0 con 0x7f933406f730 2023-03-27T10:09:58.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280708277 0 0) 0x7fbd940035b0 con 0x7fbdac070b10 2023-03-27T10:09:58.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 >> v2:172.21.15.191:3300/0 conn(0x7fbdac070120 msgr2=0x7fbdac161810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 --2- 172.21.15.172:0/3083055713 >> v2:172.21.15.191:3300/0 conn(0x7fbdac070120 0x7fbdac161810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 >> v1:172.21.15.191:6789/0 conn(0x7fbdac06c960 legacy=0x7fbdac06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac06cdd0 con 0x7fbdac070b10 2023-03-27T10:09:58.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7fbda4001920 con 0x7fbdac070b10 2023-03-27T10:09:58.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 >> v1:172.21.15.172:6789/0 conn(0x7fbdac070b10 legacy=0x7fbdac165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd94003a50 0x7fbd94003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94004850 0x7fbd94004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd94005320 0x7fbd9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac165a70 con 0x7fbd94004850 2023-03-27T10:09:58.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400c210 con 0x7fbd94003a50 2023-03-27T10:09:58.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400c3d0 con 0x7fbd94005320 2023-03-27T10:09:58.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600013610 con 0x7f760c06dff0 2023-03-27T10:09:58.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600013770 con 0x7f760c06dff0 2023-03-27T10:09:58.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600013b20 con 0x7f760c06dff0 2023-03-27T10:09:58.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0cdc50 con 0x7f760c06dff0 2023-03-27T10:09:58.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.538+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c0cb280 con 0x7f760c06dff0 2023-03-27T10:09:58.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe4dc019030 con 0x7fe4e80ceac0 2023-03-27T10:09:58.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7f1c58dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c5406fa10 0x7f1c540c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7f1c58dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c540c1d10 0x7f1c54154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7f1c58dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54160fc0 0x7f1c540b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c58dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540c6af0 con 0x7f1c54160fc0 2023-03-27T10:09:58.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c58dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540c2320 con 0x7f1c540c1d10 2023-03-27T10:09:58.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.540+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd94003a50 0x7fbd94003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c58dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540c2600 con 0x7f1c5406fa10 2023-03-27T10:09:58.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75f4000fc0 con 0x7f760c06dff0 2023-03-27T10:09:58.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7fbdb0d9b700 1 -- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd94005320 msgr2=0x7fbd9400ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-27T10:09:58.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd94005320 0x7fbd9400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7fbdb0d9b700 1 -- 172.21.15.172:0/3083055713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94004850 msgr2=0x7fbd94004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94004850 0x7fbd94004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7fbdb0d9b700 1 -- 172.21.15.172:0/3083055713 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac06cdd0 con 0x7fbd94003a50 2023-03-27T10:09:58.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd94003a50 0x7fbd94003e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbda400a7b0 tx=0x7fbd94005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c66fbc828c8795 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fe4e57fa700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe4d4066f30 0x7fe4d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4dc034e40 con 0x7fe4e80ceac0 2023-03-27T10:09:58.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fe4e57fa700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] conn(0x7fe4d406f7e0 0x7fe4d4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 --> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4d40722a0 con 0x7fe4d406f7e0 2023-03-27T10:09:58.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4dc0839e0 con 0x7fe4e80ceac0 2023-03-27T10:09:58.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4012620 con 0x7fbd94003a50 2023-03-27T10:09:58.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fbdb159c700 1 -- 172.21.15.172:0/3083055713 reap_dead start 2023-03-27T10:09:58.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4012780 con 0x7fbd94003a50 2023-03-27T10:09:58.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7fbdab7fe700 1 -- 172.21.15.172:0/3083055713 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4012b30 con 0x7fbd94003a50 2023-03-27T10:09:58.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fe4e7fff700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] conn(0x7fe4d406f7e0 0x7fe4d4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd94003a50 msgr2=0x7fbd94003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd94003a50 0x7fbd94003e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbda400a7b0 tx=0x7fbd94005880 comp rx=0 tx=0).stop 2023-03-27T10:09:58.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3083055713 shutdown_connections 2023-03-27T10:09:58.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 --2- 172.21.15.172:0/3083055713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd94003a50 0x7fbd94003e60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3083055713 >> 172.21.15.172:0/3083055713 conn(0x7fbdac06a1a0 msgr2=0x7fbdac06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3083055713 shutdown_connections 2023-03-27T10:09:58.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c51d9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c540c1d10 0x7f1c54154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c51d9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c540c1d10 0x7f1c54154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58018/0 (socket says 172.21.15.172:58018) 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c51d9b700 1 -- 172.21.15.172:0/411762924 learned_addr learned my addr 172.21.15.172:0/411762924 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.541+0000 7f1c5259c700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c5406fa10 0x7f1c540c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7f1c51d9b700 1 -- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c5406fa10 msgr2=0x7f1c540c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7f1c51d9b700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c5406fa10 0x7f1c540c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7f1c51d9b700 1 -- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54160fc0 msgr2=0x7f1c540b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7f1c51d9b700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c54160fc0 0x7f1c540b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.542+0000 7f1c51d9b700 1 -- 172.21.15.172:0/411762924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009550 con 0x7f1c540c1d10 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7f1c51d9b700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c540c1d10 0x7f1c54154be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800c4a0 tx=0x7f1c4800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c480054e0 con 0x7f1c540c1d10 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c48003680 con 0x7f1c540c1d10 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c48003a30 con 0x7f1c540c1d10 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.544+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5406c700 con 0x7f1c540c1d10 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.544+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5406c420 con 0x7f1c540c1d10 2023-03-27T10:09:58.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.544+0000 7fe4ecd9b700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe4d4066f30 0x7fe4d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.544+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7600023070 con 0x7f760c06dff0 2023-03-27T10:09:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c540c2490 con 0x7f1c540c1d10 2023-03-27T10:09:58.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7fe4e7fff700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] conn(0x7fe4d406f7e0 0x7fe4d4071bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1343633609 shutdown_connections 2023-03-27T10:09:58.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7fa6fe3ff700 1 --2- 172.21.15.172:0/1343633609 >> v2:172.21.15.172:3300/0 conn(0x7fa6f8070b10 0x7fa6f806c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7fa6fe3ff700 1 --2- 172.21.15.172:0/1343633609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f8165360 0x7fa6f806fa10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1343633609 >> 172.21.15.172:0/1343633609 conn(0x7fa6f806a1a0 msgr2=0x7fa6f806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.543+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3083055713 wait complete. 2023-03-27T10:09:58.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7fe4ecd9b700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe4d4066f30 0x7fe4d40693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009fd0 tx=0x7fe4e0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.600 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7fbdb2fff700 1 Processor -- start 2023-03-27T10:09:58.600 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== osd.3 v2:172.21.15.172:6808/110161 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fe4d40722a0 con 0x7fe4d406f7e0 2023-03-27T10:09:58.600 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7f75fe7fc700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f75f0066e80 0x7f75f0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.600 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76000844e0 con 0x7f760c06dff0 2023-03-27T10:09:58.600 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7f75fe7fc700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] conn(0x7f75f006f730 0x7f75f0071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.545+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 --> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75f00721f0 con 0x7f75f006f730 2023-03-27T10:09:58.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7600084850 con 0x7f760c06dff0 2023-03-27T10:09:58.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7f761139a700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f75f0066e80 0x7f75f0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7f761239c700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] conn(0x7f75f006f730 0x7f75f0071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.547+0000 7f761239c700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] conn(0x7f75f006f730 0x7f75f0071b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.547+0000 7f761139a700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f75f0066e80 0x7f75f0069330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f760c1571c0 tx=0x7f7608009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.547+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1343633609 shutdown_connections 2023-03-27T10:09:58.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.546+0000 7fbdb2fff700 1 -- start start 2023-03-27T10:09:58.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7f53dc9ff700 1 Processor -- start 2023-03-27T10:09:58.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7f53dc9ff700 1 -- start start 2023-03-27T10:09:58.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7fbdb2fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94003a50 0x7fbdac160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7fbdb2fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbdac162e90 0x7fbdac1632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7fbdb2fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdac0c3790 0x7fbdac0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7fbdb2fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1fff70 con 0x7fbd94003a50 2023-03-27T10:09:58.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7fbdb2fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0c81e0 con 0x7fbdac0c3790 2023-03-27T10:09:58.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.548+0000 7fbdb2fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1ff3d0 con 0x7fbdac162e90 2023-03-27T10:09:58.605 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f1c48019030 con 0x7f1c540c1d10 2023-03-27T10:09:58.605 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdabfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbdac162e90 0x7fbdac1632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdabfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbdac162e90 0x7fbdac1632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55884/0 (socket says 172.21.15.172:55884) 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdabfff700 1 -- 172.21.15.172:0/3984424524 learned_addr learned my addr 172.21.15.172:0/3984424524 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdb159c700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdac0c3790 0x7fbdac0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94003a50 0x7fbdac160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdb159c700 1 -- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbdac162e90 msgr2=0x7fbdac1632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdb159c700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbdac162e90 0x7fbdac1632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdb159c700 1 -- 172.21.15.172:0/3984424524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94003a50 msgr2=0x7fbdac160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7fbdb159c700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94003a50 0x7fbdac160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.550+0000 7fbdb159c700 1 -- 172.21.15.172:0/3984424524 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac071990 con 0x7fbdac0c3790 2023-03-27T10:09:58.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.550+0000 7f1c42ffd700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1c34077f10 0x7f1c3407a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.550+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c48083630 con 0x7f1c540c1d10 2023-03-27T10:09:58.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.551+0000 7f1c42ffd700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] conn(0x7f1c34080740 0x7f1c34082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.551+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 --> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c34083200 con 0x7f1c34080740 2023-03-27T10:09:58.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.551+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c480508f0 con 0x7f1c540c1d10 2023-03-27T10:09:58.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.551+0000 7f1c52d9d700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] conn(0x7f1c34080740 0x7f1c34082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.551+0000 7f53dc9ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53d815cc60 0x7f53d80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53dc9ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f53d80cb3e0 0x7f53d80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53dc9ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d815d030 con 0x7f53d80cc700 2023-03-27T10:09:58.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53dc9ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80ad8b0 con 0x7f53d815cc60 2023-03-27T10:09:58.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53dc9ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80ccf80 con 0x7f53d80cb3e0 2023-03-27T10:09:58.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7fbdb159c700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdac0c3790 0x7fbdac0c3c10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdac06db80 tx=0x7fbd9c00e700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53d659c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53d815cc60 0x7f53d80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53d659c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53d815cc60 0x7f53d80ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40676/0 (socket says 172.21.15.172:40676) 2023-03-27T10:09:58.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.552+0000 7f53d659c700 1 -- 172.21.15.172:0/141098239 learned_addr learned my addr 172.21.15.172:0/141098239 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.549+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== osd.4 v2:172.21.15.191:6816/110409 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f75f00721f0 con 0x7f75f006f730 2023-03-27T10:09:58.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7f1c52d9d700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] conn(0x7f1c34080740 0x7f1c34082b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1343633609 wait complete. 2023-03-27T10:09:58.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7f53d659c700 1 -- 172.21.15.172:0/141098239 >> v2:172.21.15.191:3300/0 conn(0x7f53d80cb3e0 msgr2=0x7f53d80cb7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-27T10:09:58.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7f53d659c700 1 --2- 172.21.15.172:0/141098239 >> v2:172.21.15.191:3300/0 conn(0x7f53d80cb3e0 0x7f53d80cb7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7f53d659c700 1 -- 172.21.15.172:0/141098239 >> v1:172.21.15.191:6789/0 conn(0x7f53d80cc700 legacy=0x7f53d815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:58.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7f53d659c700 1 -- 172.21.15.172:0/141098239 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80cbd20 con 0x7f53d815cc60 2023-03-27T10:09:58.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.553+0000 7f53d659c700 1 --2- 172.21.15.172:0/141098239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d815cc60 0x7f53d80ac8b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53d80c2590 tx=0x7f53c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d1246bcc182f8f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.554+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== osd.2 v2:172.21.15.172:6824/110162 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f1c34083200 con 0x7f1c34080740 2023-03-27T10:09:58.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.555+0000 7f1c5259c700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1c34077f10 0x7f1c3407a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.555+0000 7fa6fe3ff700 1 Processor -- start 2023-03-27T10:09:58.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.556+0000 7fa6fe3ff700 1 -- start start 2023-03-27T10:09:58.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7fa6fe3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6f8070b10 0x7fa6f814d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7fa6fe3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f8165360 0x7fa6f80c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7fa6fe3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f80c3400 0x7fa6f80c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7fa6fe3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c2f70 con 0x7fa6f8165360 2023-03-27T10:09:58.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7fa6fe3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8156270 con 0x7fa6f80c3400 2023-03-27T10:09:58.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7fa6fe3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c45f0 con 0x7fa6f8070b10 2023-03-27T10:09:58.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.557+0000 7f53d5d9b700 1 -- 172.21.15.172:0/141098239 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8004230 con 0x7f53d815cc60 2023-03-27T10:09:58.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7f53d5d9b700 1 -- 172.21.15.172:0/141098239 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8004390 con 0x7f53d815cc60 2023-03-27T10:09:58.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7f53d5d9b700 1 -- 172.21.15.172:0/141098239 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c80036a0 con 0x7f53d815cc60 2023-03-27T10:09:58.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7f53dc9ff700 1 -- 172.21.15.172:0/141098239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d815cc60 msgr2=0x7f53d80ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7f53dc9ff700 1 --2- 172.21.15.172:0/141098239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d815cc60 0x7f53d80ac8b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53d80c2590 tx=0x7f53c8009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6f8070b10 0x7fa6f814d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6f8070b10 0x7fa6f814d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55900/0 (socket says 172.21.15.172:55900) 2023-03-27T10:09:58.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 -- 172.21.15.172:0/1517069351 learned_addr learned my addr 172.21.15.172:0/1517069351 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 -- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f80c3400 msgr2=0x7fa6f80c3fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:09:58.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa6f80c3400 0x7fa6f80c3fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 -- 172.21.15.172:0/1517069351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f8165360 msgr2=0x7fa6f80c3a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-27T10:09:58.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f8165360 0x7fa6f80c3a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.558+0000 7fa6f7fff700 1 -- 172.21.15.172:0/1517069351 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0094a0 con 0x7fa6f8070b10 2023-03-27T10:09:58.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7fa6f7fff700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6f8070b10 0x7fa6f814d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800d800 tx=0x7fa6e800dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00c070 con 0x7fbdac0c3790 2023-03-27T10:09:58.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c013410 con 0x7fbdac0c3790 2023-03-27T10:09:58.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0137c0 con 0x7fbdac0c3790 2023-03-27T10:09:58.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7f53dc9ff700 1 -- 172.21.15.172:0/141098239 shutdown_connections 2023-03-27T10:09:58.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7f53dc9ff700 1 --2- 172.21.15.172:0/141098239 >> v2:172.21.15.191:3300/0 conn(0x7f53d80cb3e0 0x7f53d80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7f53dc9ff700 1 --2- 172.21.15.172:0/141098239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d815cc60 0x7f53d80ac8b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.559+0000 7f53dc9ff700 1 -- 172.21.15.172:0/141098239 >> 172.21.15.172:0/141098239 conn(0x7f53d806d510 msgr2=0x7f53d806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac164ba0 con 0x7fbdac0c3790 2023-03-27T10:09:58.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac071c70 con 0x7fbdac0c3790 2023-03-27T10:09:58.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80125f0 con 0x7fa6f8070b10 2023-03-27T10:09:58.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8012750 con 0x7fa6f8070b10 2023-03-27T10:09:58.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8012ac0 con 0x7fa6f8070b10 2023-03-27T10:09:58.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f8070ee0 con 0x7fa6f8070b10 2023-03-27T10:09:58.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f8071c70 con 0x7fa6f8070b10 2023-03-27T10:09:58.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.560+0000 7f1c5259c700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1c34077f10 0x7f1c3407a3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c44000c00 tx=0x7f1c44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.561+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdac0c4510 con 0x7fbdac0c3790 2023-03-27T10:09:58.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.561+0000 7f53dc9ff700 1 -- 172.21.15.172:0/141098239 shutdown_connections 2023-03-27T10:09:58.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.561+0000 7f53dc9ff700 1 -- 172.21.15.172:0/141098239 wait complete. 2023-03-27T10:09:58.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.564+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 --> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0db406bfb0 con 0x7f0da006f7b0 2023-03-27T10:09:58.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.564+0000 7f53dc9ff700 1 Processor -- start 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.564+0000 7f53dc9ff700 1 -- start start 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7f53dc9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53d80cb3e0 0x7f53d8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7f53dc9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d80cc700 0x7f53d815f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7f53dc9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53d815cc60 0x7f53d815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7f53dc9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81524b0 con 0x7f53d80cc700 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7f53dc9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d815d390 con 0x7f53d815cc60 2023-03-27T10:09:58.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7f53dc9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d815d910 con 0x7f53d80cb3e0 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53d80cb3e0 0x7f53d8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53d80cb3e0 0x7f53d8151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55912/0 (socket says 172.21.15.172:55912) 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 -- 172.21.15.172:0/3259617369 learned_addr learned my addr 172.21.15.172:0/3259617369 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d6d9d700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53d815cc60 0x7f53d815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53cdd9b700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d80cc700 0x7f53d815f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 -- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53d815cc60 msgr2=0x7f53d815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53d815cc60 0x7f53d815faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 -- 172.21.15.172:0/3259617369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d80cc700 msgr2=0x7f53d815f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53d80cc700 0x7f53d815f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7f53d659c700 1 -- 172.21.15.172:0/3259617369 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009550 con 0x7f53d80cb3e0 2023-03-27T10:09:58.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.567+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fbd9c013920 con 0x7fbdac0c3790 2023-03-27T10:09:58.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7f53d659c700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53d80cb3e0 0x7f53d8151f70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f53d80cfc30 tx=0x7f53c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.566+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6d8000fc0 con 0x7fa6f8070b10 2023-03-27T10:09:58.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 --> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9350067690 con 0x7f933406f730 2023-03-27T10:09:58.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7fbda97fa700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd98066f00 0x7fbd980693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd9c083bf0 con 0x7fbdac0c3790 2023-03-27T10:09:58.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7f0db0ff9700 1 -- 172.21.15.172:0/3297955989 <== osd.0 v2:172.21.15.172:6800/110158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0db406bfb0 con 0x7f0da006f7b0 2023-03-27T10:09:58.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fbda97fa700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] conn(0x7fbd9806f7b0 0x7fbd98071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 --> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd98072270 con 0x7fbd9806f7b0 2023-03-27T10:09:58.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd9c083fa0 con 0x7fbdac0c3790 2023-03-27T10:09:58.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011630 con 0x7f53d80cb3e0 2023-03-27T10:09:58.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8011790 con 0x7f53d80cb3e0 2023-03-27T10:09:58.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.568+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011b20 con 0x7f53d80cb3e0 2023-03-27T10:09:58.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80ccca0 con 0x7f53d80cb3e0 2023-03-27T10:09:58.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80ae450 con 0x7f53d80cb3e0 2023-03-27T10:09:58.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fa6e8012c20 con 0x7fa6f8070b10 2023-03-27T10:09:58.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd98066f00 0x7fbd980693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fbdabfff700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] conn(0x7fbd9806f7b0 0x7fbd98071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fa6f4ff9700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa6e4066e80 0x7fa6e4069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.569+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6e8085190 con 0x7fa6f8070b10 2023-03-27T10:09:58.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fa6f4ff9700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] conn(0x7fa6e406f730 0x7fa6e4071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 --> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6e40721f0 con 0x7fa6e406f730 2023-03-27T10:09:58.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6e8085500 con 0x7fa6f8070b10 2023-03-27T10:09:58.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fa6f77fe700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa6e4066e80 0x7fa6e4069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fa6fc99c700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] conn(0x7fa6e406f730 0x7fa6e4071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fbdb0d9b700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd98066f00 0x7fbd980693b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbda4000f80 tx=0x7fbda4005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7fbdabfff700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] conn(0x7fbd9806f7b0 0x7fbd98071bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] conn(0x7f0da006f7b0 msgr2=0x7f0da0071bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.570+0000 7f0dba7ff700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.172:6800/110158,v1:172.21.15.172:6801/110158] conn(0x7f0da006f7b0 0x7f0da0071bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.571+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53d80ade00 con 0x7f53d80cb3e0 2023-03-27T10:09:58.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.571+0000 7f93467fc700 1 -- 172.21.15.172:0/644951468 <== osd.1 v2:172.21.15.172:6816/110160 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9350067690 con 0x7f933406f730 2023-03-27T10:09:58.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== osd.5 v2:172.21.15.191:6808/110407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fbd98072270 con 0x7fbd9806f7b0 2023-03-27T10:09:58.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] conn(0x7f933406f730 msgr2=0x7f9334071b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f9357dff700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.172:6816/110160,v1:172.21.15.172:6817/110160] conn(0x7f933406f730 0x7f9334071b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9334066e80 msgr2=0x7f9334069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f9357dff700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9334066e80 0x7f9334069330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9340014040 tx=0x7f9340008030 comp rx=0 tx=0).stop 2023-03-27T10:09:58.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f935015ae10 msgr2=0x7f935015a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f9357dff700 1 --2- 172.21.15.172:0/644951468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f935015ae10 0x7f935015a740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f934800cbc0 tx=0x7f934800ced0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7fa6fc99c700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] conn(0x7fa6e406f730 0x7fa6e4071b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f935639c700 1 -- 172.21.15.172:0/644951468 reap_dead start 2023-03-27T10:09:58.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0da0066f00 msgr2=0x7f0da00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f0dba7ff700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0da0066f00 0x7f0da00693b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0db40686b0 tx=0x7f0da4008040 comp rx=0 tx=0).stop 2023-03-27T10:09:58.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 msgr2=0x7f0db40c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f0dba7ff700 1 --2- 172.21.15.172:0/3297955989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d9c003a00 0x7f0db40c5e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00ae60 tx=0x7f0dac001cb0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f0db8d9c700 1 -- 172.21.15.172:0/3297955989 reap_dead start 2023-03-27T10:09:58.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.572+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f53c8017020 con 0x7f53d80cb3e0 2023-03-27T10:09:58.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 shutdown_connections 2023-03-27T10:09:58.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 >> 172.21.15.172:0/3297955989 conn(0x7f0db406d510 msgr2=0x7f0db415e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 shutdown_connections 2023-03-27T10:09:58.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== osd.6 v2:172.21.15.191:6800/110408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fa6e40721f0 con 0x7fa6e406f730 2023-03-27T10:09:58.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f0dba7ff700 1 -- 172.21.15.172:0/3297955989 wait complete. 2023-03-27T10:09:58.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 shutdown_connections 2023-03-27T10:09:58.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 >> 172.21.15.172:0/644951468 conn(0x7f935006d510 msgr2=0x7f93500cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.574+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 shutdown_connections 2023-03-27T10:09:58.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.574+0000 7f9357dff700 1 -- 172.21.15.172:0/644951468 wait complete. 2023-03-27T10:09:58.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.573+0000 7f53cf7fe700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f53b8066e80 0x7f53b8069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.574+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c8085d40 con 0x7f53d80cb3e0 2023-03-27T10:09:58.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.574+0000 7f53cf7fe700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] conn(0x7f53b806f730 0x7f53b8071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:58.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.574+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 --> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53b80721f0 con 0x7f53b806f730 2023-03-27T10:09:58.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.574+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53c8088320 con 0x7f53d80cb3e0 2023-03-27T10:09:58.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.575+0000 7f53cdd9b700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f53b8066e80 0x7f53b8069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.575+0000 7f53d6d9d700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] conn(0x7f53b806f730 0x7f53b8071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:58.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.575+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 --> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe4c8002d40 con 0x7fe4d406f7e0 2023-03-27T10:09:58.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.575+0000 7fa6f77fe700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa6e4066e80 0x7fa6e4069330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80c2010 tx=0x7fa6ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.576+0000 7fe4e57fa700 1 -- 172.21.15.172:0/2292540099 <== osd.3 v2:172.21.15.172:6808/110161 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe4c8002d40 con 0x7fe4d406f7e0 2023-03-27T10:09:58.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.576+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] conn(0x7fe4d406f7e0 msgr2=0x7fe4d4071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.576+0000 7fe4eefff700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.172:6808/110161,v1:172.21.15.172:6809/110161] conn(0x7fe4d406f7e0 0x7fe4d4071bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.577+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe4d4066f30 msgr2=0x7fe4d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.577+0000 7fe4eefff700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe4d4066f30 0x7fe4d40693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009fd0 tx=0x7fe4e0009000 comp rx=0 tx=0).stop 2023-03-27T10:09:58.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.577+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 msgr2=0x7fe4e816ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.577+0000 7fe4eefff700 1 --2- 172.21.15.172:0/2292540099 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4e80ceac0 0x7fe4e816ae60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c450 tx=0x7fe4dc00c760 comp rx=0 tx=0).stop 2023-03-27T10:09:58.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.577+0000 7fe4ed59c700 1 -- 172.21.15.172:0/2292540099 reap_dead start 2023-03-27T10:09:58.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.578+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 shutdown_connections 2023-03-27T10:09:58.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.578+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 >> 172.21.15.172:0/2292540099 conn(0x7fe4e806d510 msgr2=0x7fe4e80cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.578+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 shutdown_connections 2023-03-27T10:09:58.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.578+0000 7fe4eefff700 1 -- 172.21.15.172:0/2292540099 wait complete. 2023-03-27T10:09:58.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.580+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 --> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75f4002d40 con 0x7f75f006f730 2023-03-27T10:09:58.646 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.580+0000 7f53d6d9d700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] conn(0x7f53b806f730 0x7f53b8071b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.646 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.580+0000 7f53cdd9b700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f53b8066e80 0x7f53b8069330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53d80ca230 tx=0x7f53c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:58.647 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.581+0000 7f75fe7fc700 1 -- 172.21.15.172:0/2202859058 <== osd.4 v2:172.21.15.191:6816/110409 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75f4002d40 con 0x7f75f006f730 2023-03-27T10:09:58.647 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.581+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== osd.7 v2:172.21.15.191:6822/110410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7f53b80721f0 con 0x7f53b806f730 2023-03-27T10:09:58.648 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.582+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] conn(0x7f75f006f730 msgr2=0x7f75f0071b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.649 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.582+0000 7f7613dff700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6816/110409,v1:172.21.15.191:6817/110409] conn(0x7f75f006f730 0x7f75f0071b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.649 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.583+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f75f0066e80 msgr2=0x7f75f0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.649 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.583+0000 7f7613dff700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f75f0066e80 0x7f75f0069330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f760c1571c0 tx=0x7f7608009040 comp rx=0 tx=0).stop 2023-03-27T10:09:58.649 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.583+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f760c06dff0 msgr2=0x7f760c169430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.583+0000 7f7613dff700 1 --2- 172.21.15.172:0/2202859058 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f760c06dff0 0x7f760c169430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f760000e810 tx=0x7f760000eb20 comp rx=0 tx=0).stop 2023-03-27T10:09:58.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.583+0000 7f761239c700 1 -- 172.21.15.172:0/2202859058 reap_dead start 2023-03-27T10:09:58.650 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.583+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 shutdown_connections 2023-03-27T10:09:58.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.584+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 >> 172.21.15.172:0/2202859058 conn(0x7f760c06d510 msgr2=0x7f760c06d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.584+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 shutdown_connections 2023-03-27T10:09:58.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.584+0000 7f7613dff700 1 -- 172.21.15.172:0/2202859058 wait complete. 2023-03-27T10:09:58.651 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.589+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 --> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c540c2180 con 0x7f1c34080740 2023-03-27T10:09:58.653 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.591+0000 7f1c42ffd700 1 -- 172.21.15.172:0/411762924 <== osd.2 v2:172.21.15.172:6824/110162 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c540c2180 con 0x7f1c34080740 2023-03-27T10:09:58.653 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.599+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] conn(0x7f1c34080740 msgr2=0x7f1c34082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.653 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.599+0000 7f1c58dff700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.172:6824/110162,v1:172.21.15.172:6825/110162] conn(0x7f1c34080740 0x7f1c34082b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.599+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1c34077f10 msgr2=0x7f1c3407a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.599+0000 7f1c58dff700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1c34077f10 0x7f1c3407a3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c44000c00 tx=0x7f1c44008030 comp rx=0 tx=0).stop 2023-03-27T10:09:58.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.599+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c540c1d10 msgr2=0x7f1c54154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.655 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.599+0000 7f1c58dff700 1 --2- 172.21.15.172:0/411762924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c540c1d10 0x7f1c54154be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800c4a0 tx=0x7f1c4800c7b0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.655 INFO:teuthology.orchestra.run.smithi172.stdout:55834574856 2023-03-27T10:09:58.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.600+0000 7f1c52d9d700 1 -- 172.21.15.172:0/411762924 reap_dead start 2023-03-27T10:09:58.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.600+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 shutdown_connections 2023-03-27T10:09:58.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.600+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 >> 172.21.15.172:0/411762924 conn(0x7f1c5406d510 msgr2=0x7f1c54160200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.657 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.605+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 shutdown_connections 2023-03-27T10:09:58.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-27T10:09:58.659 INFO:teuthology.orchestra.run.smithi172.stdout:55834574856 2023-03-27T10:09:58.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-27T10:09:58.660 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.606+0000 7f1c58dff700 1 -- 172.21.15.172:0/411762924 wait complete. 2023-03-27T10:09:58.661 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.607+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 --> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbdac2000b0 con 0x7fbd9806f7b0 2023-03-27T10:09:58.661 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.608+0000 7fbda97fa700 1 -- 172.21.15.172:0/3984424524 <== osd.5 v2:172.21.15.191:6808/110407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbdac2000b0 con 0x7fbd9806f7b0 2023-03-27T10:09:58.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 --> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53d815da50 con 0x7f53b806f730 2023-03-27T10:09:58.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] conn(0x7fbd9806f7b0 msgr2=0x7fbd98071bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6808/110407,v1:172.21.15.191:6809/110407] conn(0x7fbd9806f7b0 0x7fbd98071bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd98066f00 msgr2=0x7fbd980693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd98066f00 0x7fbd980693b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbda4000f80 tx=0x7fbda4005040 comp rx=0 tx=0).stop 2023-03-27T10:09:58.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdac0c3790 msgr2=0x7fbdac0c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 --2- 172.21.15.172:0/3984424524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbdac0c3790 0x7fbdac0c3c10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdac06db80 tx=0x7fbd9c00e700 comp rx=0 tx=0).stop 2023-03-27T10:09:58.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb159c700 1 -- 172.21.15.172:0/3984424524 reap_dead start 2023-03-27T10:09:58.664 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:09:58.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 shutdown_connections 2023-03-27T10:09:58.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 >> 172.21.15.172:0/3984424524 conn(0x7fbdac06a1a0 msgr2=0x7fbdac0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 shutdown_connections 2023-03-27T10:09:58.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7fbdb2fff700 1 -- 172.21.15.172:0/3984424524 wait complete. 2023-03-27T10:09:58.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.609+0000 7f53cf7fe700 1 -- 172.21.15.172:0/3259617369 <== osd.7 v2:172.21.15.191:6822/110410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53d0009c40 con 0x7f53b806f730 2023-03-27T10:09:58.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-27T10:09:58.669 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:09:58.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 --> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6d8002d40 con 0x7fa6e406f730 2023-03-27T10:09:58.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-27T10:09:58.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] conn(0x7f53b806f730 msgr2=0x7f53b8071b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6822/110410,v1:172.21.15.191:6824/110410] conn(0x7f53b806f730 0x7f53b8071b40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f53b8066e80 msgr2=0x7f53b8069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f53b8066e80 0x7f53b8069330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53d80ca230 tx=0x7f53c0009040 comp rx=0 tx=0).stop 2023-03-27T10:09:58.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53d80cb3e0 msgr2=0x7f53d8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 --2- 172.21.15.172:0/3259617369 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53d80cb3e0 0x7f53d8151f70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f53d80cfc30 tx=0x7f53c8004750 comp rx=0 tx=0).stop 2023-03-27T10:09:58.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53d6d9d700 1 -- 172.21.15.172:0/3259617369 reap_dead start 2023-03-27T10:09:58.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 shutdown_connections 2023-03-27T10:09:58.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 >> 172.21.15.172:0/3259617369 conn(0x7f53d806d510 msgr2=0x7f53d80ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 shutdown_connections 2023-03-27T10:09:58.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.610+0000 7f53dc9ff700 1 -- 172.21.15.172:0/3259617369 wait complete. 2023-03-27T10:09:58.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.611+0000 7fa6f4ff9700 1 -- 172.21.15.172:0/1517069351 <== osd.6 v2:172.21.15.191:6800/110408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6d8002d40 con 0x7fa6e406f730 2023-03-27T10:09:58.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] conn(0x7fa6e406f730 msgr2=0x7fa6e4071b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6800/110408,v1:172.21.15.191:6801/110408] conn(0x7fa6e406f730 0x7fa6e4071b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa6e4066e80 msgr2=0x7fa6e4069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa6e4066e80 0x7fa6e4069330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6f80c2010 tx=0x7fa6ec008030 comp rx=0 tx=0).stop 2023-03-27T10:09:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6f8070b10 msgr2=0x7fa6f814d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 --2- 172.21.15.172:0/1517069351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa6f8070b10 0x7fa6f814d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800d800 tx=0x7fa6e800dbc0 comp rx=0 tx=0).stop 2023-03-27T10:09:58.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fc99c700 1 -- 172.21.15.172:0/1517069351 reap_dead start 2023-03-27T10:09:58.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 shutdown_connections 2023-03-27T10:09:58.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 >> 172.21.15.172:0/1517069351 conn(0x7fa6f806a1a0 msgr2=0x7fa6f806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:58.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 shutdown_connections 2023-03-27T10:09:58.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:58.612+0000 7fa6fe3ff700 1 -- 172.21.15.172:0/1517069351 wait complete. 2023-03-27T10:09:58.680 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:09:58.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-27T10:09:58.681 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:09:58.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-27T10:09:58.683 INFO:teuthology.orchestra.run.smithi172.stdout:60129542151 2023-03-27T10:09:58.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-27T10:09:58.684 INFO:teuthology.orchestra.run.smithi172.stdout:55834574856 2023-03-27T10:09:58.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-27T10:09:59.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.031+0000 7ff029dff700 1 Processor -- start 2023-03-27T10:09:59.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.032+0000 7ff029dff700 1 -- start start 2023-03-27T10:09:59.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7ff029dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff02406dff0 0x7ff0240c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7ff029dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff024159c10 0x7ff0240ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7ff029dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0240cf280 0x7ff0240cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7ff029dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff024160ae0 con 0x7ff02406dff0 2023-03-27T10:09:59.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7ff029dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0240cafa0 con 0x7ff0240cf280 2023-03-27T10:09:59.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7ff029dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240cb280 con 0x7ff024159c10 2023-03-27T10:09:59.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.035+0000 7fccc5dff700 1 Processor -- start 2023-03-27T10:09:59.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0240cf280 0x7ff0240cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0240cf280 0x7ff0240cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58042/0 (socket says 172.21.15.172:58042) 2023-03-27T10:09:59.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 -- 172.21.15.172:0/4187177267 learned_addr learned my addr 172.21.15.172:0/4187177267 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7fccc5dff700 1 -- start start 2023-03-27T10:09:59.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff022ffd700 1 --2- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff024159c10 0x7ff0240ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 -- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff024159c10 msgr2=0x7ff0240ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 --2- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff024159c10 0x7ff0240ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 -- 172.21.15.172:0/4187177267 >> v2:172.21.15.172:3300/0 conn(0x7ff02406dff0 msgr2=0x7ff0240c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 --2- 172.21.15.172:0/4187177267 >> v2:172.21.15.172:3300/0 conn(0x7ff02406dff0 0x7ff0240c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7ff023fff700 1 -- 172.21.15.172:0/4187177267 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240cdc50 con 0x7ff0240cf280 2023-03-27T10:09:59.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.036+0000 7f61ecbff700 1 Processor -- start 2023-03-27T10:09:59.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.037+0000 7ff023fff700 1 --2- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0240cf280 0x7ff0240cc700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff02406e3c0 tx=0x7ff01c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af970e3e0df69939 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.037+0000 7ff0227fc700 1 -- 172.21.15.172:0/4187177267 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00b870 con 0x7ff0240cf280 2023-03-27T10:09:59.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.037+0000 7ff0227fc700 1 -- 172.21.15.172:0/4187177267 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00b9d0 con 0x7ff0240cf280 2023-03-27T10:09:59.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.037+0000 7ff0227fc700 1 -- 172.21.15.172:0/4187177267 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00bd60 con 0x7ff0240cf280 2023-03-27T10:09:59.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7ff029dff700 1 -- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0240cf280 msgr2=0x7ff0240cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7ff029dff700 1 --2- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0240cf280 0x7ff0240cc700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff02406e3c0 tx=0x7ff01c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7ff029dff700 1 -- 172.21.15.172:0/4187177267 shutdown_connections 2023-03-27T10:09:59.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7ff029dff700 1 --2- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0240cf280 0x7ff0240cc700 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7ff029dff700 1 --2- 172.21.15.172:0/4187177267 >> v2:172.21.15.172:3300/0 conn(0x7ff02406dff0 0x7ff0240c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7ff029dff700 1 --2- 172.21.15.172:0/4187177267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff024159c10 0x7ff0240ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7ff029dff700 1 -- 172.21.15.172:0/4187177267 >> 172.21.15.172:0/4187177267 conn(0x7ff02406d510 msgr2=0x7ff02406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.037+0000 7f61ecbff700 1 -- start start 2023-03-27T10:09:59.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccc5dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc00cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccc5dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fccc00c9180 0x7fccc0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccc5dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc015a150 con 0x7fccc00cc700 2023-03-27T10:09:59.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccc5dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc015d770 con 0x7fccc00c9180 2023-03-27T10:09:59.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccc5dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c9620 con 0x7fccc00ced40 2023-03-27T10:09:59.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccbf7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc00cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccbf7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc00cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55930/0 (socket says 172.21.15.172:55930) 2023-03-27T10:09:59.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.038+0000 7fccbf7fe700 1 -- 172.21.15.172:0/2588915307 learned_addr learned my addr 172.21.15.172:0/2588915307 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccb6ffd700 1 --2- 172.21.15.172:0/2588915307 >> v2:172.21.15.191:3300/0 conn(0x7fccc00c9180 0x7fccc0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7f61ecbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e8160cc0 0x7f61e8165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7f61ecbff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61e80cec00 0x7f61e80cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccbeffd700 1 -- 172.21.15.172:0/2588915307 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616886001 0 0) 0x7fccc015a150 con 0x7fccc00cc700 2023-03-27T10:09:59.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccbeffd700 1 -- 172.21.15.172:0/2588915307 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac0035b0 con 0x7fccc00cc700 2023-03-27T10:09:59.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccbf7fe700 1 -- 172.21.15.172:0/2588915307 >> v2:172.21.15.191:3300/0 conn(0x7fccc00c9180 msgr2=0x7fccc0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccbf7fe700 1 --2- 172.21.15.172:0/2588915307 >> v2:172.21.15.191:3300/0 conn(0x7fccc00c9180 0x7fccc0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccbf7fe700 1 -- 172.21.15.172:0/2588915307 >> v1:172.21.15.191:6789/0 conn(0x7fccc00cc700 legacy=0x7fccc0070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7fccbf7fe700 1 -- 172.21.15.172:0/2588915307 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00cafa0 con 0x7fccc00ced40 2023-03-27T10:09:59.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7f61ecbff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e80d0560 con 0x7f61e80cf070 2023-03-27T10:09:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7f61ecbff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e8164810 con 0x7f61e80cec00 2023-03-27T10:09:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.039+0000 7f61ecbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e8161090 con 0x7f61e8160cc0 2023-03-27T10:09:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7ff029dff700 1 -- 172.21.15.172:0/4187177267 shutdown_connections 2023-03-27T10:09:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7ff029dff700 1 -- 172.21.15.172:0/4187177267 wait complete. 2023-03-27T10:09:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7fccbf7fe700 1 --2- 172.21.15.172:0/2588915307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc00cf110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fccb00088f0 tx=0x7fccb000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75020e015fc49133 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7f61e659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e8160cc0 0x7f61e8165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7f61e6d9d700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f61e80cf070 0x7f61e80cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48494/0 (socket says 172.21.15.172:48494) 2023-03-27T10:09:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7f61e6d9d700 1 -- 172.21.15.172:0/2892749804 learned_addr learned my addr 172.21.15.172:0/2892749804 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.040+0000 7f61e5d9b700 1 --2- 172.21.15.172:0/2892749804 >> v2:172.21.15.172:3300/0 conn(0x7f61e80cec00 0x7f61e80cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e559a700 1 -- 172.21.15.172:0/2892749804 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299367547 0 0) 0x7f61e80d0560 con 0x7f61e80cf070 2023-03-27T10:09:59.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e559a700 1 -- 172.21.15.172:0/2892749804 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d00035b0 con 0x7f61e80cf070 2023-03-27T10:09:59.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e659c700 1 -- 172.21.15.172:0/2892749804 >> v2:172.21.15.172:3300/0 conn(0x7f61e80cec00 msgr2=0x7f61e80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e659c700 1 --2- 172.21.15.172:0/2892749804 >> v2:172.21.15.172:3300/0 conn(0x7f61e80cec00 0x7f61e80cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e659c700 1 -- 172.21.15.172:0/2892749804 >> v1:172.21.15.191:6789/0 conn(0x7f61e80cf070 legacy=0x7f61e80cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e659c700 1 -- 172.21.15.172:0/2892749804 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e80cf630 con 0x7f61e8160cc0 2023-03-27T10:09:59.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7fccbeffd700 1 -- 172.21.15.172:0/2588915307 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0010070 con 0x7fccc00ced40 2023-03-27T10:09:59.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7fccbeffd700 1 -- 172.21.15.172:0/2588915307 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb000d9d0 con 0x7fccc00ced40 2023-03-27T10:09:59.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7fccbeffd700 1 -- 172.21.15.172:0/2588915307 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb000dd60 con 0x7fccc00ced40 2023-03-27T10:09:59.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f61e659c700 1 --2- 172.21.15.172:0/2892749804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e8160cc0 0x7f61e8165280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009d90 tx=0x7f61e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35365e3ab3f027f0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7fccc5dff700 1 -- 172.21.15.172:0/2588915307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 msgr2=0x7fccc00cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7fccc5dff700 1 --2- 172.21.15.172:0/2588915307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc00cf110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fccb00088f0 tx=0x7fccb000d330 comp rx=0 tx=0).stop 2023-03-27T10:09:59.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7fccc5dff700 1 -- 172.21.15.172:0/2588915307 shutdown_connections 2023-03-27T10:09:59.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7fccc5dff700 1 --2- 172.21.15.172:0/2588915307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc00cf110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7fccc5dff700 1 --2- 172.21.15.172:0/2588915307 >> v2:172.21.15.191:3300/0 conn(0x7fccc00c9180 0x7fccc0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7fccc5dff700 1 -- 172.21.15.172:0/2588915307 >> 172.21.15.172:0/2588915307 conn(0x7fccc006d510 msgr2=0x7fccc006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7f61e559a700 1 -- 172.21.15.172:0/2892749804 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000e070 con 0x7f61e8160cc0 2023-03-27T10:09:59.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7f61e559a700 1 -- 172.21.15.172:0/2892749804 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000bb20 con 0x7f61e8160cc0 2023-03-27T10:09:59.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.042+0000 7f61e559a700 1 -- 172.21.15.172:0/2892749804 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0012430 con 0x7f61e8160cc0 2023-03-27T10:09:59.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.041+0000 7f21101ff700 1 Processor -- start 2023-03-27T10:09:59.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7ff029dff700 1 Processor -- start 2023-03-27T10:09:59.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7f61ecbff700 1 -- 172.21.15.172:0/2892749804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e8160cc0 msgr2=0x7f61e8165280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7f61ecbff700 1 --2- 172.21.15.172:0/2892749804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e8160cc0 0x7f61e8165280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009d90 tx=0x7f61e000b330 comp rx=0 tx=0).stop 2023-03-27T10:09:59.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7fccc5dff700 1 -- 172.21.15.172:0/2588915307 shutdown_connections 2023-03-27T10:09:59.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7f61ecbff700 1 -- 172.21.15.172:0/2892749804 shutdown_connections 2023-03-27T10:09:59.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7f61ecbff700 1 --2- 172.21.15.172:0/2892749804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e8160cc0 0x7f61e8165280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7f61ecbff700 1 --2- 172.21.15.172:0/2892749804 >> v2:172.21.15.172:3300/0 conn(0x7f61e80cec00 0x7f61e80cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7f61ecbff700 1 -- 172.21.15.172:0/2892749804 >> 172.21.15.172:0/2892749804 conn(0x7f61e806dd30 msgr2=0x7f61e806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.043+0000 7fccc5dff700 1 -- 172.21.15.172:0/2588915307 wait complete. 2023-03-27T10:09:59.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.045+0000 7f61ecbff700 1 -- 172.21.15.172:0/2892749804 shutdown_connections 2023-03-27T10:09:59.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.045+0000 7f61ecbff700 1 -- 172.21.15.172:0/2892749804 wait complete. 2023-03-27T10:09:59.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.046+0000 7fccc5dff700 1 Processor -- start 2023-03-27T10:09:59.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.045+0000 7ff029dff700 1 -- start start 2023-03-27T10:09:59.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.046+0000 7fccc5dff700 1 -- start start 2023-03-27T10:09:59.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.047+0000 7f61ecbff700 1 Processor -- start 2023-03-27T10:09:59.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7f61ecbff700 1 -- start start 2023-03-27T10:09:59.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.047+0000 7f21101ff700 1 -- start start 2023-03-27T10:09:59.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f61ecbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e80cec00 0x7f61e80c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccc5dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc00c9180 0x7fccc01f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccc5dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 0x7fccc00c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccc5dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccc5dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c6f20 con 0x7fccc00c9180 2023-03-27T10:09:59.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f61ecbff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 0x7f61e8163500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccc5dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c7200 con 0x7fccc00cc700 2023-03-27T10:09:59.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccc5dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00c74e0 con 0x7fccc00ced40 2023-03-27T10:09:59.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccb6ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 0x7fccc00c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccbffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccb6ffd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 0x7fccc00c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58072/0 (socket says 172.21.15.172:58072) 2023-03-27T10:09:59.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7fccb6ffd700 1 -- 172.21.15.172:0/1415121015 learned_addr learned my addr 172.21.15.172:0/1415121015 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7fccbf7fe700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc00c9180 0x7fccc01f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.046+0000 7ff029dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff02406dff0 0x7ff02415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.046+0000 7ff029dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 0x7ff0240b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff02406dff0 0x7ff02415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff0237fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff02406dff0 0x7ff02415e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58066/0 (socket says 172.21.15.172:58066) 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 0x7ff0240b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff022ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 0x7ff0240b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40712/0 (socket says 172.21.15.172:40712) 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff029dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff02414d600 0x7ff0240c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff029dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02414ce60 con 0x7ff024159c10 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff029dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02414d300 con 0x7ff02406dff0 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff029dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02415f8d0 con 0x7ff02414d600 2023-03-27T10:09:59.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.048+0000 7ff0237fe700 1 -- 172.21.15.172:0/1352949953 learned_addr learned my addr 172.21.15.172:0/1352949953 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7ff022ffd700 1 -- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff02414d600 msgr2=0x7ff0240c5c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-27T10:09:59.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7ff022ffd700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff02414d600 0x7ff0240c5c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7ff022ffd700 1 -- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff02406dff0 msgr2=0x7ff02415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7ff022ffd700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff02406dff0 0x7ff02415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7ff022ffd700 1 -- 172.21.15.172:0/1352949953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c009550 con 0x7ff024159c10 2023-03-27T10:09:59.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f61ecbff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61e8160cc0 0x7f61e815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f61ecbff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80ca300 con 0x7f61e80cf070 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f61ecbff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80ca5e0 con 0x7f61e8160cc0 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f61ecbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e80ca8c0 con 0x7f61e80cec00 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 0x7f61e8163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e80cec00 0x7f61e80c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 0x7f61e8163500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40724/0 (socket says 172.21.15.172:40724) 2023-03-27T10:09:59.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 -- 172.21.15.172:0/841388308 learned_addr learned my addr 172.21.15.172:0/841388308 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e6d9d700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61e8160cc0 0x7f61e815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7fccb6ffd700 1 -- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 msgr2=0x7fccc014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7fccb6ffd700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7fccb6ffd700 1 -- 172.21.15.172:0/1415121015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc00c9180 msgr2=0x7fccc01f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7fccb6ffd700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc00c9180 0x7fccc01f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7fccb6ffd700 1 -- 172.21.15.172:0/1415121015 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00085d0 con 0x7fccc00cc700 2023-03-27T10:09:59.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f21101ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21080cce10 0x7f2108159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f21101ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210815a150 con 0x7f21080c9180 2023-03-27T10:09:59.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f21101ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21080cf450 con 0x7f210806dff0 2023-03-27T10:09:59.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.049+0000 7f21101ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210815d770 con 0x7f21080cce10 2023-03-27T10:09:59.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7ff022ffd700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 0x7ff0240b3490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00d5c0 tx=0x7ff00c00d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7fccb6ffd700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 0x7fccc00c7fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcca801e810 tx=0x7fcca801eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f210df9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f210806dff0 0x7f21080ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48504/0 (socket says 172.21.15.172:48504) 2023-03-27T10:09:59.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f210df9b700 1 -- 172.21.15.172:0/2853572524 learned_addr learned my addr 172.21.15.172:0/2853572524 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:59.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7fd438dff700 1 Processor -- start 2023-03-27T10:09:59.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 -- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e80cec00 msgr2=0x7f61e80c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e80cec00 0x7f61e80c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 -- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61e8160cc0 msgr2=0x7f61e815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61e8160cc0 0x7f61e815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f61e5d9b700 1 -- 172.21.15.172:0/841388308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009a70 con 0x7f61e80cf070 2023-03-27T10:09:59.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7f210e79c700 1 --2- 172.21.15.172:0/2853572524 >> v2:172.21.15.172:3300/0 conn(0x7f21080cce10 0x7f2108159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.050+0000 7fd438dff700 1 -- start start 2023-03-27T10:09:59.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7f61e5d9b700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 0x7f61e8163500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9b0 tx=0x7f61dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7f210cf99700 1 -- 172.21.15.172:0/2853572524 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797855952 0 0) 0x7f210815a150 con 0x7f21080c9180 2023-03-27T10:09:59.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7f210cf99700 1 -- 172.21.15.172:0/2853572524 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f40035b0 con 0x7f21080c9180 2023-03-27T10:09:59.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7f210e79c700 1 -- 172.21.15.172:0/2853572524 >> v1:172.21.15.191:6789/0 conn(0x7f210806dff0 legacy=0x7f21080ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7f210e79c700 1 -- 172.21.15.172:0/2853572524 >> v1:172.21.15.172:6789/0 conn(0x7f21080c9180 legacy=0x7f21080cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7f210e79c700 1 -- 172.21.15.172:0/2853572524 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21080cafa0 con 0x7f21080cce10 2023-03-27T10:09:59.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8025640 con 0x7fccc00cc700 2023-03-27T10:09:59.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80257a0 con 0x7fccc00cc700 2023-03-27T10:09:59.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8025b30 con 0x7fccc00cc700 2023-03-27T10:09:59.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00cdc50 con 0x7fccc00cc700 2023-03-27T10:09:59.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc00cb330 con 0x7fccc00cc700 2023-03-27T10:09:59.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7f00067ff700 1 Processor -- start 2023-03-27T10:09:59.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc00cdf30 con 0x7fccc00cc700 2023-03-27T10:09:59.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7f210e79c700 1 --2- 172.21.15.172:0/2853572524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108159c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009840 tx=0x7f20f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3975b99f5a0504d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7f210cf99700 1 -- 172.21.15.172:0/2853572524 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011830 con 0x7f21080cce10 2023-03-27T10:09:59.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7f210cf99700 1 -- 172.21.15.172:0/2853572524 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f8011990 con 0x7f21080cce10 2023-03-27T10:09:59.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7f210cf99700 1 -- 172.21.15.172:0/2853572524 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011d00 con 0x7f21080cce10 2023-03-27T10:09:59.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7fd438dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4340ced40 0x7fd4340cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7fd438dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd434159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7fd438dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340c95e0 con 0x7fd4340c9180 2023-03-27T10:09:59.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7fd438dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43415d770 con 0x7fd4340ced40 2023-03-27T10:09:59.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7fd438dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43415a150 con 0x7fd4340cce10 2023-03-27T10:09:59.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7fd431d9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fd4340c9180 0x7fd4340cc700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48508/0 (socket says 172.21.15.172:48508) 2023-03-27T10:09:59.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7fd431d9b700 1 -- 172.21.15.172:0/3609414426 learned_addr learned my addr 172.21.15.172:0/3609414426 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:09:59.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0235f0 con 0x7ff024159c10 2023-03-27T10:09:59.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c023750 con 0x7ff024159c10 2023-03-27T10:09:59.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02415a090 con 0x7ff024159c10 2023-03-27T10:09:59.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0240cdf30 con 0x7ff024159c10 2023-03-27T10:09:59.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.051+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c023ac0 con 0x7ff024159c10 2023-03-27T10:09:59.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00ee50 con 0x7f61e80cf070 2023-03-27T10:09:59.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc00c850 con 0x7f61e80cf070 2023-03-27T10:09:59.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.053+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00cbc0 con 0x7f61e80cf070 2023-03-27T10:09:59.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.052+0000 7f00067ff700 1 -- start start 2023-03-27T10:09:59.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f00067ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f00000b2020 0x7f00000d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f00067ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00000d1030 0x7f00000b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f00067ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00000cf3e0 con 0x7f00000b4420 2023-03-27T10:09:59.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f00067ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00000d1470 con 0x7f00000d1030 2023-03-27T10:09:59.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f00067ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00000b47f0 con 0x7f00000b2020 2023-03-27T10:09:59.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f21101ff700 1 -- 172.21.15.172:0/2853572524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 msgr2=0x7f2108159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f21101ff700 1 --2- 172.21.15.172:0/2853572524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108159c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009840 tx=0x7f20f8009b50 comp rx=0 tx=0).stop 2023-03-27T10:09:59.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f506adff700 1 Processor -- start 2023-03-27T10:09:59.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f506adff700 1 -- start start 2023-03-27T10:09:59.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7fd43259c700 1 --2- 172.21.15.172:0/3609414426 >> v2:172.21.15.172:3300/0 conn(0x7fd4340ced40 0x7fd4340cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7fd432d9d700 1 --2- 172.21.15.172:0/3609414426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd434159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.055+0000 7f0004d9c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00000d1030 0x7f00000b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.055+0000 7f0004d9c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00000d1030 0x7f00000b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40764/0 (socket says 172.21.15.172:40764) 2023-03-27T10:09:59.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.055+0000 7f0004d9c700 1 -- 172.21.15.172:0/1144310778 learned_addr learned my addr 172.21.15.172:0/1144310778 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8164d60 con 0x7f61e80cf070 2023-03-27T10:09:59.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.054+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e8164a80 con 0x7f61e80cf070 2023-03-27T10:09:59.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.055+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0080052f0 con 0x7ff024159c10 2023-03-27T10:09:59.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f21101ff700 1 -- 172.21.15.172:0/2853572524 shutdown_connections 2023-03-27T10:09:59.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f21101ff700 1 --2- 172.21.15.172:0/2853572524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108159c10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f21101ff700 1 -- 172.21.15.172:0/2853572524 >> 172.21.15.172:0/2853572524 conn(0x7f210806d510 msgr2=0x7f210806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7fd43159a700 1 -- 172.21.15.172:0/3609414426 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925581409 0 0) 0x7fd4340c95e0 con 0x7fd4340c9180 2023-03-27T10:09:59.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7fd43159a700 1 -- 172.21.15.172:0/3609414426 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd41c0035b0 con 0x7fd4340c9180 2023-03-27T10:09:59.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f0004d9c700 1 -- 172.21.15.172:0/1144310778 >> v2:172.21.15.191:3300/0 conn(0x7f00000b2020 msgr2=0x7f00000d0af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-27T10:09:59.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f0004d9c700 1 --2- 172.21.15.172:0/1144310778 >> v2:172.21.15.191:3300/0 conn(0x7f00000b2020 0x7f00000d0af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f506adff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5064160e20 0x7f50640d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f0004d9c700 1 -- 172.21.15.172:0/1144310778 >> v1:172.21.15.191:6789/0 conn(0x7f00000b4420 legacy=0x7f00000cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f0004d9c700 1 -- 172.21.15.172:0/1144310778 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000ce7d0 con 0x7f00000d1030 2023-03-27T10:09:59.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f506adff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f50640b1220 0x7f50640d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f506adff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50640c6870 con 0x7f50641611f0 2023-03-27T10:09:59.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f506adff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50640c5e90 con 0x7f5064160e20 2023-03-27T10:09:59.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7f506adff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50640c5bb0 con 0x7f50640b1220 2023-03-27T10:09:59.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7fd432d9d700 1 -- 172.21.15.172:0/3609414426 >> v2:172.21.15.172:3300/0 conn(0x7fd4340ced40 msgr2=0x7fd4340cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7fd432d9d700 1 --2- 172.21.15.172:0/3609414426 >> v2:172.21.15.172:3300/0 conn(0x7fd4340ced40 0x7fd4340cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7fd432d9d700 1 -- 172.21.15.172:0/3609414426 >> v1:172.21.15.191:6789/0 conn(0x7fd4340c9180 legacy=0x7fd4340cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.056+0000 7fd432d9d700 1 -- 172.21.15.172:0/3609414426 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340cafa0 con 0x7fd4340cce10 2023-03-27T10:09:59.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7f5068b9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5064160e20 0x7f50640d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7f5068b9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5064160e20 0x7f50640d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40776/0 (socket says 172.21.15.172:40776) 2023-03-27T10:09:59.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7f5068b9b700 1 -- 172.21.15.172:0/3298314287 learned_addr learned my addr 172.21.15.172:0/3298314287 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7f0004d9c700 1 --2- 172.21.15.172:0/1144310778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1030 0x7f00000b2720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f000009c990 tx=0x7efff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11de30d7dd38fa6b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7fd432d9d700 1 --2- 172.21.15.172:0/3609414426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd434159c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd42800bae0 tx=0x7fd42800bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb4a09aee67779b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7fd43159a700 1 -- 172.21.15.172:0/3609414426 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428004230 con 0x7fd4340cce10 2023-03-27T10:09:59.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7fd43159a700 1 -- 172.21.15.172:0/3609414426 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428004390 con 0x7fd4340cce10 2023-03-27T10:09:59.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7fd43159a700 1 -- 172.21.15.172:0/3609414426 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800d920 con 0x7fd4340cce10 2023-03-27T10:09:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7f506939c700 1 --2- 172.21.15.172:0/3298314287 >> v2:172.21.15.191:3300/0 conn(0x7f50640b1220 0x7f50640d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.057+0000 7f5068b9b700 1 -- 172.21.15.172:0/3298314287 >> v2:172.21.15.191:3300/0 conn(0x7f50640b1220 msgr2=0x7f50640d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7f5068b9b700 1 --2- 172.21.15.172:0/3298314287 >> v2:172.21.15.191:3300/0 conn(0x7f50640b1220 0x7f50640d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7f5068b9b700 1 -- 172.21.15.172:0/3298314287 >> v1:172.21.15.172:6789/0 conn(0x7f50641611f0 legacy=0x7f5064164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7f5068b9b700 1 -- 172.21.15.172:0/3298314287 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50640d0360 con 0x7f5064160e20 2023-03-27T10:09:59.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7f506939c700 1 --2- 172.21.15.172:0/3298314287 >> v2:172.21.15.191:3300/0 conn(0x7f50640b1220 0x7f50640d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:59.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7f5068b9b700 1 --2- 172.21.15.172:0/3298314287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5064160e20 0x7f50640d0af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f506408c390 tx=0x7f505c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebad64f4dacc51b4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e806fd50 con 0x7f61e80cf070 2023-03-27T10:09:59.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7fd438dff700 1 -- 172.21.15.172:0/3609414426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 msgr2=0x7fd434159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.058+0000 7fd438dff700 1 --2- 172.21.15.172:0/3609414426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd434159c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd42800bae0 tx=0x7fd42800bdf0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fd438dff700 1 -- 172.21.15.172:0/3609414426 shutdown_connections 2023-03-27T10:09:59.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fd438dff700 1 --2- 172.21.15.172:0/3609414426 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd434159c10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fd438dff700 1 --2- 172.21.15.172:0/3609414426 >> v2:172.21.15.172:3300/0 conn(0x7fd4340ced40 0x7fd4340cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fd438dff700 1 -- 172.21.15.172:0/3609414426 >> 172.21.15.172:0/3609414426 conn(0x7fd43406d510 msgr2=0x7fd43406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fcca8025c90 con 0x7fccc00cc700 2023-03-27T10:09:59.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fd438dff700 1 -- 172.21.15.172:0/3609414426 shutdown_connections 2023-03-27T10:09:59.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.059+0000 7fd438dff700 1 -- 172.21.15.172:0/3609414426 wait complete. 2023-03-27T10:09:59.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.060+0000 7f1700bff700 1 Processor -- start 2023-03-27T10:09:59.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.060+0000 7f21101ff700 1 -- 172.21.15.172:0/2853572524 shutdown_connections 2023-03-27T10:09:59.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.060+0000 7f1700bff700 1 -- start start 2023-03-27T10:09:59.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.060+0000 7f21101ff700 1 -- 172.21.15.172:0/2853572524 wait complete. 2023-03-27T10:09:59.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7fccbcff9700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcca0066e30 0x7fcca00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcca8095900 con 0x7fccc00cc700 2023-03-27T10:09:59.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7f1700bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f16fc0b2020 0x7f16fc0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7f1700bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0d1030 0x7f16fc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7f1700bff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0cf3e0 con 0x7f16fc0b4420 2023-03-27T10:09:59.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7f1700bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0d14b0 con 0x7f16fc0b2020 2023-03-27T10:09:59.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7fccbf7fe700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcca0066e30 0x7fcca00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.061+0000 7f1700bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0b47f0 con 0x7f16fc0d1030 2023-03-27T10:09:59.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff00c033070 con 0x7ff024159c10 2023-03-27T10:09:59.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7fd438dff700 1 Processor -- start 2023-03-27T10:09:59.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16f3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f16fc0b2020 0x7f16fc0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16fad9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0d1030 0x7f16fc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16f3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f16fc0b2020 0x7f16fc0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58102/0 (socket says 172.21.15.172:58102) 2023-03-27T10:09:59.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16f3fff700 1 -- 172.21.15.172:0/783884771 learned_addr learned my addr 172.21.15.172:0/783884771 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16fad9d700 1 -- 172.21.15.172:0/783884771 >> v2:172.21.15.191:3300/0 conn(0x7f16fc0b2020 msgr2=0x7f16fc0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16fad9d700 1 --2- 172.21.15.172:0/783884771 >> v2:172.21.15.191:3300/0 conn(0x7f16fc0b2020 0x7f16fc0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16fad9d700 1 -- 172.21.15.172:0/783884771 >> v1:172.21.15.191:6789/0 conn(0x7f16fc0b4420 legacy=0x7f16fc0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:09:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7f16fad9d700 1 -- 172.21.15.172:0/783884771 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0ce7d0 con 0x7f16fc0d1030 2023-03-27T10:09:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.062+0000 7fd438dff700 1 -- start start 2023-03-27T10:09:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.063+0000 7f21101ff700 1 Processor -- start 2023-03-27T10:09:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.063+0000 7f16fad9d700 1 --2- 172.21.15.172:0/783884771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0d1030 0x7f16fc0b2720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009d90 tx=0x7f16f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72071f8a1b347919 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.063+0000 7f21101ff700 1 -- start start 2023-03-27T10:09:59.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7ff01bfff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff004066f00 0x7ff0040693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff00c095580 con 0x7ff024159c10 2023-03-27T10:09:59.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff00c095960 con 0x7ff024159c10 2023-03-27T10:09:59.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd438dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4340c9180 0x7fd4340b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd438dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd4341f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd438dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4340ced40 0x7fd4340b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd438dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b2070 con 0x7fd4340c9180 2023-03-27T10:09:59.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd438dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b2350 con 0x7fd4340ced40 2023-03-27T10:09:59.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd438dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b2630 con 0x7fd4340cce10 2023-03-27T10:09:59.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fcca8062bc0 con 0x7fccc00cc700 2023-03-27T10:09:59.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7efffeffd700 1 -- 172.21.15.172:0/1144310778 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800e070 con 0x7f00000d1030 2023-03-27T10:09:59.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7efffeffd700 1 -- 172.21.15.172:0/1144310778 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff800b9c0 con 0x7f00000d1030 2023-03-27T10:09:59.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7efffeffd700 1 -- 172.21.15.172:0/1144310778 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800bd50 con 0x7f00000d1030 2023-03-27T10:09:59.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f00067ff700 1 -- 172.21.15.172:0/1144310778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1030 msgr2=0x7f00000b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f00067ff700 1 --2- 172.21.15.172:0/1144310778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1030 0x7f00000b2720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f000009c990 tx=0x7efff800b330 comp rx=0 tx=0).stop 2023-03-27T10:09:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f21101ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f210806dff0 0x7f21080c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f21101ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21080c9180 0x7f2108147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f21101ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f21101ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080c2660 con 0x7f21080cce10 2023-03-27T10:09:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f21101ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080c3670 con 0x7f210806dff0 2023-03-27T10:09:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f21101ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080c28b0 con 0x7f21080c9180 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f210e79c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f210e79c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40792/0 (socket says 172.21.15.172:40792) 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f210e79c700 1 -- 172.21.15.172:0/805826899 learned_addr learned my addr 172.21.15.172:0/805826899 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210df9b700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f210806dff0 0x7f21080c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210e79c700 1 -- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21080c9180 msgr2=0x7f2108147110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210e79c700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21080c9180 0x7f2108147110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210e79c700 1 -- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f210806dff0 msgr2=0x7f21080c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210e79c700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f210806dff0 0x7f21080c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210e79c700 1 -- 172.21.15.172:0/805826899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80094a0 con 0x7f21080cce10 2023-03-27T10:09:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f210df9b700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f210806dff0 0x7f21080c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7f210e79c700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108147650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20f80090b0 tx=0x7f20f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.063+0000 7f50637fe700 1 -- 172.21.15.172:0/3298314287 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c00e070 con 0x7f5064160e20 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f50637fe700 1 -- 172.21.15.172:0/3298314287 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c003a20 con 0x7f5064160e20 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7f50637fe700 1 -- 172.21.15.172:0/3298314287 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c003dd0 con 0x7f5064160e20 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 -- 172.21.15.172:0/3298314287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5064160e20 msgr2=0x7f50640d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 --2- 172.21.15.172:0/3298314287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5064160e20 0x7f50640d0af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f506408c390 tx=0x7f505c00b330 comp rx=0 tx=0).stop 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 -- 172.21.15.172:0/3298314287 shutdown_connections 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 --2- 172.21.15.172:0/3298314287 >> v2:172.21.15.191:3300/0 conn(0x7f50640b1220 0x7f50640d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 --2- 172.21.15.172:0/3298314287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5064160e20 0x7f50640d0af0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 -- 172.21.15.172:0/3298314287 >> 172.21.15.172:0/3298314287 conn(0x7f506409c260 msgr2=0x7f50640d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 -- 172.21.15.172:0/3298314287 shutdown_connections 2023-03-27T10:09:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd431d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd4341f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd431d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd4341f6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:55990/0 (socket says 172.21.15.172:55990) 2023-03-27T10:09:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.064+0000 7fd431d9b700 1 -- 172.21.15.172:0/2107695874 learned_addr learned my addr 172.21.15.172:0/2107695874 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd432d9d700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4340ced40 0x7fd4340b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd431d9b700 1 -- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4340ced40 msgr2=0x7fd4340b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd431d9b700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4340ced40 0x7fd4340b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd431d9b700 1 -- 172.21.15.172:0/2107695874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4340c9180 msgr2=0x7fd4340b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd431d9b700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4340c9180 0x7fd4340b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd431d9b700 1 -- 172.21.15.172:0/2107695874 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42800b740 con 0x7fd4340cce10 2023-03-27T10:09:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7fd432d9d700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4340ced40 0x7fd4340b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:09:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f16f9d9b700 1 -- 172.21.15.172:0/783884771 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400e070 con 0x7f16fc0d1030 2023-03-27T10:09:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f16f9d9b700 1 -- 172.21.15.172:0/783884771 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400bae0 con 0x7f16fc0d1030 2023-03-27T10:09:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f16f9d9b700 1 -- 172.21.15.172:0/783884771 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400be90 con 0x7f16fc0d1030 2023-03-27T10:09:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f1700bff700 1 -- 172.21.15.172:0/783884771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0d1030 msgr2=0x7f16fc0b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f1700bff700 1 --2- 172.21.15.172:0/783884771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0d1030 0x7f16fc0b2720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009d90 tx=0x7f16f400b330 comp rx=0 tx=0).stop 2023-03-27T10:09:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f1700bff700 1 -- 172.21.15.172:0/783884771 shutdown_connections 2023-03-27T10:09:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f1700bff700 1 --2- 172.21.15.172:0/783884771 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0d1030 0x7f16fc0b2720 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7f1700bff700 1 --2- 172.21.15.172:0/783884771 >> v2:172.21.15.191:3300/0 conn(0x7f16fc0b2020 0x7f16fc0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7f1700bff700 1 -- 172.21.15.172:0/783884771 >> 172.21.15.172:0/783884771 conn(0x7f16fc09c260 msgr2=0x7f16fc0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7f1700bff700 1 -- 172.21.15.172:0/783884771 shutdown_connections 2023-03-27T10:09:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7f1700bff700 1 -- 172.21.15.172:0/783884771 wait complete. 2023-03-27T10:09:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7ff0237fe700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff004066f00 0x7ff0040693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.066+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f61dc019030 con 0x7f61e80cf070 2023-03-27T10:09:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.067+0000 7f61d6ffd700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f61c8066f00 0x7f61c80693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.068+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61dc0848b0 con 0x7f61e80cf070 2023-03-27T10:09:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.065+0000 7f506adff700 1 -- 172.21.15.172:0/3298314287 wait complete. 2023-03-27T10:09:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.068+0000 7f61e659c700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f61c8066f00 0x7f61c80693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.068+0000 7f506adff700 1 Processor -- start 2023-03-27T10:09:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.068+0000 7fd431d9b700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd4341f6700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00cbe0 tx=0x7fd42c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.068+0000 7f506adff700 1 -- start start 2023-03-27T10:09:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7ff0237fe700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff004066f00 0x7ff0040693b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff014009f50 tx=0x7ff0140095b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7f61e659c700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f61c8066f00 0x7f61c80693b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61e0014040 tx=0x7f61e0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00abc0 con 0x7fd4340cce10 2023-03-27T10:09:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c00ad20 con 0x7fd4340cce10 2023-03-27T10:09:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c007310 con 0x7fd4340cce10 2023-03-27T10:09:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4340cdf30 con 0x7fd4340cce10 2023-03-27T10:09:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4340cdc50 con 0x7fd4340cce10 2023-03-27T10:09:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7f1700bff700 1 Processor -- start 2023-03-27T10:09:59.112 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506adff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50640b1220 0x7f50640b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.112 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506adff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5064160e20 0x7f506415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.112 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506adff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 0x7f50640cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.112 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506adff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50640b8870 con 0x7f50641611f0 2023-03-27T10:09:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506adff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50640b7290 con 0x7f50640b1220 2023-03-27T10:09:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506adff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50640b7570 con 0x7f5064160e20 2023-03-27T10:09:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f1700bff700 1 -- start start 2023-03-27T10:09:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506939c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 0x7f50640cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506939c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 0x7f50640cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40802/0 (socket says 172.21.15.172:40802) 2023-03-27T10:09:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7f506939c700 1 -- 172.21.15.172:0/466986966 learned_addr learned my addr 172.21.15.172:0/466986966 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.070+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4340cabc0 con 0x7fd4340cce10 2023-03-27T10:09:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f5068b9b700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50640b1220 0x7f50640b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f506939c700 1 -- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5064160e20 msgr2=0x7f506415e0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:09:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f506939c700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5064160e20 0x7f506415e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f506939c700 1 -- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50640b1220 msgr2=0x7f50640b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f506939c700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50640b1220 0x7f50640b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f506939c700 1 -- 172.21.15.172:0/466986966 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c009b30 con 0x7f50641611f0 2023-03-27T10:09:59.116 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f5068b9b700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50640b1220 0x7f50640b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:09:59.116 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f506939c700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 0x7f50640cc570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f505800c7f0 tx=0x7f505800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f1700bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 0x7f16fc0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f1700bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0b4420 0x7f16fc0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f1700bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16fc0d1030 0x7f16fc155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f1700bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0ccd90 con 0x7f16fc0b2020 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f1700bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0c70c0 con 0x7f16fc0d1030 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.071+0000 7f1700bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0c73a0 con 0x7f16fc0b4420 2023-03-27T10:09:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 0x7f16fc0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 0x7f16fc0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40810/0 (socket says 172.21.15.172:40810) 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 -- 172.21.15.172:0/3052868999 learned_addr learned my addr 172.21.15.172:0/3052868999 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fad9d700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16fc0d1030 0x7f16fc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16f3fff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0b4420 0x7f16fc0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 -- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0b4420 msgr2=0x7f16fc0cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0b4420 0x7f16fc0cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 -- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16fc0d1030 msgr2=0x7f16fc155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16fc0d1030 0x7f16fc155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.072+0000 7f16fa59c700 1 -- 172.21.15.172:0/3052868999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f4009a70 con 0x7f16fc0b2020 2023-03-27T10:09:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.073+0000 7fccbf7fe700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcca0066e30 0x7fcca00692e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccb000d370 tx=0x7fccb0012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7f00067ff700 1 -- 172.21.15.172:0/1144310778 shutdown_connections 2023-03-27T10:09:59.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7f00067ff700 1 --2- 172.21.15.172:0/1144310778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1030 0x7f00000b2720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7f00067ff700 1 --2- 172.21.15.172:0/1144310778 >> v2:172.21.15.191:3300/0 conn(0x7f00000b2020 0x7f00000d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.069+0000 7f00067ff700 1 -- 172.21.15.172:0/1144310778 >> 172.21.15.172:0/1144310778 conn(0x7f000009c260 msgr2=0x7f00000d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.073+0000 7f00067ff700 1 -- 172.21.15.172:0/1144310778 shutdown_connections 2023-03-27T10:09:59.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.073+0000 7f00067ff700 1 -- 172.21.15.172:0/1144310778 wait complete. 2023-03-27T10:09:59.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.073+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd42c01a030 con 0x7fd4340cce10 2023-03-27T10:09:59.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7fd422ffd700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd414066e80 0x7fd414069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd42c035e40 con 0x7fd4340cce10 2023-03-27T10:09:59.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.073+0000 7f16fa59c700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 0x7f16fc0c6a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00c4b0 tx=0x7f16ec00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec011790 con 0x7f16fc0b2020 2023-03-27T10:09:59.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec0118f0 con 0x7f16fc0b2020 2023-03-27T10:09:59.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec011c80 con 0x7f16fc0b2020 2023-03-27T10:09:59.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc0ced90 con 0x7f16fc0b2020 2023-03-27T10:09:59.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc0ceab0 con 0x7f16fc0b2020 2023-03-27T10:09:59.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f61dc051b70 con 0x7f61e80cf070 2023-03-27T10:09:59.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f00067ff700 1 Processor -- start 2023-03-27T10:09:59.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f00067ff700 1 -- start start 2023-03-27T10:09:59.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.076+0000 7f00067ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00000b2020 0x7f000014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.076+0000 7f00067ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000b4420 0x7f00000cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.076+0000 7f00067ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00000d1030 0x7f00000cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f00067ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001fa890 con 0x7f00000b4420 2023-03-27T10:09:59.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f00067ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000150cc0 con 0x7f00000d1030 2023-03-27T10:09:59.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f00067ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0000150fa0 con 0x7f00000b2020 2023-03-27T10:09:59.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80044d0 con 0x7f21080cce10 2023-03-27T10:09:59.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f801f070 con 0x7f21080cce10 2023-03-27T10:09:59.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.074+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80038e0 con 0x7f21080cce10 2023-03-27T10:09:59.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21080cdc50 con 0x7f21080cce10 2023-03-27T10:09:59.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21080cb280 con 0x7f21080cce10 2023-03-27T10:09:59.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058011800 con 0x7f50641611f0 2023-03-27T10:09:59.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058011960 con 0x7f50641611f0 2023-03-27T10:09:59.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.075+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058011d10 con 0x7f50641611f0 2023-03-27T10:09:59.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.076+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50640afcf0 con 0x7f50641611f0 2023-03-27T10:09:59.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.076+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50640d0640 con 0x7f50641611f0 2023-03-27T10:09:59.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7fd43259c700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd414066e80 0x7fd414069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21080cdf30 con 0x7f21080cce10 2023-03-27T10:09:59.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.081+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd42c051550 con 0x7fd4340cce10 2023-03-27T10:09:59.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d40052f0 con 0x7f16fc0b2020 2023-03-27T10:09:59.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f16ec010050 con 0x7f16fc0b2020 2023-03-27T10:09:59.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.081+0000 7f16f2ffd700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16e0066f00 0x7f16e00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.081+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16ec084910 con 0x7f16fc0b2020 2023-03-27T10:09:59.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f0004d9c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00000d1030 0x7f00000cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f0004d9c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00000d1030 0x7f00000cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58150/0 (socket says 172.21.15.172:58150) 2023-03-27T10:09:59.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.077+0000 7f0004d9c700 1 -- 172.21.15.172:0/3319764732 learned_addr learned my addr 172.21.15.172:0/3319764732 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:09:59.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.078+0000 7efffffff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00000b2020 0x7f000014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.078+0000 7effff7fe700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000b4420 0x7f00000cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7effff7fe700 1 -- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00000b2020 msgr2=0x7f000014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7effff7fe700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00000b2020 0x7f000014e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7effff7fe700 1 -- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00000d1030 msgr2=0x7f00000cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7effff7fe700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00000d1030 0x7f00000cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7effff7fe700 1 -- 172.21.15.172:0/3319764732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009b30 con 0x7f00000b4420 2023-03-27T10:09:59.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.079+0000 7effff7fe700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000b4420 0x7f00000cf590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efff4009fd0 tx=0x7efff400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.080+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f20f800f050 con 0x7f21080cce10 2023-03-27T10:09:59.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.082+0000 7f20fe7fc700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f20ec066f00 0x7f20ec0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.082+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f20f8021070 con 0x7f21080cce10 2023-03-27T10:09:59.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.083+0000 7f210df9b700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f20ec066f00 0x7f20ec0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.083+0000 7f16f3fff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16e0066f00 0x7f16e00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.082+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50640c6100 con 0x7f50641611f0 2023-03-27T10:09:59.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.083+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f5058021070 con 0x7f50641611f0 2023-03-27T10:09:59.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.084+0000 7fd43259c700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd414066e80 0x7fd414069330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd424006b20 tx=0x7fd424006ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.084+0000 7f16f3fff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16e0066f00 0x7f16e00693b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16fc1f9a80 tx=0x7f16e40092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.084+0000 7f50617fa700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5050066f00 0x7f50500693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.085+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5058084180 con 0x7f50641611f0 2023-03-27T10:09:59.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.085+0000 7f210df9b700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f20ec066f00 0x7f20ec0693b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2104005910 tx=0x7f2104009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.086+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f20f8053050 con 0x7f21080cce10 2023-03-27T10:09:59.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.086+0000 7f5068b9b700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5050066f00 0x7f50500693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.088+0000 7f5068b9b700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5050066f00 0x7f50500693b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f505c000f80 tx=0x7f505c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.090+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4011620 con 0x7f00000b4420 2023-03-27T10:09:59.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.090+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00000ced90 con 0x7f00000b4420 2023-03-27T10:09:59.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.090+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00000ceab0 con 0x7f00000b4420 2023-03-27T10:09:59.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.091+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f16ec055600 con 0x7f16fc0b2020 2023-03-27T10:09:59.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.092+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00000cf070 con 0x7f00000b4420 2023-03-27T10:09:59.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.099+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f50580513c0 con 0x7f50641611f0 2023-03-27T10:09:59.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.099+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4011780 con 0x7f00000b4420 2023-03-27T10:09:59.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.099+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4011af0 con 0x7f00000b4420 2023-03-27T10:09:59.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.102+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7efff4021070 con 0x7f00000b4420 2023-03-27T10:09:59.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.103+0000 7efffcff9700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7effec066e30 0x7effec0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:09:59.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.104+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efff4084540 con 0x7f00000b4420 2023-03-27T10:09:59.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.105+0000 7efffffff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7effec066e30 0x7effec0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:09:59.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.109+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7efff4051790 con 0x7f00000b4420 2023-03-27T10:09:59.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.124+0000 7efffffff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7effec066e30 0x7effec0692e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efff0007fd0 tx=0x7efff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:09:59.504 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.505+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff008005870 con 0x7ff024159c10 2023-03-27T10:09:59.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.506+0000 7ff01bfff700 1 -- 172.21.15.172:0/1352949953 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff00c027090 con 0x7ff024159c10 2023-03-27T10:09:59.505 INFO:teuthology.orchestra.run.smithi172.stdout:55834574853 2023-03-27T10:09:59.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.503+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fccc00c7340 con 0x7fccc00cc700 2023-03-27T10:09:59.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.505+0000 7fccbcff9700 1 -- 172.21.15.172:0/1415121015 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccc00c7340 con 0x7fccc00cc700 2023-03-27T10:09:59.508 INFO:teuthology.orchestra.run.smithi172.stdout:55834574854 2023-03-27T10:09:59.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcca0066e30 msgr2=0x7fcca00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcca0066e30 0x7fcca00692e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccb000d370 tx=0x7fccb0012000 comp rx=0 tx=0).stop 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 msgr2=0x7fccc00c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 0x7fccc00c7fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcca801e810 tx=0x7fcca801eb20 comp rx=0 tx=0).stop 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 shutdown_connections 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fccc00ced40 0x7fccc014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc00c9180 0x7fccc01f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcca0066e30 0x7fcca00692e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 --2- 172.21.15.172:0/1415121015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fccc00cc700 0x7fccc00c7fc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 >> 172.21.15.172:0/1415121015 conn(0x7fccc006d510 msgr2=0x7fccc0155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 shutdown_connections 2023-03-27T10:09:59.510 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.509+0000 7fccc5dff700 1 -- 172.21.15.172:0/1415121015 wait complete. 2023-03-27T10:09:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.510+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff004066f00 msgr2=0x7ff0040693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.510+0000 7ff029dff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff004066f00 0x7ff0040693b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff014009f50 tx=0x7ff0140095b0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.510+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 msgr2=0x7ff0240b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.510+0000 7ff029dff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 0x7ff0240b3490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00d5c0 tx=0x7ff00c00d980 comp rx=0 tx=0).stop 2023-03-27T10:09:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 shutdown_connections 2023-03-27T10:09:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff02414d600 0x7ff0240c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff004066f00 0x7ff0040693b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff02406dff0 0x7ff02415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 --2- 172.21.15.172:0/1352949953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff024159c10 0x7ff0240b3490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 >> 172.21.15.172:0/1352949953 conn(0x7ff02406d510 msgr2=0x7ff024070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 shutdown_connections 2023-03-27T10:09:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7ff029dff700 1 -- 172.21.15.172:0/1352949953 wait complete. 2023-03-27T10:09:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.511+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61e80c4490 con 0x7f61e80cf070 2023-03-27T10:09:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.514+0000 7f61d6ffd700 1 -- 172.21.15.172:0/841388308 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61dc021020 con 0x7f61e80cf070 2023-03-27T10:09:59.516 INFO:teuthology.orchestra.run.smithi172.stdout:55834574854 2023-03-27T10:09:59.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.519+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f61c8066f00 msgr2=0x7f61c80693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.519+0000 7f61ecbff700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f61c8066f00 0x7f61c80693b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61e0014040 tx=0x7f61e0011000 comp rx=0 tx=0).stop 2023-03-27T10:09:59.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.519+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 msgr2=0x7f61e8163500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.519+0000 7f61ecbff700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 0x7f61e8163500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9b0 tx=0x7f61dc00ecc0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 shutdown_connections 2023-03-27T10:09:59.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f61c8066f00 0x7f61c80693b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61e8160cc0 0x7f61e815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61e80cec00 0x7f61e80c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 --2- 172.21.15.172:0/841388308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e80cf070 0x7f61e8163500 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 >> 172.21.15.172:0/841388308 conn(0x7f61e806dd30 msgr2=0x7f61e80c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 shutdown_connections 2023-03-27T10:09:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.520+0000 7f61ecbff700 1 -- 172.21.15.172:0/841388308 wait complete. 2023-03-27T10:09:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.521+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4340b2770 con 0x7fd4340cce10 2023-03-27T10:09:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.521+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2108074300 con 0x7f21080cce10 2023-03-27T10:09:59.523 INFO:teuthology.orchestra.run.smithi172.stdout:55834574853 2023-03-27T10:09:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.522+0000 7f20fe7fc700 1 -- 172.21.15.172:0/805826899 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20f8015020 con 0x7f21080cce10 2023-03-27T10:09:59.524 INFO:teuthology.orchestra.run.smithi172.stdout:60129542150 2023-03-27T10:09:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.521+0000 7fd422ffd700 1 -- 172.21.15.172:0/2107695874 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4340b2770 con 0x7fd4340cce10 2023-03-27T10:09:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f20ec066f00 msgr2=0x7f20ec0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7f21101ff700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f20ec066f00 0x7f20ec0693b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2104005910 tx=0x7f2104009040 comp rx=0 tx=0).stop 2023-03-27T10:09:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 msgr2=0x7f2108147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7f21101ff700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108147650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20f80090b0 tx=0x7f20f8004750 comp rx=0 tx=0).stop 2023-03-27T10:09:59.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd414066e80 msgr2=0x7fd414069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7fd438dff700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd414066e80 0x7fd414069330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd424006b20 tx=0x7fd424006ab0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 msgr2=0x7fd4341f6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.526+0000 7fd438dff700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd4341f6700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00cbe0 tx=0x7fd42c00a060 comp rx=0 tx=0).stop 2023-03-27T10:09:59.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f16d4005870 con 0x7f16fc0b2020 2023-03-27T10:09:59.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 shutdown_connections 2023-03-27T10:09:59.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21080cce10 0x7f2108147650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f20ec066f00 0x7f20ec0693b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f210806dff0 0x7f21080c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 --2- 172.21.15.172:0/805826899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21080c9180 0x7f2108147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 >> 172.21.15.172:0/805826899 conn(0x7f210806d510 msgr2=0x7f210806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 shutdown_connections 2023-03-27T10:09:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd414066e80 0x7fd414069330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd4340ced40 0x7fd4340b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4340c9180 0x7fd4340b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 --2- 172.21.15.172:0/2107695874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd4340cce10 0x7fd4341f6700 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 >> 172.21.15.172:0/2107695874 conn(0x7fd43406d510 msgr2=0x7fd434156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 shutdown_connections 2023-03-27T10:09:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 shutdown_connections 2023-03-27T10:09:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7fd438dff700 1 -- 172.21.15.172:0/2107695874 wait complete. 2023-03-27T10:09:59.530 INFO:teuthology.orchestra.run.smithi172.stdout:55834574854 2023-03-27T10:09:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f16f2ffd700 1 -- 172.21.15.172:0/3052868999 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16ec082e60 con 0x7f16fc0b2020 2023-03-27T10:09:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.527+0000 7f21101ff700 1 -- 172.21.15.172:0/805826899 wait complete. 2023-03-27T10:09:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.532+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5064074300 con 0x7f50641611f0 2023-03-27T10:09:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.532+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16e0066f00 msgr2=0x7f16e00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.532+0000 7f1700bff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16e0066f00 0x7f16e00693b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16fc1f9a80 tx=0x7f16e40092c0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.532+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 msgr2=0x7f16fc0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.532+0000 7f1700bff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 0x7f16fc0c6a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00c4b0 tx=0x7f16ec00c7c0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.533+0000 7f50617fa700 1 -- 172.21.15.172:0/466986966 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50580549e0 con 0x7f50641611f0 2023-03-27T10:09:59.533 INFO:teuthology.orchestra.run.smithi172.stdout:55834574853 2023-03-27T10:09:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.538+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 shutdown_connections 2023-03-27T10:09:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.538+0000 7f1700bff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16e0066f00 0x7f16e00693b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.538+0000 7f1700bff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16fc0d1030 0x7f16fc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.538+0000 7f1700bff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16fc0b2020 0x7f16fc0c6a30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.538+0000 7f1700bff700 1 --2- 172.21.15.172:0/3052868999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16fc0b4420 0x7f16fc0cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.538+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 >> 172.21.15.172:0/3052868999 conn(0x7f16fc09c260 msgr2=0x7f16fc06b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.4 2023-03-27T10:09:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5050066f00 msgr2=0x7f50500693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5050066f00 0x7f50500693b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f505c000f80 tx=0x7f505c009000 comp rx=0 tx=0).stop 2023-03-27T10:09:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 msgr2=0x7f50640cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 0x7f50640cc570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f505800c7f0 tx=0x7f505800cbb0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 shutdown_connections 2023-03-27T10:09:59.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 shutdown_connections 2023-03-27T10:09:59.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50641611f0 0x7f50640cc570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5050066f00 0x7f50500693b0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f505c000f80 tx=0x7f505c009000 comp rx=0 tx=0).stop 2023-03-27T10:09:59.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50640b1220 0x7f50640b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 --2- 172.21.15.172:0/466986966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5064160e20 0x7f506415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 >> 172.21.15.172:0/466986966 conn(0x7f506409c260 msgr2=0x7f5064160410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.540+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 shutdown_connections 2023-03-27T10:09:59.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.539+0000 7f1700bff700 1 -- 172.21.15.172:0/3052868999 wait complete. 2023-03-27T10:09:59.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.540+0000 7f506adff700 1 -- 172.21.15.172:0/466986966 wait complete. 2023-03-27T10:09:59.546 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.545+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0000074300 con 0x7f00000b4420 2023-03-27T10:09:59.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2023-03-27T10:09:59.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.547+0000 7efffcff9700 1 -- 172.21.15.172:0/3319764732 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efff4054db0 con 0x7f00000b4420 2023-03-27T10:09:59.548 INFO:teuthology.orchestra.run.smithi172.stdout:55834574853 2023-03-27T10:09:59.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7effec066e30 msgr2=0x7effec0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7effec066e30 0x7effec0692e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efff0007fd0 tx=0x7efff0009040 comp rx=0 tx=0).stop 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000b4420 msgr2=0x7f00000cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000b4420 0x7f00000cf590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efff4009fd0 tx=0x7efff400b6c0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 shutdown_connections 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7effec066e30 0x7effec0692e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f00000d1030 0x7f00000cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f00000b2020 0x7f000014e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 --2- 172.21.15.172:0/3319764732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000b4420 0x7f00000cf590 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:09:59.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 >> 172.21.15.172:0/3319764732 conn(0x7f000009c260 msgr2=0x7f00000b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:09:59.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 shutdown_connections 2023-03-27T10:09:59.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:09:59.552+0000 7f00067ff700 1 -- 172.21.15.172:0/3319764732 wait complete. 2023-03-27T10:09:59.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2023-03-27T10:09:59.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2023-03-27T10:09:59.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2023-03-27T10:09:59.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2023-03-27T10:09:59.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2023-03-27T10:09:59.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2023-03-27T10:10:00.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-27T10:10:00.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-27T10:10:00.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-27T10:10:00.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-27T10:10:00.563 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-27T10:10:00.566 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-27T10:10:00.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-27T10:10:00.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-27T10:10:00.826 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.827+0000 7f33f89ff700 1 Processor -- start 2023-03-27T10:10:00.831 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.827+0000 7f33f89ff700 1 -- start start 2023-03-27T10:10:00.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.829+0000 7f33f89ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33f40ced40 0x7f33f40cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.829+0000 7f33f89ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f33f40cce10 0x7f33f4159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.829+0000 7f33f89ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f415a150 con 0x7f33f40c9180 2023-03-27T10:10:00.832 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.829+0000 7f33f89ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f415d770 con 0x7f33f40cce10 2023-03-27T10:10:00.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.829+0000 7f33f89ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40cafa0 con 0x7f33f40ced40 2023-03-27T10:10:00.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.831+0000 7f33f259c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33f40ced40 0x7f33f40cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.831+0000 7f33f259c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33f40ced40 0x7f33f40cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58156/0 (socket says 172.21.15.172:58156) 2023-03-27T10:10:00.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.831+0000 7f33f259c700 1 -- 172.21.15.172:0/1143145071 learned_addr learned my addr 172.21.15.172:0/1143145071 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.832+0000 7f33f2d9d700 1 --2- 172.21.15.172:0/1143145071 >> v2:172.21.15.172:3300/0 conn(0x7f33f40cce10 0x7f33f4159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.833+0000 7f33f2d9d700 1 -- 172.21.15.172:0/1143145071 >> v2:172.21.15.191:3300/0 conn(0x7f33f40ced40 msgr2=0x7f33f40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:00.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.833+0000 7f33f2d9d700 1 --2- 172.21.15.172:0/1143145071 >> v2:172.21.15.191:3300/0 conn(0x7f33f40ced40 0x7f33f40cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.833+0000 7f33f2d9d700 1 -- 172.21.15.172:0/1143145071 >> v1:172.21.15.172:6789/0 conn(0x7f33f40c9180 legacy=0x7f33f40cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:00.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.833+0000 7f33f2d9d700 1 -- 172.21.15.172:0/1143145071 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40cb280 con 0x7f33f40cce10 2023-03-27T10:10:00.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.834+0000 7f33f2d9d700 1 --2- 172.21.15.172:0/1143145071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40cce10 0x7f33f4159c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f33f406e590 tx=0x7f33e4008b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9e422fbf9f2af7 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:00.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.835+0000 7f33f159a700 1 -- 172.21.15.172:0/1143145071 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e401ec20 con 0x7f33f40cce10 2023-03-27T10:10:00.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.835+0000 7f33f159a700 1 -- 172.21.15.172:0/1143145071 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e401ed80 con 0x7f33f40cce10 2023-03-27T10:10:00.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.835+0000 7f33f159a700 1 -- 172.21.15.172:0/1143145071 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004250 con 0x7f33f40cce10 2023-03-27T10:10:00.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.836+0000 7f33f89ff700 1 -- 172.21.15.172:0/1143145071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40cce10 msgr2=0x7f33f4159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:00.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.836+0000 7f33f89ff700 1 --2- 172.21.15.172:0/1143145071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40cce10 0x7f33f4159c10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f33f406e590 tx=0x7f33e4008b80 comp rx=0 tx=0).stop 2023-03-27T10:10:00.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.837+0000 7f33f89ff700 1 -- 172.21.15.172:0/1143145071 shutdown_connections 2023-03-27T10:10:00.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.837+0000 7f33f89ff700 1 --2- 172.21.15.172:0/1143145071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40cce10 0x7f33f4159c10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.837+0000 7f33f89ff700 1 --2- 172.21.15.172:0/1143145071 >> v2:172.21.15.191:3300/0 conn(0x7f33f40ced40 0x7f33f40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.837+0000 7f33f89ff700 1 -- 172.21.15.172:0/1143145071 >> 172.21.15.172:0/1143145071 conn(0x7f33f406d510 msgr2=0x7f33f406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:00.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.838+0000 7f33f89ff700 1 -- 172.21.15.172:0/1143145071 shutdown_connections 2023-03-27T10:10:00.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.838+0000 7f33f89ff700 1 -- 172.21.15.172:0/1143145071 wait complete. 2023-03-27T10:10:00.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.841+0000 7f33f89ff700 1 Processor -- start 2023-03-27T10:10:00.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.841+0000 7f33f89ff700 1 -- start start 2023-03-27T10:10:00.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.843+0000 7f33f89ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 0x7f33f41f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.843+0000 7f33f89ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33f40cce10 0x7f33f40b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.843+0000 7f33f89ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33f40ced40 0x7f33f40b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.843+0000 7f33f89ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40b24d0 con 0x7f33f40c9180 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.843+0000 7f33f89ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40b3300 con 0x7f33f40ced40 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.843+0000 7f33f89ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40b2780 con 0x7f33f40cce10 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.844+0000 7f33f259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 0x7f33f41f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.844+0000 7f33f259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 0x7f33f41f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40822/0 (socket says 172.21.15.172:40822) 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.844+0000 7f33f259c700 1 -- 172.21.15.172:0/761367354 learned_addr learned my addr 172.21.15.172:0/761367354 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.845+0000 7f33f259c700 1 -- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33f40cce10 msgr2=0x7f33f40b1a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.845+0000 7f33f259c700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33f40cce10 0x7f33f40b1a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.845+0000 7f33f259c700 1 -- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33f40ced40 msgr2=0x7f33f40b1f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.845+0000 7f33f259c700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33f40ced40 0x7f33f40b1f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.845+0000 7f33f259c700 1 -- 172.21.15.172:0/761367354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4008520 con 0x7f33f40c9180 2023-03-27T10:10:00.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.845+0000 7f33f259c700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 0x7f33f41f5130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007bd0 tx=0x7f33ec007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.848+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00db40 con 0x7f33f40c9180 2023-03-27T10:10:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.848+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00f040 con 0x7f33f40c9180 2023-03-27T10:10:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.848+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec015400 con 0x7f33f40c9180 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.848+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40cdf30 con 0x7f33f40c9180 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.848+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f40cdc50 con 0x7f33f40c9180 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.854+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f33ec01c030 con 0x7f33f40c9180 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.855+0000 7f33e2ffd700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f33d4066f00 0x7f33d40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.855+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33ec083dd0 con 0x7f33f40c9180 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.856+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80052f0 con 0x7f33f40c9180 2023-03-27T10:10:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.856+0000 7f33f1d9b700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f33d4066f00 0x7f33d40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.864 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.866+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f33ec04e4f0 con 0x7f33f40c9180 2023-03-27T10:10:00.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.876+0000 7f33f1d9b700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f33d4066f00 0x7f33d40693b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f33f4156600 tx=0x7f33e8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:00.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.980+0000 7fd8095ff700 1 Processor -- start 2023-03-27T10:10:00.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.980+0000 7fe5557ff700 1 Processor -- start 2023-03-27T10:10:00.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7fd8095ff700 1 -- start start 2023-03-27T10:10:00.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.977+0000 7f29587ff700 1 Processor -- start 2023-03-27T10:10:00.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.977+0000 7f29587ff700 1 -- start start 2023-03-27T10:10:00.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.979+0000 7f29587ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2950160fc0 0x7f2950164be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.979+0000 7f29587ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29500c1d10 0x7f2950165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.979+0000 7f29587ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2950165660 0x7f29500ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.979+0000 7f29587ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295006c1d0 con 0x7f29500c1d10 2023-03-27T10:10:00.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.979+0000 7f29587ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2950162220 con 0x7f2950160fc0 2023-03-27T10:10:00.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.979+0000 7f29587ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2950071870 con 0x7f2950165660 2023-03-27T10:10:00.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.980+0000 7f295659b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2950160fc0 0x7f2950164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.980+0000 7f295659b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2950160fc0 0x7f2950164be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58176/0 (socket says 172.21.15.172:58176) 2023-03-27T10:10:00.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.980+0000 7f295659b700 1 -- 172.21.15.172:0/2178693161 learned_addr learned my addr 172.21.15.172:0/2178693161 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.980+0000 7f2956d9c700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2950165660 0x7f29500ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f81349ff700 1 Processor -- start 2023-03-27T10:10:00.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f46a4dff700 1 Processor -- start 2023-03-27T10:10:00.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f2955d9a700 1 --2- 172.21.15.172:0/2178693161 >> v2:172.21.15.172:3300/0 conn(0x7f29500c1d10 0x7f2950165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f295659b700 1 -- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2950165660 msgr2=0x7f29500ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:00.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f295659b700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2950165660 0x7f29500ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f295659b700 1 -- 172.21.15.172:0/2178693161 >> v2:172.21.15.172:3300/0 conn(0x7f29500c1d10 msgr2=0x7f2950165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:00.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f295659b700 1 --2- 172.21.15.172:0/2178693161 >> v2:172.21.15.172:3300/0 conn(0x7f29500c1d10 0x7f2950165120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f295659b700 1 -- 172.21.15.172:0/2178693161 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950071b50 con 0x7f2950160fc0 2023-03-27T10:10:00.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7f2956d9c700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2950165660 0x7f29500ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:00.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.982+0000 7f295659b700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950160fc0 0x7f2950164be0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29500cfbd0 tx=0x7f294c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eabb096b0fe63cd7 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:00.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.982+0000 7f46a4dff700 1 -- start start 2023-03-27T10:10:00.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f46a4dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f46a0070b10 0x7f46a006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f46a4dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46a0165360 0x7f46a006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f46a4dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a0071740 con 0x7f46a01657d0 2023-03-27T10:10:00.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f46a4dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0164ed0 con 0x7f46a0165360 2023-03-27T10:10:00.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f46a4dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0164ba0 con 0x7f46a0070b10 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.981+0000 7fe5557ff700 1 -- start start 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fe5557ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fe5557ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500cafa0 con 0x7fe5500ced40 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fe5557ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500cb280 con 0x7fe5500c9180 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fe5557ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55015d770 con 0x7fe5500cce10 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fe54f7fe700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fe5500c9180 0x7fe550070a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48546/0 (socket says 172.21.15.172:48546) 2023-03-27T10:10:00.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fe54f7fe700 1 -- 172.21.15.172:0/1779280214 learned_addr learned my addr 172.21.15.172:0/1779280214 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fe54e7fc700 1 --2- 172.21.15.172:0/1779280214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fe54e7fc700 1 -- 172.21.15.172:0/1779280214 >> v1:172.21.15.191:6789/0 conn(0x7fe5500c9180 legacy=0x7fe550070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fe54e7fc700 1 -- 172.21.15.172:0/1779280214 >> v1:172.21.15.172:6789/0 conn(0x7fe5500ced40 legacy=0x7fe5500cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fe54e7fc700 1 -- 172.21.15.172:0/1779280214 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500cdc50 con 0x7fe5500cce10 2023-03-27T10:10:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f35e41ff700 1 Processor -- start 2023-03-27T10:10:00.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f35e41ff700 1 -- start start 2023-03-27T10:10:00.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.982+0000 7f81349ff700 1 -- start start 2023-03-27T10:10:00.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f81349ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f813006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f81349ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8130165360 0x7f813006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f81349ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81301657d0 0x7f813006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f81349ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8130071740 con 0x7f81301657d0 2023-03-27T10:10:00.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f81349ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8130164ed0 con 0x7f8130165360 2023-03-27T10:10:00.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7f81349ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8130164ba0 con 0x7f8130070b10 2023-03-27T10:10:00.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fd8095ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fd8095ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd804159c10 0x7fd8040ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fd8095ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8040cf280 0x7fd8040cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fd8095ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd804160ae0 con 0x7fd804159c10 2023-03-27T10:10:00.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fd8095ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040cafa0 con 0x7fd8040cf280 2023-03-27T10:10:00.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.983+0000 7fd8095ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040cb280 con 0x7fd80406dff0 2023-03-27T10:10:00.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fd8037fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8040cf280 0x7fd8040cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fd8037fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8040cf280 0x7fd8040cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58180/0 (socket says 172.21.15.172:58180) 2023-03-27T10:10:00.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.984+0000 7fd8037fe700 1 -- 172.21.15.172:0/3222024115 learned_addr learned my addr 172.21.15.172:0/3222024115 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f79d3fff700 1 Processor -- start 2023-03-27T10:10:00.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7fd8027fc700 1 --2- 172.21.15.172:0/3222024115 >> v2:172.21.15.172:3300/0 conn(0x7fd804159c10 0x7fd8040ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f469e59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f46a0070b10 0x7f46a006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f469e59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f46a0070b10 0x7f46a006c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58194/0 (socket says 172.21.15.172:58194) 2023-03-27T10:10:00.991 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f469e59c700 1 -- 172.21.15.172:0/4205409342 learned_addr learned my addr 172.21.15.172:0/4205409342 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e41ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f35dc15a240 0x7f35dc0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e41ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35dc0d3a30 0x7f35dc0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc1604b0 0x7f35dc160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e41ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc161200 con 0x7f35dc0d3a30 2023-03-27T10:10:00.992 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e41ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc0d29d0 con 0x7f35dc15a240 2023-03-27T10:10:00.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e41ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc15a610 con 0x7f35dc1604b0 2023-03-27T10:10:00.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f469e59c700 1 -- 172.21.15.172:0/4205409342 >> v2:172.21.15.172:3300/0 conn(0x7f46a0165360 msgr2=0x7f46a006fa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-27T10:10:00.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f469e59c700 1 --2- 172.21.15.172:0/4205409342 >> v2:172.21.15.172:3300/0 conn(0x7f46a0165360 0x7f46a006fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f469e59c700 1 -- 172.21.15.172:0/4205409342 >> v1:172.21.15.191:6789/0 conn(0x7f46a01657d0 legacy=0x7f46a006ff50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-27T10:10:00.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f469e59c700 1 -- 172.21.15.172:0/4205409342 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0071990 con 0x7f46a0070b10 2023-03-27T10:10:00.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f2955599700 1 -- 172.21.15.172:0/2178693161 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c033640 con 0x7f2950160fc0 2023-03-27T10:10:00.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f2955599700 1 -- 172.21.15.172:0/2178693161 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c0337a0 con 0x7f2950160fc0 2023-03-27T10:10:00.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f2955599700 1 -- 172.21.15.172:0/2178693161 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c033b30 con 0x7f2950160fc0 2023-03-27T10:10:00.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e1f9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f35dc15a240 0x7f35dc0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e1f9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f35dc15a240 0x7f35dc0d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58216/0 (socket says 172.21.15.172:58216) 2023-03-27T10:10:00.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e1f9b700 1 -- 172.21.15.172:0/4243184266 learned_addr learned my addr 172.21.15.172:0/4243184266 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7f35e279c700 1 --2- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc1604b0 0x7f35dc160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f812e59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f813006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f812e59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f813006c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56086/0 (socket says 172.21.15.172:56086) 2023-03-27T10:10:00.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f812e59c700 1 -- 172.21.15.172:0/502730023 learned_addr learned my addr 172.21.15.172:0/502730023 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:00.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f812ed9d700 1 --2- 172.21.15.172:0/502730023 >> v2:172.21.15.172:3300/0 conn(0x7f81301657d0 0x7f813006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7fe54e7fc700 1 --2- 172.21.15.172:0/1779280214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500cf110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe54000bb00 tx=0x7fe54000be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f38d8b85d6fb98 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:00.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.986+0000 7fd802ffd700 1 --2- 172.21.15.172:0/3222024115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f35e1f9b700 1 -- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc1604b0 msgr2=0x7f35dc160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f35e1f9b700 1 --2- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc1604b0 0x7f35dc160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f35e1f9b700 1 -- 172.21.15.172:0/4243184266 >> v2:172.21.15.172:3300/0 conn(0x7f35dc0d3a30 msgr2=0x7f35dc0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f35e1f9b700 1 --2- 172.21.15.172:0/4243184266 >> v2:172.21.15.172:3300/0 conn(0x7f35dc0d3a30 0x7f35dc0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f35e1f9b700 1 -- 172.21.15.172:0/4243184266 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0d2c70 con 0x7f35dc15a240 2023-03-27T10:10:00.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f469e59c700 1 --2- 172.21.15.172:0/4205409342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a0070b10 0x7f46a006c960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46a00cea90 tx=0x7f4694009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72469e7f2bc144b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:00.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f469d59a700 1 -- 172.21.15.172:0/4205409342 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694004230 con 0x7f46a0070b10 2023-03-27T10:10:00.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f469d59a700 1 -- 172.21.15.172:0/4205409342 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694004390 con 0x7f46a0070b10 2023-03-27T10:10:00.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f469d59a700 1 -- 172.21.15.172:0/4205409342 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940036a0 con 0x7f46a0070b10 2023-03-27T10:10:00.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.985+0000 7f79d3fff700 1 -- start start 2023-03-27T10:10:00.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f79d3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 0x7f79cc0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f79d3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79cc0b2020 0x7f79cc0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:00.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f79d3fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79cc0cf3e0 con 0x7f79cc0d1030 2023-03-27T10:10:00.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f79d3fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0d1470 con 0x7f79cc0b2020 2023-03-27T10:10:00.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f79d3fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0b47f0 con 0x7f79cc0b4420 2023-03-27T10:10:00.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f29587ff700 1 -- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950160fc0 msgr2=0x7f2950164be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:00.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7f29587ff700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950160fc0 0x7f2950164be0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29500cfbd0 tx=0x7f294c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 -- 172.21.15.172:0/2178693161 shutdown_connections 2023-03-27T10:10:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2950165660 0x7f29500ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 --2- 172.21.15.172:0/2178693161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950160fc0 0x7f2950164be0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 --2- 172.21.15.172:0/2178693161 >> v2:172.21.15.172:3300/0 conn(0x7f29500c1d10 0x7f2950165120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 -- 172.21.15.172:0/2178693161 >> 172.21.15.172:0/2178693161 conn(0x7f295006d510 msgr2=0x7f295006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7fd8027fc700 1 -- 172.21.15.172:0/3222024115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 msgr2=0x7fd8040c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:01.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7fd8027fc700 1 --2- 172.21.15.172:0/3222024115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7fd8027fc700 1 -- 172.21.15.172:0/3222024115 >> v2:172.21.15.191:3300/0 conn(0x7fd8040cf280 msgr2=0x7fd8040cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:01.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7fd8027fc700 1 --2- 172.21.15.172:0/3222024115 >> v2:172.21.15.191:3300/0 conn(0x7fd8040cf280 0x7fd8040cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.987+0000 7fd8027fc700 1 -- 172.21.15.172:0/3222024115 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040cdc50 con 0x7fd804159c10 2023-03-27T10:10:01.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 -- 172.21.15.172:0/2178693161 shutdown_connections 2023-03-27T10:10:01.002 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7fd8027fc700 1 --2- 172.21.15.172:0/3222024115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd8040ced40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd80406e3c0 tx=0x7fd7f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0d4c295fd306f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.002 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7fe54dffb700 1 -- 172.21.15.172:0/1779280214 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000dce0 con 0x7fe5500cce10 2023-03-27T10:10:01.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7fe54dffb700 1 -- 172.21.15.172:0/1779280214 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54000de40 con 0x7fe5500cce10 2023-03-27T10:10:01.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7fe54dffb700 1 -- 172.21.15.172:0/1779280214 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540004270 con 0x7fe5500cce10 2023-03-27T10:10:01.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f812e59c700 1 -- 172.21.15.172:0/502730023 >> v2:172.21.15.191:3300/0 conn(0x7f8130165360 msgr2=0x7f813006fa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-27T10:10:01.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f812e59c700 1 --2- 172.21.15.172:0/502730023 >> v2:172.21.15.191:3300/0 conn(0x7f8130165360 0x7f813006fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f812e59c700 1 -- 172.21.15.172:0/502730023 >> v2:172.21.15.172:3300/0 conn(0x7f81301657d0 msgr2=0x7f813006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:01.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f812e59c700 1 --2- 172.21.15.172:0/502730023 >> v2:172.21.15.172:3300/0 conn(0x7f81301657d0 0x7f813006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f812e59c700 1 -- 172.21.15.172:0/502730023 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130070490 con 0x7f8130070b10 2023-03-27T10:10:01.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f46a4dff700 1 -- 172.21.15.172:0/4205409342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a0070b10 msgr2=0x7f46a006c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f46a4dff700 1 --2- 172.21.15.172:0/4205409342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a0070b10 0x7f46a006c960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46a00cea90 tx=0x7f4694009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f46a4dff700 1 -- 172.21.15.172:0/4205409342 shutdown_connections 2023-03-27T10:10:01.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f46a4dff700 1 --2- 172.21.15.172:0/4205409342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a0070b10 0x7f46a006c960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f46a4dff700 1 --2- 172.21.15.172:0/4205409342 >> v2:172.21.15.172:3300/0 conn(0x7f46a0165360 0x7f46a006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f46a4dff700 1 -- 172.21.15.172:0/4205409342 >> 172.21.15.172:0/4205409342 conn(0x7f46a006a1a0 msgr2=0x7f46a006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fe5557ff700 1 -- 172.21.15.172:0/1779280214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 msgr2=0x7fe5500cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1779280214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500cf110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe54000bb00 tx=0x7fe54000be10 comp rx=0 tx=0).stop 2023-03-27T10:10:01.006 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f35e1f9b700 1 --2- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc15a240 0x7f35dc0d0ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0d09b0 tx=0x7f35d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7e964aa17fce0fa server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.006 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d1d9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 0x7f79cc0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.006 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d1d9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 0x7f79cc0cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58220/0 (socket says 172.21.15.172:58220) 2023-03-27T10:10:01.006 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d1d9b700 1 -- 172.21.15.172:0/2046501137 learned_addr learned my addr 172.21.15.172:0/2046501137 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d159a700 1 --2- 172.21.15.172:0/2046501137 >> v2:172.21.15.172:3300/0 conn(0x7f79cc0b2020 0x7f79cc0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.988+0000 7f29587ff700 1 -- 172.21.15.172:0/2178693161 wait complete. 2023-03-27T10:10:01.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f812e59c700 1 --2- 172.21.15.172:0/502730023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f813006c960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f813006db80 tx=0x7f8124009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99c2e52d2dd4cb2 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f812d59a700 1 -- 172.21.15.172:0/502730023 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011830 con 0x7f8130070b10 2023-03-27T10:10:01.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f812d59a700 1 -- 172.21.15.172:0/502730023 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124011990 con 0x7f8130070b10 2023-03-27T10:10:01.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f812d59a700 1 -- 172.21.15.172:0/502730023 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011d20 con 0x7f8130070b10 2023-03-27T10:10:01.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fd801ffb700 1 -- 172.21.15.172:0/3222024115 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011830 con 0x7fd804159c10 2023-03-27T10:10:01.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fd801ffb700 1 -- 172.21.15.172:0/3222024115 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8011990 con 0x7fd804159c10 2023-03-27T10:10:01.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fd801ffb700 1 -- 172.21.15.172:0/3222024115 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011d20 con 0x7fd804159c10 2023-03-27T10:10:01.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 -- 172.21.15.172:0/502730023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 msgr2=0x7f813006c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 --2- 172.21.15.172:0/502730023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f813006c960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f813006db80 tx=0x7f8124009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f46a4dff700 1 -- 172.21.15.172:0/4205409342 shutdown_connections 2023-03-27T10:10:01.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fe5557ff700 1 -- 172.21.15.172:0/1779280214 shutdown_connections 2023-03-27T10:10:01.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1779280214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500cf110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7fe5557ff700 1 -- 172.21.15.172:0/1779280214 >> 172.21.15.172:0/1779280214 conn(0x7fe55006d510 msgr2=0x7fe55006d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f35e0f99700 1 -- 172.21.15.172:0/4243184266 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400e070 con 0x7f35dc15a240 2023-03-27T10:10:01.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f35e0f99700 1 -- 172.21.15.172:0/4243184266 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d400b9c0 con 0x7f35dc15a240 2023-03-27T10:10:01.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f35e0f99700 1 -- 172.21.15.172:0/4243184266 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400bd50 con 0x7f35dc15a240 2023-03-27T10:10:01.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d159a700 1 -- 172.21.15.172:0/2046501137 >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 msgr2=0x7f79cc0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:01.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d159a700 1 --2- 172.21.15.172:0/2046501137 >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 0x7f79cc0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.989+0000 7f79d159a700 1 -- 172.21.15.172:0/2046501137 >> v1:172.21.15.191:6789/0 conn(0x7f79cc0d1030 legacy=0x7f79cc0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f79d159a700 1 -- 172.21.15.172:0/2046501137 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc0ce7d0 con 0x7f79cc0b2020 2023-03-27T10:10:01.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f79d159a700 1 --2- 172.21.15.172:0/2046501137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 0x7f79cc0d0af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79cc08b1a0 tx=0x7f79c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b335cdde55f3232 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f29587ff700 1 Processor -- start 2023-03-27T10:10:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 -- 172.21.15.172:0/502730023 shutdown_connections 2023-03-27T10:10:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 --2- 172.21.15.172:0/502730023 >> v2:172.21.15.172:3300/0 conn(0x7f81301657d0 0x7f813006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 --2- 172.21.15.172:0/502730023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f813006c960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 --2- 172.21.15.172:0/502730023 >> v2:172.21.15.191:3300/0 conn(0x7f8130165360 0x7f813006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f81349ff700 1 -- 172.21.15.172:0/502730023 >> 172.21.15.172:0/502730023 conn(0x7f813006a1a0 msgr2=0x7f813006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.990+0000 7f29587ff700 1 -- start start 2023-03-27T10:10:01.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7fe5557ff700 1 -- 172.21.15.172:0/1779280214 shutdown_connections 2023-03-27T10:10:01.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f46a4dff700 1 -- 172.21.15.172:0/4205409342 wait complete. 2023-03-27T10:10:01.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7fe5557ff700 1 -- 172.21.15.172:0/1779280214 wait complete. 2023-03-27T10:10:01.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7fd8095ff700 1 -- 172.21.15.172:0/3222024115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 msgr2=0x7fd8040ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7fd8095ff700 1 --2- 172.21.15.172:0/3222024115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd8040ced40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd80406e3c0 tx=0x7fd7f8009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:01.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f35e41ff700 1 -- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc15a240 msgr2=0x7f35dc0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f35e41ff700 1 --2- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc15a240 0x7f35dc0d0ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0d09b0 tx=0x7f35d400b330 comp rx=0 tx=0).stop 2023-03-27T10:10:01.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f79d0d99700 1 -- 172.21.15.172:0/2046501137 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400e070 con 0x7f79cc0b2020 2023-03-27T10:10:01.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f79d0d99700 1 -- 172.21.15.172:0/2046501137 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c400bbd0 con 0x7f79cc0b2020 2023-03-27T10:10:01.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f79d0d99700 1 -- 172.21.15.172:0/2046501137 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4012430 con 0x7f79cc0b2020 2023-03-27T10:10:01.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.991+0000 7f79d1d9b700 1 --2- 172.21.15.172:0/2046501137 >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 0x7f79cc0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:01.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 -- 172.21.15.172:0/2046501137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 msgr2=0x7f79cc0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 --2- 172.21.15.172:0/2046501137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 0x7f79cc0d0af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79cc08b1a0 tx=0x7f79c400b330 comp rx=0 tx=0).stop 2023-03-27T10:10:01.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f81349ff700 1 -- 172.21.15.172:0/502730023 shutdown_connections 2023-03-27T10:10:01.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 -- 172.21.15.172:0/2046501137 shutdown_connections 2023-03-27T10:10:01.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 --2- 172.21.15.172:0/2046501137 >> v2:172.21.15.191:3300/0 conn(0x7f79cc0b4420 0x7f79cc0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 --2- 172.21.15.172:0/2046501137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 0x7f79cc0d0af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 -- 172.21.15.172:0/2046501137 >> 172.21.15.172:0/2046501137 conn(0x7f79cc09c260 msgr2=0x7f79cc0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7fd8095ff700 1 -- 172.21.15.172:0/3222024115 shutdown_connections 2023-03-27T10:10:01.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7fd8095ff700 1 --2- 172.21.15.172:0/3222024115 >> v2:172.21.15.191:3300/0 conn(0x7fd8040cf280 0x7fd8040cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7fd8095ff700 1 --2- 172.21.15.172:0/3222024115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7fd8095ff700 1 --2- 172.21.15.172:0/3222024115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd8040ced40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7fd8095ff700 1 -- 172.21.15.172:0/3222024115 >> 172.21.15.172:0/3222024115 conn(0x7fd80406d510 msgr2=0x7fd80406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f79d3fff700 1 -- 172.21.15.172:0/2046501137 shutdown_connections 2023-03-27T10:10:01.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f35e41ff700 1 -- 172.21.15.172:0/4243184266 shutdown_connections 2023-03-27T10:10:01.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f35e41ff700 1 --2- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc1604b0 0x7f35dc160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f35e41ff700 1 --2- 172.21.15.172:0/4243184266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc15a240 0x7f35dc0d0ac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f35e41ff700 1 --2- 172.21.15.172:0/4243184266 >> v2:172.21.15.172:3300/0 conn(0x7f35dc0d3a30 0x7f35dc0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.992+0000 7f35e41ff700 1 -- 172.21.15.172:0/4243184266 >> 172.21.15.172:0/4243184266 conn(0x7f35dc0721f0 msgr2=0x7f35dc09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.993+0000 7f79d3fff700 1 -- 172.21.15.172:0/2046501137 wait complete. 2023-03-27T10:10:01.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.993+0000 7f35e41ff700 1 -- 172.21.15.172:0/4243184266 shutdown_connections 2023-03-27T10:10:01.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.993+0000 7f46a4dff700 1 Processor -- start 2023-03-27T10:10:01.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.993+0000 7f35e41ff700 1 -- 172.21.15.172:0/4243184266 wait complete. 2023-03-27T10:10:01.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.994+0000 7f81349ff700 1 -- 172.21.15.172:0/502730023 wait complete. 2023-03-27T10:10:01.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.994+0000 7f46a4dff700 1 -- start start 2023-03-27T10:10:01.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f46a4dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46a0070b10 0x7f46a00c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f46a4dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46a0165360 0x7f46a0159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f46a4dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 0x7f46a00b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f46a4dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00b4870 con 0x7f46a0070b10 2023-03-27T10:10:01.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f46a4dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a015a9e0 con 0x7f46a00b3e90 2023-03-27T10:10:01.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f46a4dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a015acc0 con 0x7f46a0165360 2023-03-27T10:10:01.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 0x7f46a00b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.994+0000 7fe5557ff700 1 Processor -- start 2023-03-27T10:10:01.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f35e41ff700 1 Processor -- start 2023-03-27T10:10:01.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f79d3fff700 1 Processor -- start 2023-03-27T10:10:01.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.994+0000 7fd8095ff700 1 -- 172.21.15.172:0/3222024115 shutdown_connections 2023-03-27T10:10:01.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7fd8095ff700 1 -- 172.21.15.172:0/3222024115 wait complete. 2023-03-27T10:10:01.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 0x7f46a00b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58224/0 (socket says 172.21.15.172:58224) 2023-03-27T10:10:01.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 -- 172.21.15.172:0/1673040313 learned_addr learned my addr 172.21.15.172:0/1673040313 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.995+0000 7f79d3fff700 1 -- start start 2023-03-27T10:10:01.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.994+0000 7fe5557ff700 1 -- start start 2023-03-27T10:10:01.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 -- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46a0165360 msgr2=0x7f46a0159050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:10:01.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46a0165360 0x7f46a0159050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 -- 172.21.15.172:0/1673040313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46a0070b10 msgr2=0x7f46a00c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46a0070b10 0x7f46a00c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f469ed9d700 1 -- 172.21.15.172:0/1673040313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009550 con 0x7f46a00b3e90 2023-03-27T10:10:01.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f469ed9d700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 0x7f46a00b4330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f469800b960 tx=0x7f469800bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f35e41ff700 1 -- start start 2023-03-27T10:10:01.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc0d3a30 0x7f35dc14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc15a240 0x7f35dc0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f35e41ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc1604b0 0x7f35dc0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f35e41ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c8cf0 con 0x7f35dc1604b0 2023-03-27T10:10:01.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f35e41ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c6aa0 con 0x7f35dc0d3a30 2023-03-27T10:10:01.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f35e41ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c6d80 con 0x7f35dc15a240 2023-03-27T10:10:01.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f79d3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 0x7f79cc15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f79d3fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 0x7f79cc0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f79d3fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79cc0d1030 0x7f79cc06b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f79d3fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc15ca90 con 0x7f79cc0b2020 2023-03-27T10:10:01.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f79d3fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0c71d0 con 0x7f79cc0d1030 2023-03-27T10:10:01.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7f79d3fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0b7620 con 0x7f79cc0b4420 2023-03-27T10:10:01.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.997+0000 7fd8095ff700 1 Processor -- start 2023-03-27T10:10:01.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f79d159a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 0x7f79cc0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f79d259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79cc0d1030 0x7f79cc06b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f35e1f9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc0d3a30 0x7f35dc14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f79d159a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 0x7f79cc0b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56134/0 (socket says 172.21.15.172:56134) 2023-03-27T10:10:01.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f79d159a700 1 -- 172.21.15.172:0/3712077680 learned_addr learned my addr 172.21.15.172:0/3712077680 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7fe5557ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5500c9180 0x7fe5500b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7fe5557ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7fe5557ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5500ced40 0x7fe5501ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7fe5557ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500b4190 con 0x7fe5500c9180 2023-03-27T10:10:01.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f29587ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 0x7f29500c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f29587ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2950160fc0 0x7f29500c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f29587ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950165660 0x7f29500c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f29587ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500b44f0 con 0x7f2950160fc0 2023-03-27T10:10:01.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f29587ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500b38e0 con 0x7f2950165660 2023-03-27T10:10:01.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f29587ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500b3bc0 con 0x7f29500c1d10 2023-03-27T10:10:01.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f81349ff700 1 Processor -- start 2023-03-27T10:10:01.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7f81349ff700 1 -- start start 2023-03-27T10:10:01.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f81349ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f81300c0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f81349ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 0x7f81300ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f81349ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81300cac60 0x7f8130141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f81349ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300cb100 con 0x7f81301441b0 2023-03-27T10:10:01.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f81349ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81300c8cb0 con 0x7f81300cac60 2023-03-27T10:10:01.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f81349ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81300c0fb0 con 0x7f8130070b10 2023-03-27T10:10:01.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7fe5557ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500c50c0 con 0x7fe5500ced40 2023-03-27T10:10:01.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.996+0000 7fe5557ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500b4930 con 0x7fe5500cce10 2023-03-27T10:10:01.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7fe54e7fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7fe54e7fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56124/0 (socket says 172.21.15.172:56124) 2023-03-27T10:10:01.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7fe54e7fc700 1 -- 172.21.15.172:0/1281384294 learned_addr learned my addr 172.21.15.172:0/1281384294 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7fe54effd700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5500c9180 0x7fe5500b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f295659b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 0x7f29500c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f295659b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 0x7f29500c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56162/0 (socket says 172.21.15.172:56162) 2023-03-27T10:10:01.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f295659b700 1 -- 172.21.15.172:0/2916611353 learned_addr learned my addr 172.21.15.172:0/2916611353 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f2956d9c700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950165660 0x7f29500c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7fe54f7fe700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5500ced40 0x7fe5501ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f79d159a700 1 -- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79cc0d1030 msgr2=0x7f79cc06b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f79d159a700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79cc0d1030 0x7f79cc06b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f79d159a700 1 -- 172.21.15.172:0/3712077680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 msgr2=0x7f79cc15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f79d159a700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 0x7f79cc15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f79d159a700 1 -- 172.21.15.172:0/3712077680 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009a70 con 0x7f79cc0b4420 2023-03-27T10:10:01.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f812dd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 0x7f81300ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f812dd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 0x7f81300ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40924/0 (socket says 172.21.15.172:40924) 2023-03-27T10:10:01.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f812dd9b700 1 -- 172.21.15.172:0/966320932 learned_addr learned my addr 172.21.15.172:0/966320932 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800c9b0 con 0x7f46a00b3e90 2023-03-27T10:10:01.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800cb30 con 0x7f46a00b3e90 2023-03-27T10:10:01.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698014440 con 0x7f46a00b3e90 2023-03-27T10:10:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.999+0000 7f2955d9a700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2950160fc0 0x7f29500c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f295659b700 1 -- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950165660 msgr2=0x7f29500c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f295659b700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950165660 0x7f29500c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f295659b700 1 -- 172.21.15.172:0/2916611353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2950160fc0 msgr2=0x7f29500c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f295659b700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2950160fc0 0x7f29500c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f295659b700 1 -- 172.21.15.172:0/2916611353 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009a70 con 0x7f29500c1d10 2023-03-27T10:10:01.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a0070ee0 con 0x7f46a00b3e90 2023-03-27T10:10:01.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a0071c70 con 0x7f46a00b3e90 2023-03-27T10:10:01.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fe54effd700 1 -- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 msgr2=0x7fe5500b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fe54effd700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fe54effd700 1 -- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5500ced40 msgr2=0x7fe5501ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fe54effd700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5500ced40 0x7fe5501ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fe54effd700 1 -- 172.21.15.172:0/1281384294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54000b730 con 0x7fe5500c9180 2023-03-27T10:10:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f35e1f9b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc0d3a30 0x7f35dc14a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:58240/0 (socket says 172.21.15.172:58240) 2023-03-27T10:10:01.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7f35e1f9b700 1 -- 172.21.15.172:0/3772657657 learned_addr learned my addr 172.21.15.172:0/3772657657 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f35e179a700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc15a240 0x7f35dc0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f79d159a700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 0x7f79cc0b6760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79c4014040 tx=0x7f79c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.042 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:00.998+0000 7fd8095ff700 1 -- start start 2023-03-27T10:10:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fd8095ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fd8095ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd80414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fd8095ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd80414cab0 0x7fd8041479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fd8095ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80414d940 con 0x7fd804159c10 2023-03-27T10:10:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fd8095ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040c7ff0 con 0x7fd80414cab0 2023-03-27T10:10:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7fd8095ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040c82d0 con 0x7fd80406dff0 2023-03-27T10:10:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f812ed9d700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81300cac60 0x7f8130141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f295659b700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 0x7f29500c4bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f294c000c00 tx=0x7f294c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f812e59c700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f81300c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.000+0000 7f35e279c700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc1604b0 0x7f35dc0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7fd8027fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd80414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7fd8027fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd80414c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40940/0 (socket says 172.21.15.172:40940) 2023-03-27T10:10:01.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7fd8027fc700 1 -- 172.21.15.172:0/479067631 learned_addr learned my addr 172.21.15.172:0/479067631 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f35e179a700 1 -- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc0d3a30 msgr2=0x7f35dc14a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f35e179a700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc0d3a30 0x7f35dc14a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f35e179a700 1 -- 172.21.15.172:0/3772657657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc1604b0 msgr2=0x7f35dc0b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f35e179a700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc1604b0 0x7f35dc0b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f35e179a700 1 -- 172.21.15.172:0/3772657657 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009b30 con 0x7f35dc15a240 2023-03-27T10:10:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f812dd9b700 1 -- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 msgr2=0x7f81300c0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f812dd9b700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f81300c0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f812dd9b700 1 -- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81300cac60 msgr2=0x7f8130141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f812dd9b700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81300cac60 0x7f8130141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f812dd9b700 1 -- 172.21.15.172:0/966320932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124009550 con 0x7f81301441b0 2023-03-27T10:10:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c033640 con 0x7f29500c1d10 2023-03-27T10:10:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a0071070 con 0x7f46a00b3e90 2023-03-27T10:10:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c0038a0 con 0x7f29500c1d10 2023-03-27T10:10:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c003c50 con 0x7f29500c1d10 2023-03-27T10:10:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7fe54effd700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5500c9180 0x7fe5500b3680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c3e0 tx=0x7fe54400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.001+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c009550 con 0x7f29500c1d10 2023-03-27T10:10:01.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295006c700 con 0x7f29500c1d10 2023-03-27T10:10:01.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fd8027fc700 1 -- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 msgr2=0x7fd8040c5e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:10:01.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fd8027fc700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c5e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fd8027fc700 1 -- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd80414cab0 msgr2=0x7fd8041479a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-27T10:10:01.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fd8027fc700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd80414cab0 0x7fd8041479a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fd8027fc700 1 -- 172.21.15.172:0/479067631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80094a0 con 0x7fd804159c10 2023-03-27T10:10:01.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54400cea0 con 0x7fe5500c9180 2023-03-27T10:10:01.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7f35e179a700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc15a240 0x7f35dc0b2d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b450 tx=0x7f35cc00b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7f812dd9b700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 0x7f81300ca720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f812000b4d0 tx=0x7f812000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011830 con 0x7f35dc15a240 2023-03-27T10:10:01.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc011990 con 0x7f35dc15a240 2023-03-27T10:10:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011d20 con 0x7f35dc15a240 2023-03-27T10:10:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000bea0 con 0x7f81301441b0 2023-03-27T10:10:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120011850 con 0x7f81301441b0 2023-03-27T10:10:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120011c00 con 0x7f81301441b0 2023-03-27T10:10:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295006c420 con 0x7f29500c1d10 2023-03-27T10:10:01.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8130071c70 con 0x7f81301441b0 2023-03-27T10:10:01.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8130071990 con 0x7f81301441b0 2023-03-27T10:10:01.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544005500 con 0x7fe5500c9180 2023-03-27T10:10:01.053 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5440038c0 con 0x7fe5500c9180 2023-03-27T10:10:01.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5500cabc0 con 0x7fe5500c9180 2023-03-27T10:10:01.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5500cdf30 con 0x7fe5500c9180 2023-03-27T10:10:01.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.005+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f469801b030 con 0x7f46a00b3e90 2023-03-27T10:10:01.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.005+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5500cad50 con 0x7fe5500c9180 2023-03-27T10:10:01.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.005+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f294c03c420 con 0x7f29500c1d10 2023-03-27T10:10:01.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.006+0000 7f468effd700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4680066e80 0x7f4680069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.006+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4698084440 con 0x7f46a00b3e90 2023-03-27T10:10:01.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.008+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f46980517b0 con 0x7f46a00b3e90 2023-03-27T10:10:01.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.008+0000 7f469e59c700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4680066e80 0x7f4680069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.006+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0d3230 con 0x7f35dc15a240 2023-03-27T10:10:01.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.006+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc0d2f50 con 0x7f35dc15a240 2023-03-27T10:10:01.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.008+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc0d3510 con 0x7f35dc15a240 2023-03-27T10:10:01.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.002+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4003ea0 con 0x7f79cc0b4420 2023-03-27T10:10:01.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4020070 con 0x7f79cc0b4420 2023-03-27T10:10:01.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.003+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40276c0 con 0x7f79cc0b4420 2023-03-27T10:10:01.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.005+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc0ced90 con 0x7f79cc0b4420 2023-03-27T10:10:01.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.005+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc0ceab0 con 0x7f79cc0b4420 2023-03-27T10:10:01.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.007+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc0cf070 con 0x7f79cc0b4420 2023-03-27T10:10:01.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.010+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f79c4027820 con 0x7f79cc0b4420 2023-03-27T10:10:01.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.007+0000 7f2946ffd700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2934066e80 0x7f2934069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.007+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f294c0a7860 con 0x7f29500c1d10 2023-03-27T10:10:01.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.006+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81140052f0 con 0x7f81301441b0 2023-03-27T10:10:01.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.011+0000 7f469e59c700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4680066e80 0x7f4680069330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c10 tx=0x7f4694010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.011+0000 7fd8027fc700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd80414c570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097c0 tx=0x7fd7f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.011+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f8120021070 con 0x7f81301441b0 2023-03-27T10:10:01.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.012+0000 7f79c27fc700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f79b0066e80 0x7f79b0069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.012+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79c4022070 con 0x7f79cc0b4420 2023-03-27T10:10:01.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.012+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe544019030 con 0x7fe5500c9180 2023-03-27T10:10:01.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.012+0000 7f79d1d9b700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f79b0066e80 0x7f79b0069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.013+0000 7f2955d9a700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2934066e80 0x7f2934069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.013+0000 7f811effd700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8110066f00 0x7f81100693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.013+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f35cc021070 con 0x7f35dc15a240 2023-03-27T10:10:01.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.013+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8120083f50 con 0x7f81301441b0 2023-03-27T10:10:01.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.013+0000 7fe5377fe700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe53c066f00 0x7fe53c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.013+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe544083990 con 0x7fe5500c9180 2023-03-27T10:10:01.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7fe54e7fc700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe53c066f00 0x7fe53c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f294c074ac0 con 0x7f29500c1d10 2023-03-27T10:10:01.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7f2955d9a700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2934066e80 0x7f2934069330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29500710f0 tx=0x7f2940008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7f812e59c700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8110066f00 0x7f81100693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe544054680 con 0x7fe5500c9180 2023-03-27T10:10:01.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7f35d27fc700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f35c0066f00 0x7f35c00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.014+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35cc084670 con 0x7f35dc15a240 2023-03-27T10:10:01.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.015+0000 7fe54e7fc700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe53c066f00 0x7fe53c0693b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe54000ba50 tx=0x7fe54001d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.015+0000 7f35e1f9b700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f35c0066f00 0x7f35c00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.015+0000 7f79d1d9b700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f79b0066e80 0x7f79b0069330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79bc006fd0 tx=0x7f79bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.015+0000 7f812e59c700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8110066f00 0x7f81100693b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8124000c00 tx=0x7f8124008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.017+0000 7f35e1f9b700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f35c0066f00 0x7f35c00693b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009440 tx=0x7f35d4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.018+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f35cc051930 con 0x7f35dc15a240 2023-03-27T10:10:01.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.019+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8004590 con 0x7fd804159c10 2023-03-27T10:10:01.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.019+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f801e070 con 0x7fd804159c10 2023-03-27T10:10:01.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.019+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80038e0 con 0x7fd804159c10 2023-03-27T10:10:01.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.019+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f8120051210 con 0x7f81301441b0 2023-03-27T10:10:01.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.019+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80415a0b0 con 0x7fd804159c10 2023-03-27T10:10:01.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.019+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040cdf30 con 0x7fd804159c10 2023-03-27T10:10:01.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.021+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e40052f0 con 0x7fd804159c10 2023-03-27T10:10:01.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.023+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f79c4053e40 con 0x7f79cc0b4420 2023-03-27T10:10:01.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.022+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd7f800f050 con 0x7fd804159c10 2023-03-27T10:10:01.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.024+0000 7fd7eb7fe700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd7f0066f00 0x7fd7f00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.024+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7f8084c30 con 0x7fd804159c10 2023-03-27T10:10:01.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.027+0000 7fd802ffd700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd7f0066f00 0x7fd7f00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.034+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd7f8051ef0 con 0x7fd804159c10 2023-03-27T10:10:01.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.054+0000 7fd802ffd700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd7f0066f00 0x7fd7f00693b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8040cc440 tx=0x7fd7f4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.285 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.285+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f33d80055a0 con 0x7f33f40c9180 2023-03-27T10:10:01.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.287+0000 7f33e2ffd700 1 -- 172.21.15.172:0/761367354 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33ec0511f0 con 0x7f33f40c9180 2023-03-27T10:10:01.289 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:10:01.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.291+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f33d4066f00 msgr2=0x7f33d40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.291+0000 7f33f89ff700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f33d4066f00 0x7f33d40693b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f33f4156600 tx=0x7f33e8007a40 comp rx=0 tx=0).stop 2023-03-27T10:10:01.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.291+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 msgr2=0x7f33f41f5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.291+0000 7f33f89ff700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 0x7f33f41f5130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007bd0 tx=0x7f33ec007f90 comp rx=0 tx=0).stop 2023-03-27T10:10:01.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 shutdown_connections 2023-03-27T10:10:01.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f33d4066f00 0x7f33d40693b0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f33f4156600 tx=0x7f33e8007a40 comp rx=0 tx=0).stop 2023-03-27T10:10:01.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33f40ced40 0x7f33f40b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f40c9180 0x7f33f41f5130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 --2- 172.21.15.172:0/761367354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33f40cce10 0x7f33f40b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 >> 172.21.15.172:0/761367354 conn(0x7f33f406d510 msgr2=0x7f33f4157080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 shutdown_connections 2023-03-27T10:10:01.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.292+0000 7f33f89ff700 1 -- 172.21.15.172:0/761367354 wait complete. 2023-03-27T10:10:01.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-03-27T10:10:01.321 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.380 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.382+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe55015a2f0 con 0x7fe5500c9180 2023-03-27T10:10:01.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.382+0000 7fe5377fe700 1 -- 172.21.15.172:0/1281384294 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe544054270 con 0x7fe5500c9180 2023-03-27T10:10:01.381 INFO:teuthology.orchestra.run.smithi172.stdout:55834574856 2023-03-27T10:10:01.383 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe53c066f00 msgr2=0x7fe53c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.383 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe53c066f00 0x7fe53c0693b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe54000ba50 tx=0x7fe54001d040 comp rx=0 tx=0).stop 2023-03-27T10:10:01.383 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5500c9180 msgr2=0x7fe5500b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5500c9180 0x7fe5500b3680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c3e0 tx=0x7fe54400c6f0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 shutdown_connections 2023-03-27T10:10:01.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe53c066f00 0x7fe53c0693b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5500ced40 0x7fe5501ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5500c9180 0x7fe5500b3680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 --2- 172.21.15.172:0/1281384294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5500cce10 0x7fe5500b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.385+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 >> 172.21.15.172:0/1281384294 conn(0x7fe55006d510 msgr2=0x7fe550155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.386+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 shutdown_connections 2023-03-27T10:10:01.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.386+0000 7fe5557ff700 1 -- 172.21.15.172:0/1281384294 wait complete. 2023-03-27T10:10:01.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-03-27T10:10:01.404 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.445+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f35dc0c6ec0 con 0x7f35dc15a240 2023-03-27T10:10:01.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.446+0000 7f35d27fc700 1 -- 172.21.15.172:0/3772657657 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35dc0c6ec0 con 0x7f35dc15a240 2023-03-27T10:10:01.445 INFO:teuthology.orchestra.run.smithi172.stdout:60129542152 2023-03-27T10:10:01.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.447+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f29501626b0 con 0x7f29500c1d10 2023-03-27T10:10:01.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.447+0000 7f2946ffd700 1 -- 172.21.15.172:0/2916611353 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f294c037090 con 0x7f29500c1d10 2023-03-27T10:10:01.446 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:10:01.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.449+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f46a0071070 con 0x7f46a00b3e90 2023-03-27T10:10:01.448 INFO:teuthology.orchestra.run.smithi172.stdout:55834574856 2023-03-27T10:10:01.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.449+0000 7f468effd700 1 -- 172.21.15.172:0/1673040313 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4698019020 con 0x7f46a00b3e90 2023-03-27T10:10:01.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f81140055a0 con 0x7f81301441b0 2023-03-27T10:10:01.449 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f35c0066f00 msgr2=0x7f35c00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f35c0066f00 0x7f35c00693b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009440 tx=0x7f35d4009000 comp rx=0 tx=0).stop 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc15a240 msgr2=0x7f35dc0b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc15a240 0x7f35dc0b2d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b450 tx=0x7f35cc00b760 comp rx=0 tx=0).stop 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 shutdown_connections 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35dc1604b0 0x7f35dc0b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f35c0066f00 0x7f35c00693b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35dc0d3a30 0x7f35dc14a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 --2- 172.21.15.172:0/3772657657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35dc15a240 0x7f35dc0b2d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 >> 172.21.15.172:0/3772657657 conn(0x7f35dc0721f0 msgr2=0x7f35dc0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 shutdown_connections 2023-03-27T10:10:01.451 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f35e41ff700 1 -- 172.21.15.172:0/3772657657 wait complete. 2023-03-27T10:10:01.452 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.450+0000 7f811effd700 1 -- 172.21.15.172:0/966320932 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8120015020 con 0x7f81301441b0 2023-03-27T10:10:01.452 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2934066e80 msgr2=0x7f2934069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.452 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2934066e80 0x7f2934069330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29500710f0 tx=0x7f2940008040 comp rx=0 tx=0).stop 2023-03-27T10:10:01.452 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 msgr2=0x7f29500c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.453 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 0x7f29500c4bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f294c000c00 tx=0x7f294c004750 comp rx=0 tx=0).stop 2023-03-27T10:10:01.453 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 shutdown_connections 2023-03-27T10:10:01.453 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2934066e80 0x7f2934069330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.453 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2950165660 0x7f29500c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.453 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f29500c1d10 0x7f29500c4bd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.454 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 --2- 172.21.15.172:0/2916611353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2950160fc0 0x7f29500c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.454 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 >> 172.21.15.172:0/2916611353 conn(0x7f295006d510 msgr2=0x7f2950159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.454 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 shutdown_connections 2023-03-27T10:10:01.454 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.451+0000 7f29587ff700 1 -- 172.21.15.172:0/2916611353 wait complete. 2023-03-27T10:10:01.455 INFO:teuthology.orchestra.run.smithi172.stdout:55834574856 2023-03-27T10:10:01.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.453+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4680066e80 msgr2=0x7f4680069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.453+0000 7f46a4dff700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4680066e80 0x7f4680069330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c10 tx=0x7f4694010000 comp rx=0 tx=0).stop 2023-03-27T10:10:01.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.453+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 msgr2=0x7f46a00b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.453+0000 7f46a4dff700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 0x7f46a00b4330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f469800b960 tx=0x7f469800bd20 comp rx=0 tx=0).stop 2023-03-27T10:10:01.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 shutdown_connections 2023-03-27T10:10:01.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4680066e80 0x7f4680069330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46a00b3e90 0x7f46a00b4330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.457 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46a0070b10 0x7f46a00c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.457 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 --2- 172.21.15.172:0/1673040313 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46a0165360 0x7f46a0159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.457 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 >> 172.21.15.172:0/1673040313 conn(0x7f46a006a1a0 msgr2=0x7f46a00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.457 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 shutdown_connections 2023-03-27T10:10:01.457 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f46a4dff700 1 -- 172.21.15.172:0/1673040313 wait complete. 2023-03-27T10:10:01.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8110066f00 msgr2=0x7f81100693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f81349ff700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8110066f00 0x7f81100693b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8124000c00 tx=0x7f8124008030 comp rx=0 tx=0).stop 2023-03-27T10:10:01.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 msgr2=0x7f81300ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.454+0000 7f81349ff700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 0x7f81300ca720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f812000b4d0 tx=0x7f812000b7e0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 shutdown_connections 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8110066f00 0x7f81100693b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81300cac60 0x7f8130141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8130070b10 0x7f81300c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 --2- 172.21.15.172:0/966320932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81301441b0 0x7f81300ca720 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 >> 172.21.15.172:0/966320932 conn(0x7f813006a1a0 msgr2=0x7f81300b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 shutdown_connections 2023-03-27T10:10:01.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.455+0000 7f81349ff700 1 -- 172.21.15.172:0/966320932 wait complete. 2023-03-27T10:10:01.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.456+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f79cc0c7380 con 0x7f79cc0b4420 2023-03-27T10:10:01.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.457+0000 7f79c27fc700 1 -- 172.21.15.172:0/3712077680 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79c4004930 con 0x7f79cc0b4420 2023-03-27T10:10:01.460 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:10:01.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.463+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f79b0066e80 msgr2=0x7f79b0069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f79b0066e80 0x7f79b0069330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79bc006fd0 tx=0x7f79bc008040 comp rx=0 tx=0).stop 2023-03-27T10:10:01.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 msgr2=0x7f79cc0b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 0x7f79cc0b6760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79c4014040 tx=0x7f79c4004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 shutdown_connections 2023-03-27T10:10:01.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f79b0066e80 0x7f79b0069330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79cc0d1030 0x7f79cc06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79cc0b2020 0x7f79cc15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 --2- 172.21.15.172:0/3712077680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79cc0b4420 0x7f79cc0b6760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 >> 172.21.15.172:0/3712077680 conn(0x7f79cc09c260 msgr2=0x7f79cc06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 shutdown_connections 2023-03-27T10:10:01.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.464+0000 7f79d3fff700 1 -- 172.21.15.172:0/3712077680 wait complete. 2023-03-27T10:10:01.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.465+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd7e40055a0 con 0x7fd804159c10 2023-03-27T10:10:01.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.466+0000 7fd7eb7fe700 1 -- 172.21.15.172:0/479067631 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd7f8020020 con 0x7fd804159c10 2023-03-27T10:10:01.466 INFO:teuthology.orchestra.run.smithi172.stdout:55834574855 2023-03-27T10:10:01.469 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd7f0066f00 msgr2=0x7fd7f00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.469 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd7f0066f00 0x7fd7f00693b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8040cc440 tx=0x7fd7f4009210 comp rx=0 tx=0).stop 2023-03-27T10:10:01.469 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 msgr2=0x7fd80414c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.469 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd80414c570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097c0 tx=0x7fd7f8004750 comp rx=0 tx=0).stop 2023-03-27T10:10:01.470 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 shutdown_connections 2023-03-27T10:10:01.470 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd7f0066f00 0x7fd7f00693b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.470 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd80414cab0 0x7fd8041479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.471 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd80406dff0 0x7fd8040c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.471 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 --2- 172.21.15.172:0/479067631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd804159c10 0x7fd80414c570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.471 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 >> 172.21.15.172:0/479067631 conn(0x7fd80406d510 msgr2=0x7fd804070490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.471 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 shutdown_connections 2023-03-27T10:10:01.471 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.471+0000 7fd8095ff700 1 -- 172.21.15.172:0/479067631 wait complete. 2023-03-27T10:10:01.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-03-27T10:10:01.482 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.2 2023-03-27T10:10:01.483 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-03-27T10:10:01.486 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-03-27T10:10:01.487 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-03-27T10:10:01.490 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-03-27T10:10:01.494 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:01.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-27T10:10:01.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-27T10:10:01.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.719+0000 7f75247ff700 1 Processor -- start 2023-03-27T10:10:01.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.720+0000 7f75247ff700 1 -- start start 2023-03-27T10:10:01.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.720+0000 7f75247ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f751c0d0b90 0x7f751c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f75247ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f751c15ca20 0x7f751c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f75247ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0d14a0 con 0x7f751c0cd610 2023-03-27T10:10:01.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f75247ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0cebc0 con 0x7f751c15ca20 2023-03-27T10:10:01.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f75247ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0ceea0 con 0x7f751c0d0b90 2023-03-27T10:10:01.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521d9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f751c15ca20 0x7f751c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7522d9c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f751c0cd610 0x7f751c0cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53106/0 (socket says 172.21.15.172:53106) 2023-03-27T10:10:01.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521d9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f751c15ca20 0x7f751c0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40942/0 (socket says 172.21.15.172:40942) 2023-03-27T10:10:01.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7522d9c700 1 -- 172.21.15.172:0/3011880020 learned_addr learned my addr 172.21.15.172:0/3011880020 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:01.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f752259b700 1 --2- 172.21.15.172:0/3011880020 >> v2:172.21.15.191:3300/0 conn(0x7f751c0d0b90 0x7f751c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521d9a700 1 -- 172.21.15.172:0/3011880020 >> v2:172.21.15.191:3300/0 conn(0x7f751c0d0b90 msgr2=0x7f751c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:01.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521d9a700 1 --2- 172.21.15.172:0/3011880020 >> v2:172.21.15.191:3300/0 conn(0x7f751c0d0b90 0x7f751c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521d9a700 1 -- 172.21.15.172:0/3011880020 >> v1:172.21.15.172:6789/0 conn(0x7f751c0cd610 legacy=0x7f751c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521d9a700 1 -- 172.21.15.172:0/3011880020 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0cf180 con 0x7f751c15ca20 2023-03-27T10:10:01.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f752259b700 1 --2- 172.21.15.172:0/3011880020 >> v2:172.21.15.191:3300/0 conn(0x7f751c0d0b90 0x7f751c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:01.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.721+0000 7f7521599700 1 -- 172.21.15.172:0/3011880020 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55825823 0 0) 0x7f751c0d14a0 con 0x7f751c0cd610 2023-03-27T10:10:01.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f7521d9a700 1 --2- 172.21.15.172:0/3011880020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c0d0f60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f751c08c260 tx=0x7f750c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412ec141c469aae4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f7521599700 1 -- 172.21.15.172:0/3011880020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011830 con 0x7f751c15ca20 2023-03-27T10:10:01.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f7521599700 1 -- 172.21.15.172:0/3011880020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c011990 con 0x7f751c15ca20 2023-03-27T10:10:01.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f7521599700 1 -- 172.21.15.172:0/3011880020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011d20 con 0x7f751c15ca20 2023-03-27T10:10:01.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 -- 172.21.15.172:0/3011880020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 msgr2=0x7f751c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 --2- 172.21.15.172:0/3011880020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c0d0f60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f751c08c260 tx=0x7f750c009b20 comp rx=0 tx=0).stop 2023-03-27T10:10:01.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 -- 172.21.15.172:0/3011880020 shutdown_connections 2023-03-27T10:10:01.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 --2- 172.21.15.172:0/3011880020 >> v2:172.21.15.191:3300/0 conn(0x7f751c0d0b90 0x7f751c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 --2- 172.21.15.172:0/3011880020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c0d0f60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 -- 172.21.15.172:0/3011880020 >> 172.21.15.172:0/3011880020 conn(0x7f751c0721f0 msgr2=0x7f751c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.722+0000 7f75247ff700 1 -- 172.21.15.172:0/3011880020 shutdown_connections 2023-03-27T10:10:01.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.723+0000 7f75247ff700 1 -- 172.21.15.172:0/3011880020 wait complete. 2023-03-27T10:10:01.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.724+0000 7f75247ff700 1 Processor -- start 2023-03-27T10:10:01.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.724+0000 7f75247ff700 1 -- start start 2023-03-27T10:10:01.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f75247ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f751c0cd610 0x7f751c14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f75247ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f751c0d0b90 0x7f751c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f75247ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c1e6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f75247ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0b41d0 con 0x7f751c15ca20 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f75247ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0b8ee0 con 0x7f751c0cd610 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f75247ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c14d240 con 0x7f751c0d0b90 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.725+0000 7f7522d9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c1e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c1e6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40958/0 (socket says 172.21.15.172:40958) 2023-03-27T10:10:01.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 -- 172.21.15.172:0/3464373399 learned_addr learned my addr 172.21.15.172:0/3464373399 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f752259b700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f751c0cd610 0x7f751c14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7521d9a700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f751c0d0b90 0x7f751c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 -- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f751c0d0b90 msgr2=0x7f751c0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f751c0d0b90 0x7f751c0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 -- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f751c0cd610 msgr2=0x7f751c14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f751c0cd610 0x7f751c14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 -- 172.21.15.172:0/3464373399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0094a0 con 0x7f751c15ca20 2023-03-27T10:10:01.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f752259b700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f751c0cd610 0x7f751c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7521d9a700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f751c0d0b90 0x7f751c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7522d9c700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c1e6980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f751400cb90 tx=0x7f751400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400ab30 con 0x7f751c15ca20 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400ac90 con 0x7f751c15ca20 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140070d0 con 0x7f751c15ca20 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.726+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c0afc50 con 0x7f751c15ca20 2023-03-27T10:10:01.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.727+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c0cf460 con 0x7f751c15ca20 2023-03-27T10:10:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.728+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c0d2d30 con 0x7f751c15ca20 2023-03-27T10:10:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.728+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7514010070 con 0x7f751c15ca20 2023-03-27T10:10:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.729+0000 7f7512ffd700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7500066e30 0x7f75000692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.729+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7514083c30 con 0x7f751c15ca20 2023-03-27T10:10:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.730+0000 7f752259b700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7500066e30 0x7f75000692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:01.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.730+0000 7f752259b700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7500066e30 0x7f75000692e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f75180099f0 tx=0x7f7518008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:01.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.733+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f7514050f00 con 0x7f751c15ca20 2023-03-27T10:10:01.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.919+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 --> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f751c0b4310 con 0x7f7500066e30 2023-03-27T10:10:01.927 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.929+0000 7f7512ffd700 1 -- 172.21.15.172:0/3464373399 <== mgr.4100 v2:172.21.15.191:6832/109700 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286528 (secure 0 0 0) 0x7f751c0b4310 con 0x7f7500066e30 2023-03-27T10:10:01.930 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:01.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7500066e30 msgr2=0x7f75000692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7500066e30 0x7f75000692e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f75180099f0 tx=0x7f7518008040 comp rx=0 tx=0).stop 2023-03-27T10:10:01.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 msgr2=0x7f751c1e6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:01.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c1e6980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f751400cb90 tx=0x7f751400cf50 comp rx=0 tx=0).stop 2023-03-27T10:10:01.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 shutdown_connections 2023-03-27T10:10:01.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f751c15ca20 0x7f751c1e6980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7500066e30 0x7f75000692e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f751c0cd610 0x7f751c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 --2- 172.21.15.172:0/3464373399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f751c0d0b90 0x7f751c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:01.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.932+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 >> 172.21.15.172:0/3464373399 conn(0x7f751c0721f0 msgr2=0x7f751c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:01.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.933+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 shutdown_connections 2023-03-27T10:10:01.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:01.933+0000 7f75247ff700 1 -- 172.21.15.172:0/3464373399 wait complete. 2023-03-27T10:10:01.933 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-03-27T10:10:01.948 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-03-27T10:10:01.279353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66376,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908344,"statfs":{"total":773094113280,"available":773026144256,"internally_reserved":0,"allocated":3284992,"data_stored":1937284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.205613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078386+0000","last_change":"2023-03-27T10:09:52.092982+0000","last_active":"2023-03-27T10:09:53.078386+0000","last_peered":"2023-03-27T10:09:53.078386+0000","last_clean":"2023-03-27T10:09:53.078386+0000","last_became_active":"2023-03-27T10:09:52.092730+0000","last_became_peered":"2023-03-27T10:09:52.092730+0000","last_unstale":"2023-03-27T10:09:53.078386+0000","last_undegraded":"2023-03-27T10:09:53.078386+0000","last_fullsized":"2023-03-27T10:09:53.078386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:47.906298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291625+0000","last_change":"2023-03-27T10:09:52.101670+0000","last_active":"2023-03-27T10:09:53.291625+0000","last_peered":"2023-03-27T10:09:53.291625+0000","last_clean":"2023-03-27T10:09:53.291625+0000","last_became_active":"2023-03-27T10:09:52.101416+0000","last_became_peered":"2023-03-27T10:09:52.101416+0000","last_unstale":"2023-03-27T10:09:53.291625+0000","last_undegraded":"2023-03-27T10:09:53.291625+0000","last_fullsized":"2023-03-27T10:09:53.291625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078062+0000","last_change":"2023-03-27T10:09:52.098166+0000","last_active":"2023-03-27T10:09:53.078062+0000","last_peered":"2023-03-27T10:09:53.078062+0000","last_clean":"2023-03-27T10:09:53.078062+0000","last_became_active":"2023-03-27T10:09:52.097566+0000","last_became_peered":"2023-03-27T10:09:52.097566+0000","last_unstale":"2023-03-27T10:09:53.078062+0000","last_undegraded":"2023-03-27T10:09:53.078062+0000","last_fullsized":"2023-03-27T10:09:53.078062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:17:39.738754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301360+0000","last_change":"2023-03-27T10:09:52.092492+0000","last_active":"2023-03-27T10:09:53.301360+0000","last_peered":"2023-03-27T10:09:53.301360+0000","last_clean":"2023-03-27T10:09:53.301360+0000","last_became_active":"2023-03-27T10:09:52.092129+0000","last_became_peered":"2023-03-27T10:09:52.092129+0000","last_unstale":"2023-03-27T10:09:53.301360+0000","last_undegraded":"2023-03-27T10:09:53.301360+0000","last_fullsized":"2023-03-27T10:09:53.301360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:44.247914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291869+0000","last_change":"2023-03-27T10:09:52.090058+0000","last_active":"2023-03-27T10:09:53.291869+0000","last_peered":"2023-03-27T10:09:53.291869+0000","last_clean":"2023-03-27T10:09:53.291869+0000","last_became_active":"2023-03-27T10:09:52.089732+0000","last_became_peered":"2023-03-27T10:09:52.089732+0000","last_unstale":"2023-03-27T10:09:53.291869+0000","last_undegraded":"2023-03-27T10:09:53.291869+0000","last_fullsized":"2023-03-27T10:09:53.291869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077922+0000","last_change":"2023-03-27T10:09:52.095899+0000","last_active":"2023-03-27T10:09:53.077922+0000","last_peered":"2023-03-27T10:09:53.077922+0000","last_clean":"2023-03-27T10:09:53.077922+0000","last_became_active":"2023-03-27T10:09:52.095619+0000","last_became_peered":"2023-03-27T10:09:52.095619+0000","last_unstale":"2023-03-27T10:09:53.077922+0000","last_undegraded":"2023-03-27T10:09:53.077922+0000","last_fullsized":"2023-03-27T10:09:53.077922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:18:43.652732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298543+0000","last_change":"2023-03-27T10:09:52.097492+0000","last_active":"2023-03-27T10:09:53.298543+0000","last_peered":"2023-03-27T10:09:53.298543+0000","last_clean":"2023-03-27T10:09:53.298543+0000","last_became_active":"2023-03-27T10:09:52.097213+0000","last_became_peered":"2023-03-27T10:09:52.097213+0000","last_unstale":"2023-03-27T10:09:53.298543+0000","last_undegraded":"2023-03-27T10:09:53.298543+0000","last_fullsized":"2023-03-27T10:09:53.298543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291473+0000","last_change":"2023-03-27T10:09:52.103087+0000","last_active":"2023-03-27T10:09:53.291473+0000","last_peered":"2023-03-27T10:09:53.291473+0000","last_clean":"2023-03-27T10:09:53.291473+0000","last_became_active":"2023-03-27T10:09:52.102367+0000","last_became_peered":"2023-03-27T10:09:52.102367+0000","last_unstale":"2023-03-27T10:09:53.291473+0000","last_undegraded":"2023-03-27T10:09:53.291473+0000","last_fullsized":"2023-03-27T10:09:53.291473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292031+0000","last_change":"2023-03-27T10:09:52.096511+0000","last_active":"2023-03-27T10:09:53.292031+0000","last_peered":"2023-03-27T10:09:53.292031+0000","last_clean":"2023-03-27T10:09:53.292031+0000","last_became_active":"2023-03-27T10:09:52.096240+0000","last_became_peered":"2023-03-27T10:09:52.096240+0000","last_unstale":"2023-03-27T10:09:53.292031+0000","last_undegraded":"2023-03-27T10:09:53.292031+0000","last_fullsized":"2023-03-27T10:09:53.292031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291646+0000","last_change":"2023-03-27T10:09:52.089753+0000","last_active":"2023-03-27T10:09:53.291646+0000","last_peered":"2023-03-27T10:09:53.291646+0000","last_clean":"2023-03-27T10:09:53.291646+0000","last_became_active":"2023-03-27T10:09:52.089386+0000","last_became_peered":"2023-03-27T10:09:52.089386+0000","last_unstale":"2023-03-27T10:09:53.291646+0000","last_undegraded":"2023-03-27T10:09:53.291646+0000","last_fullsized":"2023-03-27T10:09:53.291646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078132+0000","last_change":"2023-03-27T10:09:52.099885+0000","last_active":"2023-03-27T10:09:53.078132+0000","last_peered":"2023-03-27T10:09:53.078132+0000","last_clean":"2023-03-27T10:09:53.078132+0000","last_became_active":"2023-03-27T10:09:52.099574+0000","last_became_peered":"2023-03-27T10:09:52.099574+0000","last_unstale":"2023-03-27T10:09:53.078132+0000","last_undegraded":"2023-03-27T10:09:53.078132+0000","last_fullsized":"2023-03-27T10:09:53.078132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:46:07.725303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078388+0000","last_change":"2023-03-27T10:09:52.100207+0000","last_active":"2023-03-27T10:09:53.078388+0000","last_peered":"2023-03-27T10:09:53.078388+0000","last_clean":"2023-03-27T10:09:53.078388+0000","last_became_active":"2023-03-27T10:09:52.099924+0000","last_became_peered":"2023-03-27T10:09:52.099924+0000","last_unstale":"2023-03-27T10:09:53.078388+0000","last_undegraded":"2023-03-27T10:09:53.078388+0000","last_fullsized":"2023-03-27T10:09:53.078388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:49.858973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078147+0000","last_change":"2023-03-27T10:09:52.094046+0000","last_active":"2023-03-27T10:09:53.078147+0000","last_peered":"2023-03-27T10:09:53.078147+0000","last_clean":"2023-03-27T10:09:53.078147+0000","last_became_active":"2023-03-27T10:09:52.093731+0000","last_became_peered":"2023-03-27T10:09:52.093731+0000","last_unstale":"2023-03-27T10:09:53.078147+0000","last_undegraded":"2023-03-27T10:09:53.078147+0000","last_fullsized":"2023-03-27T10:09:53.078147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:28.421519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291507+0000","last_change":"2023-03-27T10:09:52.096296+0000","last_active":"2023-03-27T10:09:53.291507+0000","last_peered":"2023-03-27T10:09:53.291507+0000","last_clean":"2023-03-27T10:09:53.291507+0000","last_became_active":"2023-03-27T10:09:52.095479+0000","last_became_peered":"2023-03-27T10:09:52.095479+0000","last_unstale":"2023-03-27T10:09:53.291507+0000","last_undegraded":"2023-03-27T10:09:53.291507+0000","last_fullsized":"2023-03-27T10:09:53.291507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298567+0000","last_change":"2023-03-27T10:09:52.097616+0000","last_active":"2023-03-27T10:09:53.298567+0000","last_peered":"2023-03-27T10:09:53.298567+0000","last_clean":"2023-03-27T10:09:53.298567+0000","last_became_active":"2023-03-27T10:09:52.097333+0000","last_became_peered":"2023-03-27T10:09:52.097333+0000","last_unstale":"2023-03-27T10:09:53.298567+0000","last_undegraded":"2023-03-27T10:09:53.298567+0000","last_fullsized":"2023-03-27T10:09:53.298567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077882+0000","last_change":"2023-03-27T10:09:52.093782+0000","last_active":"2023-03-27T10:09:53.077882+0000","last_peered":"2023-03-27T10:09:53.077882+0000","last_clean":"2023-03-27T10:09:53.077882+0000","last_became_active":"2023-03-27T10:09:52.093446+0000","last_became_peered":"2023-03-27T10:09:52.093446+0000","last_unstale":"2023-03-27T10:09:53.077882+0000","last_undegraded":"2023-03-27T10:09:53.077882+0000","last_fullsized":"2023-03-27T10:09:53.077882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:24:48.042121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292046+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:53.292046+0000","last_peered":"2023-03-27T10:09:53.292046+0000","last_clean":"2023-03-27T10:09:53.292046+0000","last_became_active":"2023-03-27T10:09:52.089580+0000","last_became_peered":"2023-03-27T10:09:52.089580+0000","last_unstale":"2023-03-27T10:09:53.292046+0000","last_undegraded":"2023-03-27T10:09:53.292046+0000","last_fullsized":"2023-03-27T10:09:53.292046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078431+0000","last_change":"2023-03-27T10:09:52.095466+0000","last_active":"2023-03-27T10:09:53.078431+0000","last_peered":"2023-03-27T10:09:53.078431+0000","last_clean":"2023-03-27T10:09:53.078431+0000","last_became_active":"2023-03-27T10:09:52.094721+0000","last_became_peered":"2023-03-27T10:09:52.094721+0000","last_unstale":"2023-03-27T10:09:53.078431+0000","last_undegraded":"2023-03-27T10:09:53.078431+0000","last_fullsized":"2023-03-27T10:09:53.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078298+0000","last_change":"2023-03-27T10:09:52.093525+0000","last_active":"2023-03-27T10:09:53.078298+0000","last_peered":"2023-03-27T10:09:53.078298+0000","last_clean":"2023-03-27T10:09:53.078298+0000","last_became_active":"2023-03-27T10:09:52.093265+0000","last_became_peered":"2023-03-27T10:09:52.093265+0000","last_unstale":"2023-03-27T10:09:53.078298+0000","last_undegraded":"2023-03-27T10:09:53.078298+0000","last_fullsized":"2023-03-27T10:09:53.078298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:53.392900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078673+0000","last_change":"2023-03-27T10:09:52.099661+0000","last_active":"2023-03-27T10:09:53.078673+0000","last_peered":"2023-03-27T10:09:53.078673+0000","last_clean":"2023-03-27T10:09:53.078673+0000","last_became_active":"2023-03-27T10:09:52.098998+0000","last_became_peered":"2023-03-27T10:09:52.098998+0000","last_unstale":"2023-03-27T10:09:53.078673+0000","last_undegraded":"2023-03-27T10:09:53.078673+0000","last_fullsized":"2023-03-27T10:09:53.078673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:33:36.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298614+0000","last_change":"2023-03-27T10:09:52.090988+0000","last_active":"2023-03-27T10:09:53.298614+0000","last_peered":"2023-03-27T10:09:53.298614+0000","last_clean":"2023-03-27T10:09:53.298614+0000","last_became_active":"2023-03-27T10:09:52.090631+0000","last_became_peered":"2023-03-27T10:09:52.090631+0000","last_unstale":"2023-03-27T10:09:53.298614+0000","last_undegraded":"2023-03-27T10:09:53.298614+0000","last_fullsized":"2023-03-27T10:09:53.298614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291836+0000","last_change":"2023-03-27T10:09:52.098273+0000","last_active":"2023-03-27T10:09:53.291836+0000","last_peered":"2023-03-27T10:09:53.291836+0000","last_clean":"2023-03-27T10:09:53.291836+0000","last_became_active":"2023-03-27T10:09:52.098119+0000","last_became_peered":"2023-03-27T10:09:52.098119+0000","last_unstale":"2023-03-27T10:09:53.291836+0000","last_undegraded":"2023-03-27T10:09:53.291836+0000","last_fullsized":"2023-03-27T10:09:53.291836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076772+0000","last_change":"2023-03-27T10:09:52.095429+0000","last_active":"2023-03-27T10:09:53.076772+0000","last_peered":"2023-03-27T10:09:53.076772+0000","last_clean":"2023-03-27T10:09:53.076772+0000","last_became_active":"2023-03-27T10:09:52.095162+0000","last_became_peered":"2023-03-27T10:09:52.095162+0000","last_unstale":"2023-03-27T10:09:53.076772+0000","last_undegraded":"2023-03-27T10:09:53.076772+0000","last_fullsized":"2023-03-27T10:09:53.076772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298521+0000","last_change":"2023-03-27T10:09:52.088996+0000","last_active":"2023-03-27T10:09:53.298521+0000","last_peered":"2023-03-27T10:09:53.298521+0000","last_clean":"2023-03-27T10:09:53.298521+0000","last_became_active":"2023-03-27T10:09:52.088726+0000","last_became_peered":"2023-03-27T10:09:52.088726+0000","last_unstale":"2023-03-27T10:09:53.298521+0000","last_undegraded":"2023-03-27T10:09:53.298521+0000","last_fullsized":"2023-03-27T10:09:53.298521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302188+0000","last_change":"2023-03-27T10:09:52.109336+0000","last_active":"2023-03-27T10:09:53.302188+0000","last_peered":"2023-03-27T10:09:53.302188+0000","last_clean":"2023-03-27T10:09:53.302188+0000","last_became_active":"2023-03-27T10:09:52.108989+0000","last_became_peered":"2023-03-27T10:09:52.108989+0000","last_unstale":"2023-03-27T10:09:53.302188+0000","last_undegraded":"2023-03-27T10:09:53.302188+0000","last_fullsized":"2023-03-27T10:09:53.302188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302160+0000","last_change":"2023-03-27T10:09:52.098826+0000","last_active":"2023-03-27T10:09:53.302160+0000","last_peered":"2023-03-27T10:09:53.302160+0000","last_clean":"2023-03-27T10:09:53.302160+0000","last_became_active":"2023-03-27T10:09:52.097953+0000","last_became_peered":"2023-03-27T10:09:52.097953+0000","last_unstale":"2023-03-27T10:09:53.302160+0000","last_undegraded":"2023-03-27T10:09:53.302160+0000","last_fullsized":"2023-03-27T10:09:53.302160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291580+0000","last_change":"2023-03-27T10:09:52.104784+0000","last_active":"2023-03-27T10:09:53.291580+0000","last_peered":"2023-03-27T10:09:53.291580+0000","last_clean":"2023-03-27T10:09:53.291580+0000","last_became_active":"2023-03-27T10:09:52.104514+0000","last_became_peered":"2023-03-27T10:09:52.104514+0000","last_unstale":"2023-03-27T10:09:53.291580+0000","last_undegraded":"2023-03-27T10:09:53.291580+0000","last_fullsized":"2023-03-27T10:09:53.291580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078137+0000","last_change":"2023-03-27T10:09:51.616324+0000","last_active":"2023-03-27T10:09:53.078137+0000","last_peered":"2023-03-27T10:09:53.078137+0000","last_clean":"2023-03-27T10:09:53.078137+0000","last_became_active":"2023-03-27T10:09:51.616038+0000","last_became_peered":"2023-03-27T10:09:51.616038+0000","last_unstale":"2023-03-27T10:09:53.078137+0000","last_undegraded":"2023-03-27T10:09:53.078137+0000","last_fullsized":"2023-03-27T10:09:53.078137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:20:38.312045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076796+0000","last_change":"2023-03-27T10:09:52.101349+0000","last_active":"2023-03-27T10:09:53.076796+0000","last_peered":"2023-03-27T10:09:53.076796+0000","last_clean":"2023-03-27T10:09:53.076796+0000","last_became_active":"2023-03-27T10:09:52.101052+0000","last_became_peered":"2023-03-27T10:09:52.101052+0000","last_unstale":"2023-03-27T10:09:53.076796+0000","last_undegraded":"2023-03-27T10:09:53.076796+0000","last_fullsized":"2023-03-27T10:09:53.076796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302096+0000","last_change":"2023-03-27T10:09:51.611795+0000","last_active":"2023-03-27T10:09:53.302096+0000","last_peered":"2023-03-27T10:09:53.302096+0000","last_clean":"2023-03-27T10:09:53.302096+0000","last_became_active":"2023-03-27T10:09:51.611060+0000","last_became_peered":"2023-03-27T10:09:51.611060+0000","last_unstale":"2023-03-27T10:09:53.302096+0000","last_undegraded":"2023-03-27T10:09:53.302096+0000","last_fullsized":"2023-03-27T10:09:53.302096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291956+0000","last_change":"2023-03-27T10:09:52.097761+0000","last_active":"2023-03-27T10:09:53.291956+0000","last_peered":"2023-03-27T10:09:53.291956+0000","last_clean":"2023-03-27T10:09:53.291956+0000","last_became_active":"2023-03-27T10:09:52.097543+0000","last_became_peered":"2023-03-27T10:09:52.097543+0000","last_unstale":"2023-03-27T10:09:53.291956+0000","last_undegraded":"2023-03-27T10:09:53.291956+0000","last_fullsized":"2023-03-27T10:09:53.291956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076491+0000","last_change":"2023-03-27T10:09:51.614621+0000","last_active":"2023-03-27T10:09:53.076491+0000","last_peered":"2023-03-27T10:09:53.076491+0000","last_clean":"2023-03-27T10:09:53.076491+0000","last_became_active":"2023-03-27T10:09:51.613765+0000","last_became_peered":"2023-03-27T10:09:51.613765+0000","last_unstale":"2023-03-27T10:09:53.076491+0000","last_undegraded":"2023-03-27T10:09:53.076491+0000","last_fullsized":"2023-03-27T10:09:53.076491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301435+0000","last_change":"2023-03-27T10:09:52.087655+0000","last_active":"2023-03-27T10:09:53.301435+0000","last_peered":"2023-03-27T10:09:53.301435+0000","last_clean":"2023-03-27T10:09:53.301435+0000","last_became_active":"2023-03-27T10:09:52.087383+0000","last_became_peered":"2023-03-27T10:09:52.087383+0000","last_unstale":"2023-03-27T10:09:53.301435+0000","last_undegraded":"2023-03-27T10:09:53.301435+0000","last_fullsized":"2023-03-27T10:09:53.301435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:15.162076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292062+0000","last_change":"2023-03-27T10:09:51.621560+0000","last_active":"2023-03-27T10:09:53.292062+0000","last_peered":"2023-03-27T10:09:53.292062+0000","last_clean":"2023-03-27T10:09:53.292062+0000","last_became_active":"2023-03-27T10:09:51.621122+0000","last_became_peered":"2023-03-27T10:09:51.621122+0000","last_unstale":"2023-03-27T10:09:53.292062+0000","last_undegraded":"2023-03-27T10:09:53.292062+0000","last_fullsized":"2023-03-27T10:09:53.292062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076407+0000","last_change":"2023-03-27T10:09:52.098575+0000","last_active":"2023-03-27T10:09:53.076407+0000","last_peered":"2023-03-27T10:09:53.076407+0000","last_clean":"2023-03-27T10:09:53.076407+0000","last_became_active":"2023-03-27T10:09:52.097932+0000","last_became_peered":"2023-03-27T10:09:52.097932+0000","last_unstale":"2023-03-27T10:09:53.076407+0000","last_undegraded":"2023-03-27T10:09:53.076407+0000","last_fullsized":"2023-03-27T10:09:53.076407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291636+0000","last_change":"2023-03-27T10:09:51.615898+0000","last_active":"2023-03-27T10:09:53.291636+0000","last_peered":"2023-03-27T10:09:53.291636+0000","last_clean":"2023-03-27T10:09:53.291636+0000","last_became_active":"2023-03-27T10:09:51.614109+0000","last_became_peered":"2023-03-27T10:09:51.614109+0000","last_unstale":"2023-03-27T10:09:53.291636+0000","last_undegraded":"2023-03-27T10:09:53.291636+0000","last_fullsized":"2023-03-27T10:09:53.291636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076484+0000","last_change":"2023-03-27T10:09:52.088791+0000","last_active":"2023-03-27T10:09:53.076484+0000","last_peered":"2023-03-27T10:09:53.076484+0000","last_clean":"2023-03-27T10:09:53.076484+0000","last_became_active":"2023-03-27T10:09:52.088546+0000","last_became_peered":"2023-03-27T10:09:52.088546+0000","last_unstale":"2023-03-27T10:09:53.076484+0000","last_undegraded":"2023-03-27T10:09:53.076484+0000","last_fullsized":"2023-03-27T10:09:53.076484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298625+0000","last_change":"2023-03-27T10:09:51.619965+0000","last_active":"2023-03-27T10:09:53.298625+0000","last_peered":"2023-03-27T10:09:53.298625+0000","last_clean":"2023-03-27T10:09:53.298625+0000","last_became_active":"2023-03-27T10:09:51.619669+0000","last_became_peered":"2023-03-27T10:09:51.619669+0000","last_unstale":"2023-03-27T10:09:53.298625+0000","last_undegraded":"2023-03-27T10:09:53.298625+0000","last_fullsized":"2023-03-27T10:09:53.298625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302106+0000","last_change":"2023-03-27T10:09:52.109249+0000","last_active":"2023-03-27T10:09:53.302106+0000","last_peered":"2023-03-27T10:09:53.302106+0000","last_clean":"2023-03-27T10:09:53.302106+0000","last_became_active":"2023-03-27T10:09:52.108978+0000","last_became_peered":"2023-03-27T10:09:52.108978+0000","last_unstale":"2023-03-27T10:09:53.302106+0000","last_undegraded":"2023-03-27T10:09:53.302106+0000","last_fullsized":"2023-03-27T10:09:53.302106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078791+0000","last_change":"2023-03-27T10:09:51.615701+0000","last_active":"2023-03-27T10:09:53.078791+0000","last_peered":"2023-03-27T10:09:53.078791+0000","last_clean":"2023-03-27T10:09:53.078791+0000","last_became_active":"2023-03-27T10:09:51.615154+0000","last_became_peered":"2023-03-27T10:09:51.615154+0000","last_unstale":"2023-03-27T10:09:53.078791+0000","last_undegraded":"2023-03-27T10:09:53.078791+0000","last_fullsized":"2023-03-27T10:09:53.078791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078630+0000","last_change":"2023-03-27T10:09:52.096016+0000","last_active":"2023-03-27T10:09:53.078630+0000","last_peered":"2023-03-27T10:09:53.078630+0000","last_clean":"2023-03-27T10:09:53.078630+0000","last_became_active":"2023-03-27T10:09:52.095750+0000","last_became_peered":"2023-03-27T10:09:52.095750+0000","last_unstale":"2023-03-27T10:09:53.078630+0000","last_undegraded":"2023-03-27T10:09:53.078630+0000","last_fullsized":"2023-03-27T10:09:53.078630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298601+0000","last_change":"2023-03-27T10:09:51.621889+0000","last_active":"2023-03-27T10:09:53.298601+0000","last_peered":"2023-03-27T10:09:53.298601+0000","last_clean":"2023-03-27T10:09:53.298601+0000","last_became_active":"2023-03-27T10:09:51.621395+0000","last_became_peered":"2023-03-27T10:09:51.621395+0000","last_unstale":"2023-03-27T10:09:53.298601+0000","last_undegraded":"2023-03-27T10:09:53.298601+0000","last_fullsized":"2023-03-27T10:09:53.298601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:24.048712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076636+0000","last_change":"2023-03-27T10:09:52.101533+0000","last_active":"2023-03-27T10:09:53.076636+0000","last_peered":"2023-03-27T10:09:53.076636+0000","last_clean":"2023-03-27T10:09:53.076636+0000","last_became_active":"2023-03-27T10:09:52.101282+0000","last_became_peered":"2023-03-27T10:09:52.101282+0000","last_unstale":"2023-03-27T10:09:53.076636+0000","last_undegraded":"2023-03-27T10:09:53.076636+0000","last_fullsized":"2023-03-27T10:09:53.076636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291818+0000","last_change":"2023-03-27T10:09:51.617855+0000","last_active":"2023-03-27T10:09:53.291818+0000","last_peered":"2023-03-27T10:09:53.291818+0000","last_clean":"2023-03-27T10:09:53.291818+0000","last_became_active":"2023-03-27T10:09:51.617615+0000","last_became_peered":"2023-03-27T10:09:51.617615+0000","last_unstale":"2023-03-27T10:09:53.291818+0000","last_undegraded":"2023-03-27T10:09:53.291818+0000","last_fullsized":"2023-03-27T10:09:53.291818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291591+0000","last_change":"2023-03-27T10:09:52.104706+0000","last_active":"2023-03-27T10:09:53.291591+0000","last_peered":"2023-03-27T10:09:53.291591+0000","last_clean":"2023-03-27T10:09:53.291591+0000","last_became_active":"2023-03-27T10:09:52.104399+0000","last_became_peered":"2023-03-27T10:09:52.104399+0000","last_unstale":"2023-03-27T10:09:53.291591+0000","last_undegraded":"2023-03-27T10:09:53.291591+0000","last_fullsized":"2023-03-27T10:09:53.291591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298555+0000","last_change":"2023-03-27T10:09:51.622460+0000","last_active":"2023-03-27T10:09:53.298555+0000","last_peered":"2023-03-27T10:09:53.298555+0000","last_clean":"2023-03-27T10:09:53.298555+0000","last_became_active":"2023-03-27T10:09:51.622173+0000","last_became_peered":"2023-03-27T10:09:51.622173+0000","last_unstale":"2023-03-27T10:09:53.298555+0000","last_undegraded":"2023-03-27T10:09:53.298555+0000","last_fullsized":"2023-03-27T10:09:53.298555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:52.390198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291940+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:53.291940+0000","last_peered":"2023-03-27T10:09:53.291940+0000","last_clean":"2023-03-27T10:09:53.291940+0000","last_became_active":"2023-03-27T10:09:52.089994+0000","last_became_peered":"2023-03-27T10:09:52.089994+0000","last_unstale":"2023-03-27T10:09:53.291940+0000","last_undegraded":"2023-03-27T10:09:53.291940+0000","last_fullsized":"2023-03-27T10:09:53.291940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301266+0000","last_change":"2023-03-27T10:09:51.617245+0000","last_active":"2023-03-27T10:09:53.301266+0000","last_peered":"2023-03-27T10:09:53.301266+0000","last_clean":"2023-03-27T10:09:53.301266+0000","last_became_active":"2023-03-27T10:09:51.616762+0000","last_became_peered":"2023-03-27T10:09:51.616762+0000","last_unstale":"2023-03-27T10:09:53.301266+0000","last_undegraded":"2023-03-27T10:09:53.301266+0000","last_fullsized":"2023-03-27T10:09:53.301266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076949+0000","last_change":"2023-03-27T10:09:52.095172+0000","last_active":"2023-03-27T10:09:53.076949+0000","last_peered":"2023-03-27T10:09:53.076949+0000","last_clean":"2023-03-27T10:09:53.076949+0000","last_became_active":"2023-03-27T10:09:52.093048+0000","last_became_peered":"2023-03-27T10:09:52.093048+0000","last_unstale":"2023-03-27T10:09:53.076949+0000","last_undegraded":"2023-03-27T10:09:53.076949+0000","last_fullsized":"2023-03-27T10:09:53.076949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298673+0000","last_change":"2023-03-27T10:09:51.622695+0000","last_active":"2023-03-27T10:09:53.298673+0000","last_peered":"2023-03-27T10:09:53.298673+0000","last_clean":"2023-03-27T10:09:53.298673+0000","last_became_active":"2023-03-27T10:09:51.622334+0000","last_became_peered":"2023-03-27T10:09:51.622334+0000","last_unstale":"2023-03-27T10:09:53.298673+0000","last_undegraded":"2023-03-27T10:09:53.298673+0000","last_fullsized":"2023-03-27T10:09:53.298673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:43.245212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291494+0000","last_change":"2023-03-27T10:09:52.103636+0000","last_active":"2023-03-27T10:09:53.291494+0000","last_peered":"2023-03-27T10:09:53.291494+0000","last_clean":"2023-03-27T10:09:53.291494+0000","last_became_active":"2023-03-27T10:09:52.103345+0000","last_became_peered":"2023-03-27T10:09:52.103345+0000","last_unstale":"2023-03-27T10:09:53.291494+0000","last_undegraded":"2023-03-27T10:09:53.291494+0000","last_fullsized":"2023-03-27T10:09:53.291494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298658+0000","last_change":"2023-03-27T10:09:51.621953+0000","last_active":"2023-03-27T10:09:53.298658+0000","last_peered":"2023-03-27T10:09:53.298658+0000","last_clean":"2023-03-27T10:09:53.298658+0000","last_became_active":"2023-03-27T10:09:51.621630+0000","last_became_peered":"2023-03-27T10:09:51.621630+0000","last_unstale":"2023-03-27T10:09:53.298658+0000","last_undegraded":"2023-03-27T10:09:53.298658+0000","last_fullsized":"2023-03-27T10:09:53.298658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077921+0000","last_change":"2023-03-27T10:09:52.101803+0000","last_active":"2023-03-27T10:09:53.077921+0000","last_peered":"2023-03-27T10:09:53.077921+0000","last_clean":"2023-03-27T10:09:53.077921+0000","last_became_active":"2023-03-27T10:09:52.100140+0000","last_became_peered":"2023-03-27T10:09:52.100140+0000","last_unstale":"2023-03-27T10:09:53.077921+0000","last_undegraded":"2023-03-27T10:09:53.077921+0000","last_fullsized":"2023-03-27T10:09:53.077921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:52:48.138618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298646+0000","last_change":"2023-03-27T10:09:51.620614+0000","last_active":"2023-03-27T10:09:53.298646+0000","last_peered":"2023-03-27T10:09:53.298646+0000","last_clean":"2023-03-27T10:09:53.298646+0000","last_became_active":"2023-03-27T10:09:51.620331+0000","last_became_peered":"2023-03-27T10:09:51.620331+0000","last_unstale":"2023-03-27T10:09:53.298646+0000","last_undegraded":"2023-03-27T10:09:53.298646+0000","last_fullsized":"2023-03-27T10:09:53.298646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301343+0000","last_change":"2023-03-27T10:09:52.097480+0000","last_active":"2023-03-27T10:09:53.301343+0000","last_peered":"2023-03-27T10:09:53.301343+0000","last_clean":"2023-03-27T10:09:53.301343+0000","last_became_active":"2023-03-27T10:09:52.097210+0000","last_became_peered":"2023-03-27T10:09:52.097210+0000","last_unstale":"2023-03-27T10:09:53.301343+0000","last_undegraded":"2023-03-27T10:09:53.301343+0000","last_fullsized":"2023-03-27T10:09:53.301343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:53:27.358285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291546+0000","last_change":"2023-03-27T10:09:51.615276+0000","last_active":"2023-03-27T10:09:53.291546+0000","last_peered":"2023-03-27T10:09:53.291546+0000","last_clean":"2023-03-27T10:09:53.291546+0000","last_became_active":"2023-03-27T10:09:51.614739+0000","last_became_peered":"2023-03-27T10:09:51.614739+0000","last_unstale":"2023-03-27T10:09:53.291546+0000","last_undegraded":"2023-03-27T10:09:53.291546+0000","last_fullsized":"2023-03-27T10:09:53.291546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291924+0000","last_change":"2023-03-27T10:09:52.106003+0000","last_active":"2023-03-27T10:09:53.291924+0000","last_peered":"2023-03-27T10:09:53.291924+0000","last_clean":"2023-03-27T10:09:53.291924+0000","last_became_active":"2023-03-27T10:09:52.105235+0000","last_became_peered":"2023-03-27T10:09:52.105235+0000","last_unstale":"2023-03-27T10:09:53.291924+0000","last_undegraded":"2023-03-27T10:09:53.291924+0000","last_fullsized":"2023-03-27T10:09:53.291924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076894+0000","last_change":"2023-03-27T10:09:51.614759+0000","last_active":"2023-03-27T10:09:53.076894+0000","last_peered":"2023-03-27T10:09:53.076894+0000","last_clean":"2023-03-27T10:09:53.076894+0000","last_became_active":"2023-03-27T10:09:51.613946+0000","last_became_peered":"2023-03-27T10:09:51.613946+0000","last_unstale":"2023-03-27T10:09:53.076894+0000","last_undegraded":"2023-03-27T10:09:53.076894+0000","last_fullsized":"2023-03-27T10:09:53.076894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078757+0000","last_change":"2023-03-27T10:09:52.099430+0000","last_active":"2023-03-27T10:09:53.078757+0000","last_peered":"2023-03-27T10:09:53.078757+0000","last_clean":"2023-03-27T10:09:53.078757+0000","last_became_active":"2023-03-27T10:09:52.098704+0000","last_became_peered":"2023-03-27T10:09:52.098704+0000","last_unstale":"2023-03-27T10:09:53.078757+0000","last_undegraded":"2023-03-27T10:09:53.078757+0000","last_fullsized":"2023-03-27T10:09:53.078757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301312+0000","last_change":"2023-03-27T10:09:51.618553+0000","last_active":"2023-03-27T10:09:53.301312+0000","last_peered":"2023-03-27T10:09:53.301312+0000","last_clean":"2023-03-27T10:09:53.301312+0000","last_became_active":"2023-03-27T10:09:51.618221+0000","last_became_peered":"2023-03-27T10:09:51.618221+0000","last_unstale":"2023-03-27T10:09:53.301312+0000","last_undegraded":"2023-03-27T10:09:53.301312+0000","last_fullsized":"2023-03-27T10:09:53.301312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078676+0000","last_change":"2023-03-27T10:09:52.097963+0000","last_active":"2023-03-27T10:09:53.078676+0000","last_peered":"2023-03-27T10:09:53.078676+0000","last_clean":"2023-03-27T10:09:53.078676+0000","last_became_active":"2023-03-27T10:09:52.097246+0000","last_became_peered":"2023-03-27T10:09:52.097246+0000","last_unstale":"2023-03-27T10:09:53.078676+0000","last_undegraded":"2023-03-27T10:09:53.078676+0000","last_fullsized":"2023-03-27T10:09:53.078676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078174+0000","last_change":"2023-03-27T10:09:51.607348+0000","last_active":"2023-03-27T10:09:53.078174+0000","last_peered":"2023-03-27T10:09:53.078174+0000","last_clean":"2023-03-27T10:09:53.078174+0000","last_became_active":"2023-03-27T10:09:51.605922+0000","last_became_peered":"2023-03-27T10:09:51.605922+0000","last_unstale":"2023-03-27T10:09:53.078174+0000","last_undegraded":"2023-03-27T10:09:53.078174+0000","last_fullsized":"2023-03-27T10:09:53.078174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:42:49.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078583+0000","last_change":"2023-03-27T10:09:52.095246+0000","last_active":"2023-03-27T10:09:53.078583+0000","last_peered":"2023-03-27T10:09:53.078583+0000","last_clean":"2023-03-27T10:09:53.078583+0000","last_became_active":"2023-03-27T10:09:52.094368+0000","last_became_peered":"2023-03-27T10:09:52.094368+0000","last_unstale":"2023-03-27T10:09:53.078583+0000","last_undegraded":"2023-03-27T10:09:53.078583+0000","last_fullsized":"2023-03-27T10:09:53.078583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076378+0000","last_change":"2023-03-27T10:09:51.615859+0000","last_active":"2023-03-27T10:09:53.076378+0000","last_peered":"2023-03-27T10:09:53.076378+0000","last_clean":"2023-03-27T10:09:53.076378+0000","last_became_active":"2023-03-27T10:09:51.615589+0000","last_became_peered":"2023-03-27T10:09:51.615589+0000","last_unstale":"2023-03-27T10:09:53.076378+0000","last_undegraded":"2023-03-27T10:09:53.076378+0000","last_fullsized":"2023-03-27T10:09:53.076378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302204+0000","last_change":"2023-03-27T10:09:52.108218+0000","last_active":"2023-03-27T10:09:53.302204+0000","last_peered":"2023-03-27T10:09:53.302204+0000","last_clean":"2023-03-27T10:09:53.302204+0000","last_became_active":"2023-03-27T10:09:52.107884+0000","last_became_peered":"2023-03-27T10:09:52.107884+0000","last_unstale":"2023-03-27T10:09:53.302204+0000","last_undegraded":"2023-03-27T10:09:53.302204+0000","last_fullsized":"2023-03-27T10:09:53.302204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097493+0000","last_change":"2023-03-27T10:09:46.107098+0000","last_active":"2023-03-27T10:09:52.097493+0000","last_peered":"2023-03-27T10:09:52.097493+0000","last_clean":"2023-03-27T10:09:52.097493+0000","last_became_active":"2023-03-27T10:09:46.106831+0000","last_became_peered":"2023-03-27T10:09:46.106831+0000","last_unstale":"2023-03-27T10:09:52.097493+0000","last_undegraded":"2023-03-27T10:09:52.097493+0000","last_fullsized":"2023-03-27T10:09:52.097493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291603+0000","last_change":"2023-03-27T10:09:51.614610+0000","last_active":"2023-03-27T10:09:53.291603+0000","last_peered":"2023-03-27T10:09:53.291603+0000","last_clean":"2023-03-27T10:09:53.291603+0000","last_became_active":"2023-03-27T10:09:51.614320+0000","last_became_peered":"2023-03-27T10:09:51.614320+0000","last_unstale":"2023-03-27T10:09:53.291603+0000","last_undegraded":"2023-03-27T10:09:53.291603+0000","last_fullsized":"2023-03-27T10:09:53.291603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302115+0000","last_change":"2023-03-27T10:09:52.102379+0000","last_active":"2023-03-27T10:09:53.302115+0000","last_peered":"2023-03-27T10:09:53.302115+0000","last_clean":"2023-03-27T10:09:53.302115+0000","last_became_active":"2023-03-27T10:09:52.102073+0000","last_became_peered":"2023-03-27T10:09:52.102073+0000","last_unstale":"2023-03-27T10:09:53.302115+0000","last_undegraded":"2023-03-27T10:09:53.302115+0000","last_fullsized":"2023-03-27T10:09:53.302115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.080707+0000","last_change":"2023-03-27T10:09:46.107305+0000","last_active":"2023-03-27T10:09:52.080707+0000","last_peered":"2023-03-27T10:09:52.080707+0000","last_clean":"2023-03-27T10:09:52.080707+0000","last_became_active":"2023-03-27T10:09:46.107038+0000","last_became_peered":"2023-03-27T10:09:46.107038+0000","last_unstale":"2023-03-27T10:09:52.080707+0000","last_undegraded":"2023-03-27T10:09:52.080707+0000","last_fullsized":"2023-03-27T10:09:52.080707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078493+0000","last_change":"2023-03-27T10:09:51.619230+0000","last_active":"2023-03-27T10:09:53.078493+0000","last_peered":"2023-03-27T10:09:53.078493+0000","last_clean":"2023-03-27T10:09:53.078493+0000","last_became_active":"2023-03-27T10:09:51.618937+0000","last_became_peered":"2023-03-27T10:09:51.618937+0000","last_unstale":"2023-03-27T10:09:53.078493+0000","last_undegraded":"2023-03-27T10:09:53.078493+0000","last_fullsized":"2023-03-27T10:09:53.078493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:22:21.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302143+0000","last_change":"2023-03-27T10:09:52.099004+0000","last_active":"2023-03-27T10:09:53.302143+0000","last_peered":"2023-03-27T10:09:53.302143+0000","last_clean":"2023-03-27T10:09:53.302143+0000","last_became_active":"2023-03-27T10:09:52.098396+0000","last_became_peered":"2023-03-27T10:09:52.098396+0000","last_unstale":"2023-03-27T10:09:53.302143+0000","last_undegraded":"2023-03-27T10:09:53.302143+0000","last_fullsized":"2023-03-27T10:09:53.302143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.076320+0000","last_change":"2023-03-27T10:09:46.326263+0000","last_active":"2023-03-27T10:09:52.076320+0000","last_peered":"2023-03-27T10:09:52.076320+0000","last_clean":"2023-03-27T10:09:52.076320+0000","last_became_active":"2023-03-27T10:09:46.325963+0000","last_became_peered":"2023-03-27T10:09:46.325963+0000","last_unstale":"2023-03-27T10:09:52.076320+0000","last_undegraded":"2023-03-27T10:09:52.076320+0000","last_fullsized":"2023-03-27T10:09:52.076320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302084+0000","last_change":"2023-03-27T10:09:51.614527+0000","last_active":"2023-03-27T10:09:53.302084+0000","last_peered":"2023-03-27T10:09:53.302084+0000","last_clean":"2023-03-27T10:09:53.302084+0000","last_became_active":"2023-03-27T10:09:51.614208+0000","last_became_peered":"2023-03-27T10:09:51.614208+0000","last_unstale":"2023-03-27T10:09:53.302084+0000","last_undegraded":"2023-03-27T10:09:53.302084+0000","last_fullsized":"2023-03-27T10:09:53.302084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302196+0000","last_change":"2023-03-27T10:09:52.096517+0000","last_active":"2023-03-27T10:09:53.302196+0000","last_peered":"2023-03-27T10:09:53.302196+0000","last_clean":"2023-03-27T10:09:53.302196+0000","last_became_active":"2023-03-27T10:09:52.096184+0000","last_became_peered":"2023-03-27T10:09:52.096184+0000","last_unstale":"2023-03-27T10:09:53.302196+0000","last_undegraded":"2023-03-27T10:09:53.302196+0000","last_fullsized":"2023-03-27T10:09:53.302196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.080807+0000","last_change":"2023-03-27T10:09:46.106690+0000","last_active":"2023-03-27T10:09:52.080807+0000","last_peered":"2023-03-27T10:09:52.080807+0000","last_clean":"2023-03-27T10:09:52.080807+0000","last_became_active":"2023-03-27T10:09:46.106393+0000","last_became_peered":"2023-03-27T10:09:46.106393+0000","last_unstale":"2023-03-27T10:09:52.080807+0000","last_undegraded":"2023-03-27T10:09:52.080807+0000","last_fullsized":"2023-03-27T10:09:52.080807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083438+0000","last_change":"2023-03-27T10:09:40.691310+0000","last_active":"2023-03-27T10:09:52.083438+0000","last_peered":"2023-03-27T10:09:52.083438+0000","last_clean":"2023-03-27T10:09:52.083438+0000","last_became_active":"2023-03-27T10:09:40.690248+0000","last_became_peered":"2023-03-27T10:09:40.690248+0000","last_unstale":"2023-03-27T10:09:52.083438+0000","last_undegraded":"2023-03-27T10:09:52.083438+0000","last_fullsized":"2023-03-27T10:09:52.083438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_clean_scrub_stamp":"2023-03-27T10:09:39.335229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:58:29.036302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076523+0000","last_change":"2023-03-27T10:09:51.612759+0000","last_active":"2023-03-27T10:09:53.076523+0000","last_peered":"2023-03-27T10:09:53.076523+0000","last_clean":"2023-03-27T10:09:53.076523+0000","last_became_active":"2023-03-27T10:09:51.612495+0000","last_became_peered":"2023-03-27T10:09:51.612495+0000","last_unstale":"2023-03-27T10:09:53.076523+0000","last_undegraded":"2023-03-27T10:09:53.076523+0000","last_fullsized":"2023-03-27T10:09:53.076523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301379+0000","last_change":"2023-03-27T10:09:52.100115+0000","last_active":"2023-03-27T10:09:53.301379+0000","last_peered":"2023-03-27T10:09:53.301379+0000","last_clean":"2023-03-27T10:09:53.301379+0000","last_became_active":"2023-03-27T10:09:52.099833+0000","last_became_peered":"2023-03-27T10:09:52.099833+0000","last_unstale":"2023-03-27T10:09:53.301379+0000","last_undegraded":"2023-03-27T10:09:53.301379+0000","last_fullsized":"2023-03-27T10:09:53.301379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:02:14.752486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083885+0000","last_change":"2023-03-27T10:09:46.108163+0000","last_active":"2023-03-27T10:09:52.083885+0000","last_peered":"2023-03-27T10:09:52.083885+0000","last_clean":"2023-03-27T10:09:52.083885+0000","last_became_active":"2023-03-27T10:09:46.107807+0000","last_became_peered":"2023-03-27T10:09:46.107807+0000","last_unstale":"2023-03-27T10:09:52.083885+0000","last_undegraded":"2023-03-27T10:09:52.083885+0000","last_fullsized":"2023-03-27T10:09:52.083885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291779+0000","last_change":"2023-03-27T10:09:51.620513+0000","last_active":"2023-03-27T10:09:53.291779+0000","last_peered":"2023-03-27T10:09:53.291779+0000","last_clean":"2023-03-27T10:09:53.291779+0000","last_became_active":"2023-03-27T10:09:51.620285+0000","last_became_peered":"2023-03-27T10:09:51.620285+0000","last_unstale":"2023-03-27T10:09:53.291779+0000","last_undegraded":"2023-03-27T10:09:53.291779+0000","last_fullsized":"2023-03-27T10:09:53.291779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291990+0000","last_change":"2023-03-27T10:09:52.103681+0000","last_active":"2023-03-27T10:09:53.291990+0000","last_peered":"2023-03-27T10:09:53.291990+0000","last_clean":"2023-03-27T10:09:53.291990+0000","last_became_active":"2023-03-27T10:09:52.103419+0000","last_became_peered":"2023-03-27T10:09:52.103419+0000","last_unstale":"2023-03-27T10:09:53.291990+0000","last_undegraded":"2023-03-27T10:09:53.291990+0000","last_fullsized":"2023-03-27T10:09:53.291990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083018+0000","last_change":"2023-03-27T10:09:46.107100+0000","last_active":"2023-03-27T10:09:52.083018+0000","last_peered":"2023-03-27T10:09:52.083018+0000","last_clean":"2023-03-27T10:09:52.083018+0000","last_became_active":"2023-03-27T10:09:46.106766+0000","last_became_peered":"2023-03-27T10:09:46.106766+0000","last_unstale":"2023-03-27T10:09:52.083018+0000","last_undegraded":"2023-03-27T10:09:52.083018+0000","last_fullsized":"2023-03-27T10:09:52.083018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:44:01.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302152+0000","last_change":"2023-03-27T10:09:51.611165+0000","last_active":"2023-03-27T10:09:53.302152+0000","last_peered":"2023-03-27T10:09:53.302152+0000","last_clean":"2023-03-27T10:09:53.302152+0000","last_became_active":"2023-03-27T10:09:51.610854+0000","last_became_peered":"2023-03-27T10:09:51.610854+0000","last_unstale":"2023-03-27T10:09:53.302152+0000","last_undegraded":"2023-03-27T10:09:53.302152+0000","last_fullsized":"2023-03-27T10:09:53.302152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291887+0000","last_change":"2023-03-27T10:09:52.088129+0000","last_active":"2023-03-27T10:09:53.291887+0000","last_peered":"2023-03-27T10:09:53.291887+0000","last_clean":"2023-03-27T10:09:53.291887+0000","last_became_active":"2023-03-27T10:09:52.087826+0000","last_became_peered":"2023-03-27T10:09:52.087826+0000","last_unstale":"2023-03-27T10:09:53.291887+0000","last_undegraded":"2023-03-27T10:09:53.291887+0000","last_fullsized":"2023-03-27T10:09:53.291887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077036+0000","last_change":"2023-03-27T10:09:51.614313+0000","last_active":"2023-03-27T10:09:53.077036+0000","last_peered":"2023-03-27T10:09:53.077036+0000","last_clean":"2023-03-27T10:09:53.077036+0000","last_became_active":"2023-03-27T10:09:51.613995+0000","last_became_peered":"2023-03-27T10:09:51.613995+0000","last_unstale":"2023-03-27T10:09:53.077036+0000","last_undegraded":"2023-03-27T10:09:53.077036+0000","last_fullsized":"2023-03-27T10:09:53.077036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097475+0000","last_change":"2023-03-27T10:09:46.108779+0000","last_active":"2023-03-27T10:09:52.097475+0000","last_peered":"2023-03-27T10:09:52.097475+0000","last_clean":"2023-03-27T10:09:52.097475+0000","last_became_active":"2023-03-27T10:09:46.108307+0000","last_became_peered":"2023-03-27T10:09:46.108307+0000","last_unstale":"2023-03-27T10:09:52.097475+0000","last_undegraded":"2023-03-27T10:09:52.097475+0000","last_fullsized":"2023-03-27T10:09:52.097475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076313+0000","last_change":"2023-03-27T10:09:52.089355+0000","last_active":"2023-03-27T10:09:53.076313+0000","last_peered":"2023-03-27T10:09:53.076313+0000","last_clean":"2023-03-27T10:09:53.076313+0000","last_became_active":"2023-03-27T10:09:52.089075+0000","last_became_peered":"2023-03-27T10:09:52.089075+0000","last_unstale":"2023-03-27T10:09:53.076313+0000","last_undegraded":"2023-03-27T10:09:53.076313+0000","last_fullsized":"2023-03-27T10:09:53.076313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.084381+0000","last_change":"2023-03-27T10:09:46.108791+0000","last_active":"2023-03-27T10:09:52.084381+0000","last_peered":"2023-03-27T10:09:52.084381+0000","last_clean":"2023-03-27T10:09:52.084381+0000","last_became_active":"2023-03-27T10:09:46.108203+0000","last_became_peered":"2023-03-27T10:09:46.108203+0000","last_unstale":"2023-03-27T10:09:52.084381+0000","last_undegraded":"2023-03-27T10:09:52.084381+0000","last_fullsized":"2023-03-27T10:09:52.084381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:54.365595+0000","last_change":"2023-03-27T10:09:51.617246+0000","last_active":"2023-03-27T10:09:54.365595+0000","last_peered":"2023-03-27T10:09:54.365595+0000","last_clean":"2023-03-27T10:09:54.365595+0000","last_became_active":"2023-03-27T10:09:51.616745+0000","last_became_peered":"2023-03-27T10:09:51.616745+0000","last_unstale":"2023-03-27T10:09:54.365595+0000","last_undegraded":"2023-03-27T10:09:54.365595+0000","last_fullsized":"2023-03-27T10:09:54.365595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078179+0000","last_change":"2023-03-27T10:09:52.100091+0000","last_active":"2023-03-27T10:09:53.078179+0000","last_peered":"2023-03-27T10:09:53.078179+0000","last_clean":"2023-03-27T10:09:53.078179+0000","last_became_active":"2023-03-27T10:09:52.099822+0000","last_became_peered":"2023-03-27T10:09:52.099822+0000","last_unstale":"2023-03-27T10:09:53.078179+0000","last_undegraded":"2023-03-27T10:09:53.078179+0000","last_fullsized":"2023-03-27T10:09:53.078179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291905+0000","last_change":"2023-03-27T10:09:51.624415+0000","last_active":"2023-03-27T10:09:53.291905+0000","last_peered":"2023-03-27T10:09:53.291905+0000","last_clean":"2023-03-27T10:09:53.291905+0000","last_became_active":"2023-03-27T10:09:51.624151+0000","last_became_peered":"2023-03-27T10:09:51.624151+0000","last_unstale":"2023-03-27T10:09:53.291905+0000","last_undegraded":"2023-03-27T10:09:53.291905+0000","last_fullsized":"2023-03-27T10:09:53.291905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078453+0000","last_change":"2023-03-27T10:09:52.097854+0000","last_active":"2023-03-27T10:09:53.078453+0000","last_peered":"2023-03-27T10:09:53.078453+0000","last_clean":"2023-03-27T10:09:53.078453+0000","last_became_active":"2023-03-27T10:09:52.097592+0000","last_became_peered":"2023-03-27T10:09:52.097592+0000","last_unstale":"2023-03-27T10:09:53.078453+0000","last_undegraded":"2023-03-27T10:09:53.078453+0000","last_fullsized":"2023-03-27T10:09:53.078453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291535+0000","last_change":"2023-03-27T10:09:51.620648+0000","last_active":"2023-03-27T10:09:53.291535+0000","last_peered":"2023-03-27T10:09:53.291535+0000","last_clean":"2023-03-27T10:09:53.291535+0000","last_became_active":"2023-03-27T10:09:51.620327+0000","last_became_peered":"2023-03-27T10:09:51.620327+0000","last_unstale":"2023-03-27T10:09:53.291535+0000","last_undegraded":"2023-03-27T10:09:53.291535+0000","last_fullsized":"2023-03-27T10:09:53.291535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078428+0000","last_change":"2023-03-27T10:09:52.083060+0000","last_active":"2023-03-27T10:09:53.078428+0000","last_peered":"2023-03-27T10:09:53.078428+0000","last_clean":"2023-03-27T10:09:53.078428+0000","last_became_active":"2023-03-27T10:09:52.082804+0000","last_became_peered":"2023-03-27T10:09:52.082804+0000","last_unstale":"2023-03-27T10:09:53.078428+0000","last_undegraded":"2023-03-27T10:09:53.078428+0000","last_fullsized":"2023-03-27T10:09:53.078428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291615+0000","last_change":"2023-03-27T10:09:51.620593+0000","last_active":"2023-03-27T10:09:53.291615+0000","last_peered":"2023-03-27T10:09:53.291615+0000","last_clean":"2023-03-27T10:09:53.291615+0000","last_became_active":"2023-03-27T10:09:51.620287+0000","last_became_peered":"2023-03-27T10:09:51.620287+0000","last_unstale":"2023-03-27T10:09:53.291615+0000","last_undegraded":"2023-03-27T10:09:53.291615+0000","last_fullsized":"2023-03-27T10:09:53.291615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078402+0000","last_change":"2023-03-27T10:09:52.080606+0000","last_active":"2023-03-27T10:09:53.078402+0000","last_peered":"2023-03-27T10:09:53.078402+0000","last_clean":"2023-03-27T10:09:53.078402+0000","last_became_active":"2023-03-27T10:09:52.080331+0000","last_became_peered":"2023-03-27T10:09:52.080331+0000","last_unstale":"2023-03-27T10:09:53.078402+0000","last_undegraded":"2023-03-27T10:09:53.078402+0000","last_fullsized":"2023-03-27T10:09:53.078402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076857+0000","last_change":"2023-03-27T10:09:51.616366+0000","last_active":"2023-03-27T10:09:53.076857+0000","last_peered":"2023-03-27T10:09:53.076857+0000","last_clean":"2023-03-27T10:09:53.076857+0000","last_became_active":"2023-03-27T10:09:51.615908+0000","last_became_peered":"2023-03-27T10:09:51.615908+0000","last_unstale":"2023-03-27T10:09:53.076857+0000","last_undegraded":"2023-03-27T10:09:53.076857+0000","last_fullsized":"2023-03-27T10:09:53.076857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076487+0000","last_change":"2023-03-27T10:09:52.102730+0000","last_active":"2023-03-27T10:09:53.076487+0000","last_peered":"2023-03-27T10:09:53.076487+0000","last_clean":"2023-03-27T10:09:53.076487+0000","last_became_active":"2023-03-27T10:09:52.102450+0000","last_became_peered":"2023-03-27T10:09:52.102450+0000","last_unstale":"2023-03-27T10:09:53.076487+0000","last_undegraded":"2023-03-27T10:09:53.076487+0000","last_fullsized":"2023-03-27T10:09:53.076487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292078+0000","last_change":"2023-03-27T10:09:51.621408+0000","last_active":"2023-03-27T10:09:53.292078+0000","last_peered":"2023-03-27T10:09:53.292078+0000","last_clean":"2023-03-27T10:09:53.292078+0000","last_became_active":"2023-03-27T10:09:51.620743+0000","last_became_peered":"2023-03-27T10:09:51.620743+0000","last_unstale":"2023-03-27T10:09:53.292078+0000","last_undegraded":"2023-03-27T10:09:53.292078+0000","last_fullsized":"2023-03-27T10:09:53.292078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077753+0000","last_change":"2023-03-27T10:09:52.088963+0000","last_active":"2023-03-27T10:09:53.077753+0000","last_peered":"2023-03-27T10:09:53.077753+0000","last_clean":"2023-03-27T10:09:53.077753+0000","last_became_active":"2023-03-27T10:09:52.088695+0000","last_became_peered":"2023-03-27T10:09:52.088695+0000","last_unstale":"2023-03-27T10:09:53.077753+0000","last_undegraded":"2023-03-27T10:09:53.077753+0000","last_fullsized":"2023-03-27T10:09:53.077753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301293+0000","last_change":"2023-03-27T10:09:52.098801+0000","last_active":"2023-03-27T10:09:53.301293+0000","last_peered":"2023-03-27T10:09:53.301293+0000","last_clean":"2023-03-27T10:09:53.301293+0000","last_became_active":"2023-03-27T10:09:52.098214+0000","last_became_peered":"2023-03-27T10:09:52.098214+0000","last_unstale":"2023-03-27T10:09:53.301293+0000","last_undegraded":"2023-03-27T10:09:53.301293+0000","last_fullsized":"2023-03-27T10:09:53.301293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076365+0000","last_change":"2023-03-27T10:09:52.101353+0000","last_active":"2023-03-27T10:09:53.076365+0000","last_peered":"2023-03-27T10:09:53.076365+0000","last_clean":"2023-03-27T10:09:53.076365+0000","last_became_active":"2023-03-27T10:09:52.101060+0000","last_became_peered":"2023-03-27T10:09:52.101060+0000","last_unstale":"2023-03-27T10:09:53.076365+0000","last_undegraded":"2023-03-27T10:09:53.076365+0000","last_fullsized":"2023-03-27T10:09:53.076365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078027+0000","last_change":"2023-03-27T10:09:52.090063+0000","last_active":"2023-03-27T10:09:53.078027+0000","last_peered":"2023-03-27T10:09:53.078027+0000","last_clean":"2023-03-27T10:09:53.078027+0000","last_became_active":"2023-03-27T10:09:52.089785+0000","last_became_peered":"2023-03-27T10:09:52.089785+0000","last_unstale":"2023-03-27T10:09:53.078027+0000","last_undegraded":"2023-03-27T10:09:53.078027+0000","last_fullsized":"2023-03-27T10:09:53.078027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:23:37.734370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076654+0000","last_change":"2023-03-27T10:09:52.102062+0000","last_active":"2023-03-27T10:09:53.076654+0000","last_peered":"2023-03-27T10:09:53.076654+0000","last_clean":"2023-03-27T10:09:53.076654+0000","last_became_active":"2023-03-27T10:09:52.101762+0000","last_became_peered":"2023-03-27T10:09:52.101762+0000","last_unstale":"2023-03-27T10:09:53.076654+0000","last_undegraded":"2023-03-27T10:09:53.076654+0000","last_fullsized":"2023-03-27T10:09:53.076654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302124+0000","last_change":"2023-03-27T10:09:52.100627+0000","last_active":"2023-03-27T10:09:53.302124+0000","last_peered":"2023-03-27T10:09:53.302124+0000","last_clean":"2023-03-27T10:09:53.302124+0000","last_became_active":"2023-03-27T10:09:52.100237+0000","last_became_peered":"2023-03-27T10:09:52.100237+0000","last_unstale":"2023-03-27T10:09:53.302124+0000","last_undegraded":"2023-03-27T10:09:53.302124+0000","last_fullsized":"2023-03-27T10:09:53.302124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7936,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363904,"statfs":{"total":96636764160,"available":96628637696,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0779999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.133}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":684920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0059999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-27T10:10:01.955 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-27T10:10:02.173 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.175+0000 7f40349ff700 1 Processor -- start 2023-03-27T10:10:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.175+0000 7f40349ff700 1 -- start start 2023-03-27T10:10:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f40349ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f40300d0b90 0x7f40300ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f40349ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f403015ca20 0x7f40300d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f40349ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40300cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f40349ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40300d14a0 con 0x7f403015ca20 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f40349ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40300cebc0 con 0x7f40300d0b90 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f40349ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40300ceea0 con 0x7f40300cd610 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f402dd9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f403015ca20 0x7f40300d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f402dd9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f403015ca20 0x7f40300d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40968/0 (socket says 172.21.15.172:40968) 2023-03-27T10:10:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.176+0000 7f402dd9b700 1 -- 172.21.15.172:0/1235432675 learned_addr learned my addr 172.21.15.172:0/1235432675 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:02.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402e59c700 1 --2- 172.21.15.172:0/1235432675 >> v2:172.21.15.191:3300/0 conn(0x7f40300d0b90 0x7f40300ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402ed9d700 1 --2- 172.21.15.172:0/1235432675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40300cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402dd9b700 1 -- 172.21.15.172:0/1235432675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 msgr2=0x7f40300cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:02.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402dd9b700 1 --2- 172.21.15.172:0/1235432675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40300cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402dd9b700 1 -- 172.21.15.172:0/1235432675 >> v2:172.21.15.191:3300/0 conn(0x7f40300d0b90 msgr2=0x7f40300ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402dd9b700 1 --2- 172.21.15.172:0/1235432675 >> v2:172.21.15.191:3300/0 conn(0x7f40300d0b90 0x7f40300ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402dd9b700 1 -- 172.21.15.172:0/1235432675 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300cf180 con 0x7f403015ca20 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402dd9b700 1 --2- 172.21.15.172:0/1235432675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300d0f60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f403008c260 tx=0x7f4024009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8fe4e58fd0266 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402d59a700 1 -- 172.21.15.172:0/1235432675 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402400b870 con 0x7f403015ca20 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402d59a700 1 -- 172.21.15.172:0/1235432675 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402400b9d0 con 0x7f403015ca20 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.177+0000 7f402d59a700 1 -- 172.21.15.172:0/1235432675 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402400bd60 con 0x7f403015ca20 2023-03-27T10:10:02.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 -- 172.21.15.172:0/1235432675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 msgr2=0x7f40300d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 --2- 172.21.15.172:0/1235432675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300d0f60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f403008c260 tx=0x7f4024009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 -- 172.21.15.172:0/1235432675 shutdown_connections 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 --2- 172.21.15.172:0/1235432675 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40300cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 --2- 172.21.15.172:0/1235432675 >> v2:172.21.15.191:3300/0 conn(0x7f40300d0b90 0x7f40300ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 --2- 172.21.15.172:0/1235432675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300d0f60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 -- 172.21.15.172:0/1235432675 >> 172.21.15.172:0/1235432675 conn(0x7f40300721f0 msgr2=0x7f403009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 -- 172.21.15.172:0/1235432675 shutdown_connections 2023-03-27T10:10:02.179 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.178+0000 7f40349ff700 1 -- 172.21.15.172:0/1235432675 wait complete. 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.180+0000 7f40349ff700 1 Processor -- start 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.180+0000 7f40349ff700 1 -- start start 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f40349ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40301f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f40349ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40300d0b90 0x7f40301f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f40349ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f40349ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b7380 con 0x7f403015ca20 2023-03-27T10:10:02.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f40349ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b37e0 con 0x7f40300d0b90 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f40349ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b3ac0 con 0x7f40300cd610 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40978/0 (socket says 172.21.15.172:40978) 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 -- 172.21.15.172:0/4108301834 learned_addr learned my addr 172.21.15.172:0/4108301834 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402e59c700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40301f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402dd9b700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40300d0b90 0x7f40301f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 -- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 msgr2=0x7f40301f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40301f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 -- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40300d0b90 msgr2=0x7f40301f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40300d0b90 0x7f40301f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.181+0000 7f402ed9d700 1 -- 172.21.15.172:0/4108301834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024009550 con 0x7f403015ca20 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.182+0000 7f402ed9d700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300b6b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4028007e60 tx=0x7f402800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.182+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402800ed30 con 0x7f403015ca20 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.182+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028014420 con 0x7f403015ca20 2023-03-27T10:10:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.182+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40300afc50 con 0x7f403015ca20 2023-03-27T10:10:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.182+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280147d0 con 0x7f403015ca20 2023-03-27T10:10:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.182+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40300cf460 con 0x7f403015ca20 2023-03-27T10:10:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.183+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40300d2d30 con 0x7f403015ca20 2023-03-27T10:10:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.184+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f4028012050 con 0x7f403015ca20 2023-03-27T10:10:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.185+0000 7f401effd700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4010066e30 0x7f40100692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.185+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40280846f0 con 0x7f403015ca20 2023-03-27T10:10:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.185+0000 7f402e59c700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4010066e30 0x7f40100692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.186+0000 7f402e59c700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4010066e30 0x7f40100692e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f403015bd50 tx=0x7f4020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.189+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f4028051a20 con 0x7f403015ca20 2023-03-27T10:10:02.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.376+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 --> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40300b3950 con 0x7f4010066e30 2023-03-27T10:10:02.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.384+0000 7f401effd700 1 -- 172.21.15.172:0/4108301834 <== mgr.4100 v2:172.21.15.191:6832/109700 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286528 (secure 0 0 0) 0x7f40300b3950 con 0x7f4010066e30 2023-03-27T10:10:02.387 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:02.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.388+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4010066e30 msgr2=0x7f40100692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.388+0000 7f40349ff700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4010066e30 0x7f40100692e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f403015bd50 tx=0x7f4020008040 comp rx=0 tx=0).stop 2023-03-27T10:10:02.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.388+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 msgr2=0x7f40300b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.388+0000 7f40349ff700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300b6b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4028007e60 tx=0x7f402800e3c0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 shutdown_connections 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f403015ca20 0x7f40300b6b10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40300cd610 0x7f40301f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4010066e30 0x7f40100692e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 --2- 172.21.15.172:0/4108301834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40300d0b90 0x7f40301f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 >> 172.21.15.172:0/4108301834 conn(0x7f40300721f0 msgr2=0x7f40300cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 shutdown_connections 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.389+0000 7f40349ff700 1 -- 172.21.15.172:0/4108301834 wait complete. 2023-03-27T10:10:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-03-27T10:10:02.404 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-03-27T10:10:01.279353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66376,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908344,"statfs":{"total":773094113280,"available":773026144256,"internally_reserved":0,"allocated":3284992,"data_stored":1937284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.205613"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078386+0000","last_change":"2023-03-27T10:09:52.092982+0000","last_active":"2023-03-27T10:09:53.078386+0000","last_peered":"2023-03-27T10:09:53.078386+0000","last_clean":"2023-03-27T10:09:53.078386+0000","last_became_active":"2023-03-27T10:09:52.092730+0000","last_became_peered":"2023-03-27T10:09:52.092730+0000","last_unstale":"2023-03-27T10:09:53.078386+0000","last_undegraded":"2023-03-27T10:09:53.078386+0000","last_fullsized":"2023-03-27T10:09:53.078386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:47.906298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291625+0000","last_change":"2023-03-27T10:09:52.101670+0000","last_active":"2023-03-27T10:09:53.291625+0000","last_peered":"2023-03-27T10:09:53.291625+0000","last_clean":"2023-03-27T10:09:53.291625+0000","last_became_active":"2023-03-27T10:09:52.101416+0000","last_became_peered":"2023-03-27T10:09:52.101416+0000","last_unstale":"2023-03-27T10:09:53.291625+0000","last_undegraded":"2023-03-27T10:09:53.291625+0000","last_fullsized":"2023-03-27T10:09:53.291625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078062+0000","last_change":"2023-03-27T10:09:52.098166+0000","last_active":"2023-03-27T10:09:53.078062+0000","last_peered":"2023-03-27T10:09:53.078062+0000","last_clean":"2023-03-27T10:09:53.078062+0000","last_became_active":"2023-03-27T10:09:52.097566+0000","last_became_peered":"2023-03-27T10:09:52.097566+0000","last_unstale":"2023-03-27T10:09:53.078062+0000","last_undegraded":"2023-03-27T10:09:53.078062+0000","last_fullsized":"2023-03-27T10:09:53.078062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:17:39.738754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301360+0000","last_change":"2023-03-27T10:09:52.092492+0000","last_active":"2023-03-27T10:09:53.301360+0000","last_peered":"2023-03-27T10:09:53.301360+0000","last_clean":"2023-03-27T10:09:53.301360+0000","last_became_active":"2023-03-27T10:09:52.092129+0000","last_became_peered":"2023-03-27T10:09:52.092129+0000","last_unstale":"2023-03-27T10:09:53.301360+0000","last_undegraded":"2023-03-27T10:09:53.301360+0000","last_fullsized":"2023-03-27T10:09:53.301360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:44.247914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291869+0000","last_change":"2023-03-27T10:09:52.090058+0000","last_active":"2023-03-27T10:09:53.291869+0000","last_peered":"2023-03-27T10:09:53.291869+0000","last_clean":"2023-03-27T10:09:53.291869+0000","last_became_active":"2023-03-27T10:09:52.089732+0000","last_became_peered":"2023-03-27T10:09:52.089732+0000","last_unstale":"2023-03-27T10:09:53.291869+0000","last_undegraded":"2023-03-27T10:09:53.291869+0000","last_fullsized":"2023-03-27T10:09:53.291869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077922+0000","last_change":"2023-03-27T10:09:52.095899+0000","last_active":"2023-03-27T10:09:53.077922+0000","last_peered":"2023-03-27T10:09:53.077922+0000","last_clean":"2023-03-27T10:09:53.077922+0000","last_became_active":"2023-03-27T10:09:52.095619+0000","last_became_peered":"2023-03-27T10:09:52.095619+0000","last_unstale":"2023-03-27T10:09:53.077922+0000","last_undegraded":"2023-03-27T10:09:53.077922+0000","last_fullsized":"2023-03-27T10:09:53.077922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:18:43.652732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298543+0000","last_change":"2023-03-27T10:09:52.097492+0000","last_active":"2023-03-27T10:09:53.298543+0000","last_peered":"2023-03-27T10:09:53.298543+0000","last_clean":"2023-03-27T10:09:53.298543+0000","last_became_active":"2023-03-27T10:09:52.097213+0000","last_became_peered":"2023-03-27T10:09:52.097213+0000","last_unstale":"2023-03-27T10:09:53.298543+0000","last_undegraded":"2023-03-27T10:09:53.298543+0000","last_fullsized":"2023-03-27T10:09:53.298543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291473+0000","last_change":"2023-03-27T10:09:52.103087+0000","last_active":"2023-03-27T10:09:53.291473+0000","last_peered":"2023-03-27T10:09:53.291473+0000","last_clean":"2023-03-27T10:09:53.291473+0000","last_became_active":"2023-03-27T10:09:52.102367+0000","last_became_peered":"2023-03-27T10:09:52.102367+0000","last_unstale":"2023-03-27T10:09:53.291473+0000","last_undegraded":"2023-03-27T10:09:53.291473+0000","last_fullsized":"2023-03-27T10:09:53.291473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292031+0000","last_change":"2023-03-27T10:09:52.096511+0000","last_active":"2023-03-27T10:09:53.292031+0000","last_peered":"2023-03-27T10:09:53.292031+0000","last_clean":"2023-03-27T10:09:53.292031+0000","last_became_active":"2023-03-27T10:09:52.096240+0000","last_became_peered":"2023-03-27T10:09:52.096240+0000","last_unstale":"2023-03-27T10:09:53.292031+0000","last_undegraded":"2023-03-27T10:09:53.292031+0000","last_fullsized":"2023-03-27T10:09:53.292031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291646+0000","last_change":"2023-03-27T10:09:52.089753+0000","last_active":"2023-03-27T10:09:53.291646+0000","last_peered":"2023-03-27T10:09:53.291646+0000","last_clean":"2023-03-27T10:09:53.291646+0000","last_became_active":"2023-03-27T10:09:52.089386+0000","last_became_peered":"2023-03-27T10:09:52.089386+0000","last_unstale":"2023-03-27T10:09:53.291646+0000","last_undegraded":"2023-03-27T10:09:53.291646+0000","last_fullsized":"2023-03-27T10:09:53.291646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078132+0000","last_change":"2023-03-27T10:09:52.099885+0000","last_active":"2023-03-27T10:09:53.078132+0000","last_peered":"2023-03-27T10:09:53.078132+0000","last_clean":"2023-03-27T10:09:53.078132+0000","last_became_active":"2023-03-27T10:09:52.099574+0000","last_became_peered":"2023-03-27T10:09:52.099574+0000","last_unstale":"2023-03-27T10:09:53.078132+0000","last_undegraded":"2023-03-27T10:09:53.078132+0000","last_fullsized":"2023-03-27T10:09:53.078132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:46:07.725303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078388+0000","last_change":"2023-03-27T10:09:52.100207+0000","last_active":"2023-03-27T10:09:53.078388+0000","last_peered":"2023-03-27T10:09:53.078388+0000","last_clean":"2023-03-27T10:09:53.078388+0000","last_became_active":"2023-03-27T10:09:52.099924+0000","last_became_peered":"2023-03-27T10:09:52.099924+0000","last_unstale":"2023-03-27T10:09:53.078388+0000","last_undegraded":"2023-03-27T10:09:53.078388+0000","last_fullsized":"2023-03-27T10:09:53.078388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:49.858973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078147+0000","last_change":"2023-03-27T10:09:52.094046+0000","last_active":"2023-03-27T10:09:53.078147+0000","last_peered":"2023-03-27T10:09:53.078147+0000","last_clean":"2023-03-27T10:09:53.078147+0000","last_became_active":"2023-03-27T10:09:52.093731+0000","last_became_peered":"2023-03-27T10:09:52.093731+0000","last_unstale":"2023-03-27T10:09:53.078147+0000","last_undegraded":"2023-03-27T10:09:53.078147+0000","last_fullsized":"2023-03-27T10:09:53.078147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:28.421519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291507+0000","last_change":"2023-03-27T10:09:52.096296+0000","last_active":"2023-03-27T10:09:53.291507+0000","last_peered":"2023-03-27T10:09:53.291507+0000","last_clean":"2023-03-27T10:09:53.291507+0000","last_became_active":"2023-03-27T10:09:52.095479+0000","last_became_peered":"2023-03-27T10:09:52.095479+0000","last_unstale":"2023-03-27T10:09:53.291507+0000","last_undegraded":"2023-03-27T10:09:53.291507+0000","last_fullsized":"2023-03-27T10:09:53.291507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298567+0000","last_change":"2023-03-27T10:09:52.097616+0000","last_active":"2023-03-27T10:09:53.298567+0000","last_peered":"2023-03-27T10:09:53.298567+0000","last_clean":"2023-03-27T10:09:53.298567+0000","last_became_active":"2023-03-27T10:09:52.097333+0000","last_became_peered":"2023-03-27T10:09:52.097333+0000","last_unstale":"2023-03-27T10:09:53.298567+0000","last_undegraded":"2023-03-27T10:09:53.298567+0000","last_fullsized":"2023-03-27T10:09:53.298567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077882+0000","last_change":"2023-03-27T10:09:52.093782+0000","last_active":"2023-03-27T10:09:53.077882+0000","last_peered":"2023-03-27T10:09:53.077882+0000","last_clean":"2023-03-27T10:09:53.077882+0000","last_became_active":"2023-03-27T10:09:52.093446+0000","last_became_peered":"2023-03-27T10:09:52.093446+0000","last_unstale":"2023-03-27T10:09:53.077882+0000","last_undegraded":"2023-03-27T10:09:53.077882+0000","last_fullsized":"2023-03-27T10:09:53.077882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:24:48.042121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292046+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:53.292046+0000","last_peered":"2023-03-27T10:09:53.292046+0000","last_clean":"2023-03-27T10:09:53.292046+0000","last_became_active":"2023-03-27T10:09:52.089580+0000","last_became_peered":"2023-03-27T10:09:52.089580+0000","last_unstale":"2023-03-27T10:09:53.292046+0000","last_undegraded":"2023-03-27T10:09:53.292046+0000","last_fullsized":"2023-03-27T10:09:53.292046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078431+0000","last_change":"2023-03-27T10:09:52.095466+0000","last_active":"2023-03-27T10:09:53.078431+0000","last_peered":"2023-03-27T10:09:53.078431+0000","last_clean":"2023-03-27T10:09:53.078431+0000","last_became_active":"2023-03-27T10:09:52.094721+0000","last_became_peered":"2023-03-27T10:09:52.094721+0000","last_unstale":"2023-03-27T10:09:53.078431+0000","last_undegraded":"2023-03-27T10:09:53.078431+0000","last_fullsized":"2023-03-27T10:09:53.078431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078298+0000","last_change":"2023-03-27T10:09:52.093525+0000","last_active":"2023-03-27T10:09:53.078298+0000","last_peered":"2023-03-27T10:09:53.078298+0000","last_clean":"2023-03-27T10:09:53.078298+0000","last_became_active":"2023-03-27T10:09:52.093265+0000","last_became_peered":"2023-03-27T10:09:52.093265+0000","last_unstale":"2023-03-27T10:09:53.078298+0000","last_undegraded":"2023-03-27T10:09:53.078298+0000","last_fullsized":"2023-03-27T10:09:53.078298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:53.392900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078673+0000","last_change":"2023-03-27T10:09:52.099661+0000","last_active":"2023-03-27T10:09:53.078673+0000","last_peered":"2023-03-27T10:09:53.078673+0000","last_clean":"2023-03-27T10:09:53.078673+0000","last_became_active":"2023-03-27T10:09:52.098998+0000","last_became_peered":"2023-03-27T10:09:52.098998+0000","last_unstale":"2023-03-27T10:09:53.078673+0000","last_undegraded":"2023-03-27T10:09:53.078673+0000","last_fullsized":"2023-03-27T10:09:53.078673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:33:36.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298614+0000","last_change":"2023-03-27T10:09:52.090988+0000","last_active":"2023-03-27T10:09:53.298614+0000","last_peered":"2023-03-27T10:09:53.298614+0000","last_clean":"2023-03-27T10:09:53.298614+0000","last_became_active":"2023-03-27T10:09:52.090631+0000","last_became_peered":"2023-03-27T10:09:52.090631+0000","last_unstale":"2023-03-27T10:09:53.298614+0000","last_undegraded":"2023-03-27T10:09:53.298614+0000","last_fullsized":"2023-03-27T10:09:53.298614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291836+0000","last_change":"2023-03-27T10:09:52.098273+0000","last_active":"2023-03-27T10:09:53.291836+0000","last_peered":"2023-03-27T10:09:53.291836+0000","last_clean":"2023-03-27T10:09:53.291836+0000","last_became_active":"2023-03-27T10:09:52.098119+0000","last_became_peered":"2023-03-27T10:09:52.098119+0000","last_unstale":"2023-03-27T10:09:53.291836+0000","last_undegraded":"2023-03-27T10:09:53.291836+0000","last_fullsized":"2023-03-27T10:09:53.291836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076772+0000","last_change":"2023-03-27T10:09:52.095429+0000","last_active":"2023-03-27T10:09:53.076772+0000","last_peered":"2023-03-27T10:09:53.076772+0000","last_clean":"2023-03-27T10:09:53.076772+0000","last_became_active":"2023-03-27T10:09:52.095162+0000","last_became_peered":"2023-03-27T10:09:52.095162+0000","last_unstale":"2023-03-27T10:09:53.076772+0000","last_undegraded":"2023-03-27T10:09:53.076772+0000","last_fullsized":"2023-03-27T10:09:53.076772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298521+0000","last_change":"2023-03-27T10:09:52.088996+0000","last_active":"2023-03-27T10:09:53.298521+0000","last_peered":"2023-03-27T10:09:53.298521+0000","last_clean":"2023-03-27T10:09:53.298521+0000","last_became_active":"2023-03-27T10:09:52.088726+0000","last_became_peered":"2023-03-27T10:09:52.088726+0000","last_unstale":"2023-03-27T10:09:53.298521+0000","last_undegraded":"2023-03-27T10:09:53.298521+0000","last_fullsized":"2023-03-27T10:09:53.298521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302188+0000","last_change":"2023-03-27T10:09:52.109336+0000","last_active":"2023-03-27T10:09:53.302188+0000","last_peered":"2023-03-27T10:09:53.302188+0000","last_clean":"2023-03-27T10:09:53.302188+0000","last_became_active":"2023-03-27T10:09:52.108989+0000","last_became_peered":"2023-03-27T10:09:52.108989+0000","last_unstale":"2023-03-27T10:09:53.302188+0000","last_undegraded":"2023-03-27T10:09:53.302188+0000","last_fullsized":"2023-03-27T10:09:53.302188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302160+0000","last_change":"2023-03-27T10:09:52.098826+0000","last_active":"2023-03-27T10:09:53.302160+0000","last_peered":"2023-03-27T10:09:53.302160+0000","last_clean":"2023-03-27T10:09:53.302160+0000","last_became_active":"2023-03-27T10:09:52.097953+0000","last_became_peered":"2023-03-27T10:09:52.097953+0000","last_unstale":"2023-03-27T10:09:53.302160+0000","last_undegraded":"2023-03-27T10:09:53.302160+0000","last_fullsized":"2023-03-27T10:09:53.302160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291580+0000","last_change":"2023-03-27T10:09:52.104784+0000","last_active":"2023-03-27T10:09:53.291580+0000","last_peered":"2023-03-27T10:09:53.291580+0000","last_clean":"2023-03-27T10:09:53.291580+0000","last_became_active":"2023-03-27T10:09:52.104514+0000","last_became_peered":"2023-03-27T10:09:52.104514+0000","last_unstale":"2023-03-27T10:09:53.291580+0000","last_undegraded":"2023-03-27T10:09:53.291580+0000","last_fullsized":"2023-03-27T10:09:53.291580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078137+0000","last_change":"2023-03-27T10:09:51.616324+0000","last_active":"2023-03-27T10:09:53.078137+0000","last_peered":"2023-03-27T10:09:53.078137+0000","last_clean":"2023-03-27T10:09:53.078137+0000","last_became_active":"2023-03-27T10:09:51.616038+0000","last_became_peered":"2023-03-27T10:09:51.616038+0000","last_unstale":"2023-03-27T10:09:53.078137+0000","last_undegraded":"2023-03-27T10:09:53.078137+0000","last_fullsized":"2023-03-27T10:09:53.078137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:20:38.312045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076796+0000","last_change":"2023-03-27T10:09:52.101349+0000","last_active":"2023-03-27T10:09:53.076796+0000","last_peered":"2023-03-27T10:09:53.076796+0000","last_clean":"2023-03-27T10:09:53.076796+0000","last_became_active":"2023-03-27T10:09:52.101052+0000","last_became_peered":"2023-03-27T10:09:52.101052+0000","last_unstale":"2023-03-27T10:09:53.076796+0000","last_undegraded":"2023-03-27T10:09:53.076796+0000","last_fullsized":"2023-03-27T10:09:53.076796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302096+0000","last_change":"2023-03-27T10:09:51.611795+0000","last_active":"2023-03-27T10:09:53.302096+0000","last_peered":"2023-03-27T10:09:53.302096+0000","last_clean":"2023-03-27T10:09:53.302096+0000","last_became_active":"2023-03-27T10:09:51.611060+0000","last_became_peered":"2023-03-27T10:09:51.611060+0000","last_unstale":"2023-03-27T10:09:53.302096+0000","last_undegraded":"2023-03-27T10:09:53.302096+0000","last_fullsized":"2023-03-27T10:09:53.302096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291956+0000","last_change":"2023-03-27T10:09:52.097761+0000","last_active":"2023-03-27T10:09:53.291956+0000","last_peered":"2023-03-27T10:09:53.291956+0000","last_clean":"2023-03-27T10:09:53.291956+0000","last_became_active":"2023-03-27T10:09:52.097543+0000","last_became_peered":"2023-03-27T10:09:52.097543+0000","last_unstale":"2023-03-27T10:09:53.291956+0000","last_undegraded":"2023-03-27T10:09:53.291956+0000","last_fullsized":"2023-03-27T10:09:53.291956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076491+0000","last_change":"2023-03-27T10:09:51.614621+0000","last_active":"2023-03-27T10:09:53.076491+0000","last_peered":"2023-03-27T10:09:53.076491+0000","last_clean":"2023-03-27T10:09:53.076491+0000","last_became_active":"2023-03-27T10:09:51.613765+0000","last_became_peered":"2023-03-27T10:09:51.613765+0000","last_unstale":"2023-03-27T10:09:53.076491+0000","last_undegraded":"2023-03-27T10:09:53.076491+0000","last_fullsized":"2023-03-27T10:09:53.076491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301435+0000","last_change":"2023-03-27T10:09:52.087655+0000","last_active":"2023-03-27T10:09:53.301435+0000","last_peered":"2023-03-27T10:09:53.301435+0000","last_clean":"2023-03-27T10:09:53.301435+0000","last_became_active":"2023-03-27T10:09:52.087383+0000","last_became_peered":"2023-03-27T10:09:52.087383+0000","last_unstale":"2023-03-27T10:09:53.301435+0000","last_undegraded":"2023-03-27T10:09:53.301435+0000","last_fullsized":"2023-03-27T10:09:53.301435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:15.162076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292062+0000","last_change":"2023-03-27T10:09:51.621560+0000","last_active":"2023-03-27T10:09:53.292062+0000","last_peered":"2023-03-27T10:09:53.292062+0000","last_clean":"2023-03-27T10:09:53.292062+0000","last_became_active":"2023-03-27T10:09:51.621122+0000","last_became_peered":"2023-03-27T10:09:51.621122+0000","last_unstale":"2023-03-27T10:09:53.292062+0000","last_undegraded":"2023-03-27T10:09:53.292062+0000","last_fullsized":"2023-03-27T10:09:53.292062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076407+0000","last_change":"2023-03-27T10:09:52.098575+0000","last_active":"2023-03-27T10:09:53.076407+0000","last_peered":"2023-03-27T10:09:53.076407+0000","last_clean":"2023-03-27T10:09:53.076407+0000","last_became_active":"2023-03-27T10:09:52.097932+0000","last_became_peered":"2023-03-27T10:09:52.097932+0000","last_unstale":"2023-03-27T10:09:53.076407+0000","last_undegraded":"2023-03-27T10:09:53.076407+0000","last_fullsized":"2023-03-27T10:09:53.076407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291636+0000","last_change":"2023-03-27T10:09:51.615898+0000","last_active":"2023-03-27T10:09:53.291636+0000","last_peered":"2023-03-27T10:09:53.291636+0000","last_clean":"2023-03-27T10:09:53.291636+0000","last_became_active":"2023-03-27T10:09:51.614109+0000","last_became_peered":"2023-03-27T10:09:51.614109+0000","last_unstale":"2023-03-27T10:09:53.291636+0000","last_undegraded":"2023-03-27T10:09:53.291636+0000","last_fullsized":"2023-03-27T10:09:53.291636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076484+0000","last_change":"2023-03-27T10:09:52.088791+0000","last_active":"2023-03-27T10:09:53.076484+0000","last_peered":"2023-03-27T10:09:53.076484+0000","last_clean":"2023-03-27T10:09:53.076484+0000","last_became_active":"2023-03-27T10:09:52.088546+0000","last_became_peered":"2023-03-27T10:09:52.088546+0000","last_unstale":"2023-03-27T10:09:53.076484+0000","last_undegraded":"2023-03-27T10:09:53.076484+0000","last_fullsized":"2023-03-27T10:09:53.076484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298625+0000","last_change":"2023-03-27T10:09:51.619965+0000","last_active":"2023-03-27T10:09:53.298625+0000","last_peered":"2023-03-27T10:09:53.298625+0000","last_clean":"2023-03-27T10:09:53.298625+0000","last_became_active":"2023-03-27T10:09:51.619669+0000","last_became_peered":"2023-03-27T10:09:51.619669+0000","last_unstale":"2023-03-27T10:09:53.298625+0000","last_undegraded":"2023-03-27T10:09:53.298625+0000","last_fullsized":"2023-03-27T10:09:53.298625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302106+0000","last_change":"2023-03-27T10:09:52.109249+0000","last_active":"2023-03-27T10:09:53.302106+0000","last_peered":"2023-03-27T10:09:53.302106+0000","last_clean":"2023-03-27T10:09:53.302106+0000","last_became_active":"2023-03-27T10:09:52.108978+0000","last_became_peered":"2023-03-27T10:09:52.108978+0000","last_unstale":"2023-03-27T10:09:53.302106+0000","last_undegraded":"2023-03-27T10:09:53.302106+0000","last_fullsized":"2023-03-27T10:09:53.302106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078791+0000","last_change":"2023-03-27T10:09:51.615701+0000","last_active":"2023-03-27T10:09:53.078791+0000","last_peered":"2023-03-27T10:09:53.078791+0000","last_clean":"2023-03-27T10:09:53.078791+0000","last_became_active":"2023-03-27T10:09:51.615154+0000","last_became_peered":"2023-03-27T10:09:51.615154+0000","last_unstale":"2023-03-27T10:09:53.078791+0000","last_undegraded":"2023-03-27T10:09:53.078791+0000","last_fullsized":"2023-03-27T10:09:53.078791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078630+0000","last_change":"2023-03-27T10:09:52.096016+0000","last_active":"2023-03-27T10:09:53.078630+0000","last_peered":"2023-03-27T10:09:53.078630+0000","last_clean":"2023-03-27T10:09:53.078630+0000","last_became_active":"2023-03-27T10:09:52.095750+0000","last_became_peered":"2023-03-27T10:09:52.095750+0000","last_unstale":"2023-03-27T10:09:53.078630+0000","last_undegraded":"2023-03-27T10:09:53.078630+0000","last_fullsized":"2023-03-27T10:09:53.078630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298601+0000","last_change":"2023-03-27T10:09:51.621889+0000","last_active":"2023-03-27T10:09:53.298601+0000","last_peered":"2023-03-27T10:09:53.298601+0000","last_clean":"2023-03-27T10:09:53.298601+0000","last_became_active":"2023-03-27T10:09:51.621395+0000","last_became_peered":"2023-03-27T10:09:51.621395+0000","last_unstale":"2023-03-27T10:09:53.298601+0000","last_undegraded":"2023-03-27T10:09:53.298601+0000","last_fullsized":"2023-03-27T10:09:53.298601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:24.048712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076636+0000","last_change":"2023-03-27T10:09:52.101533+0000","last_active":"2023-03-27T10:09:53.076636+0000","last_peered":"2023-03-27T10:09:53.076636+0000","last_clean":"2023-03-27T10:09:53.076636+0000","last_became_active":"2023-03-27T10:09:52.101282+0000","last_became_peered":"2023-03-27T10:09:52.101282+0000","last_unstale":"2023-03-27T10:09:53.076636+0000","last_undegraded":"2023-03-27T10:09:53.076636+0000","last_fullsized":"2023-03-27T10:09:53.076636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:26:16.200422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291818+0000","last_change":"2023-03-27T10:09:51.617855+0000","last_active":"2023-03-27T10:09:53.291818+0000","last_peered":"2023-03-27T10:09:53.291818+0000","last_clean":"2023-03-27T10:09:53.291818+0000","last_became_active":"2023-03-27T10:09:51.617615+0000","last_became_peered":"2023-03-27T10:09:51.617615+0000","last_unstale":"2023-03-27T10:09:53.291818+0000","last_undegraded":"2023-03-27T10:09:53.291818+0000","last_fullsized":"2023-03-27T10:09:53.291818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291591+0000","last_change":"2023-03-27T10:09:52.104706+0000","last_active":"2023-03-27T10:09:53.291591+0000","last_peered":"2023-03-27T10:09:53.291591+0000","last_clean":"2023-03-27T10:09:53.291591+0000","last_became_active":"2023-03-27T10:09:52.104399+0000","last_became_peered":"2023-03-27T10:09:52.104399+0000","last_unstale":"2023-03-27T10:09:53.291591+0000","last_undegraded":"2023-03-27T10:09:53.291591+0000","last_fullsized":"2023-03-27T10:09:53.291591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298555+0000","last_change":"2023-03-27T10:09:51.622460+0000","last_active":"2023-03-27T10:09:53.298555+0000","last_peered":"2023-03-27T10:09:53.298555+0000","last_clean":"2023-03-27T10:09:53.298555+0000","last_became_active":"2023-03-27T10:09:51.622173+0000","last_became_peered":"2023-03-27T10:09:51.622173+0000","last_unstale":"2023-03-27T10:09:53.298555+0000","last_undegraded":"2023-03-27T10:09:53.298555+0000","last_fullsized":"2023-03-27T10:09:53.298555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:25:52.390198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291940+0000","last_change":"2023-03-27T10:09:52.090285+0000","last_active":"2023-03-27T10:09:53.291940+0000","last_peered":"2023-03-27T10:09:53.291940+0000","last_clean":"2023-03-27T10:09:53.291940+0000","last_became_active":"2023-03-27T10:09:52.089994+0000","last_became_peered":"2023-03-27T10:09:52.089994+0000","last_unstale":"2023-03-27T10:09:53.291940+0000","last_undegraded":"2023-03-27T10:09:53.291940+0000","last_fullsized":"2023-03-27T10:09:53.291940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301266+0000","last_change":"2023-03-27T10:09:51.617245+0000","last_active":"2023-03-27T10:09:53.301266+0000","last_peered":"2023-03-27T10:09:53.301266+0000","last_clean":"2023-03-27T10:09:53.301266+0000","last_became_active":"2023-03-27T10:09:51.616762+0000","last_became_peered":"2023-03-27T10:09:51.616762+0000","last_unstale":"2023-03-27T10:09:53.301266+0000","last_undegraded":"2023-03-27T10:09:53.301266+0000","last_fullsized":"2023-03-27T10:09:53.301266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076949+0000","last_change":"2023-03-27T10:09:52.095172+0000","last_active":"2023-03-27T10:09:53.076949+0000","last_peered":"2023-03-27T10:09:53.076949+0000","last_clean":"2023-03-27T10:09:53.076949+0000","last_became_active":"2023-03-27T10:09:52.093048+0000","last_became_peered":"2023-03-27T10:09:52.093048+0000","last_unstale":"2023-03-27T10:09:53.076949+0000","last_undegraded":"2023-03-27T10:09:53.076949+0000","last_fullsized":"2023-03-27T10:09:53.076949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298673+0000","last_change":"2023-03-27T10:09:51.622695+0000","last_active":"2023-03-27T10:09:53.298673+0000","last_peered":"2023-03-27T10:09:53.298673+0000","last_clean":"2023-03-27T10:09:53.298673+0000","last_became_active":"2023-03-27T10:09:51.622334+0000","last_became_peered":"2023-03-27T10:09:51.622334+0000","last_unstale":"2023-03-27T10:09:53.298673+0000","last_undegraded":"2023-03-27T10:09:53.298673+0000","last_fullsized":"2023-03-27T10:09:53.298673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:55:43.245212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291494+0000","last_change":"2023-03-27T10:09:52.103636+0000","last_active":"2023-03-27T10:09:53.291494+0000","last_peered":"2023-03-27T10:09:53.291494+0000","last_clean":"2023-03-27T10:09:53.291494+0000","last_became_active":"2023-03-27T10:09:52.103345+0000","last_became_peered":"2023-03-27T10:09:52.103345+0000","last_unstale":"2023-03-27T10:09:53.291494+0000","last_undegraded":"2023-03-27T10:09:53.291494+0000","last_fullsized":"2023-03-27T10:09:53.291494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298658+0000","last_change":"2023-03-27T10:09:51.621953+0000","last_active":"2023-03-27T10:09:53.298658+0000","last_peered":"2023-03-27T10:09:53.298658+0000","last_clean":"2023-03-27T10:09:53.298658+0000","last_became_active":"2023-03-27T10:09:51.621630+0000","last_became_peered":"2023-03-27T10:09:51.621630+0000","last_unstale":"2023-03-27T10:09:53.298658+0000","last_undegraded":"2023-03-27T10:09:53.298658+0000","last_fullsized":"2023-03-27T10:09:53.298658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:14:14.159374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077921+0000","last_change":"2023-03-27T10:09:52.101803+0000","last_active":"2023-03-27T10:09:53.077921+0000","last_peered":"2023-03-27T10:09:53.077921+0000","last_clean":"2023-03-27T10:09:53.077921+0000","last_became_active":"2023-03-27T10:09:52.100140+0000","last_became_peered":"2023-03-27T10:09:52.100140+0000","last_unstale":"2023-03-27T10:09:53.077921+0000","last_undegraded":"2023-03-27T10:09:53.077921+0000","last_fullsized":"2023-03-27T10:09:53.077921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:52:48.138618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.298646+0000","last_change":"2023-03-27T10:09:51.620614+0000","last_active":"2023-03-27T10:09:53.298646+0000","last_peered":"2023-03-27T10:09:53.298646+0000","last_clean":"2023-03-27T10:09:53.298646+0000","last_became_active":"2023-03-27T10:09:51.620331+0000","last_became_peered":"2023-03-27T10:09:51.620331+0000","last_unstale":"2023-03-27T10:09:53.298646+0000","last_undegraded":"2023-03-27T10:09:53.298646+0000","last_fullsized":"2023-03-27T10:09:53.298646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301343+0000","last_change":"2023-03-27T10:09:52.097480+0000","last_active":"2023-03-27T10:09:53.301343+0000","last_peered":"2023-03-27T10:09:53.301343+0000","last_clean":"2023-03-27T10:09:53.301343+0000","last_became_active":"2023-03-27T10:09:52.097210+0000","last_became_peered":"2023-03-27T10:09:52.097210+0000","last_unstale":"2023-03-27T10:09:53.301343+0000","last_undegraded":"2023-03-27T10:09:53.301343+0000","last_fullsized":"2023-03-27T10:09:53.301343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:53:27.358285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291546+0000","last_change":"2023-03-27T10:09:51.615276+0000","last_active":"2023-03-27T10:09:53.291546+0000","last_peered":"2023-03-27T10:09:53.291546+0000","last_clean":"2023-03-27T10:09:53.291546+0000","last_became_active":"2023-03-27T10:09:51.614739+0000","last_became_peered":"2023-03-27T10:09:51.614739+0000","last_unstale":"2023-03-27T10:09:53.291546+0000","last_undegraded":"2023-03-27T10:09:53.291546+0000","last_fullsized":"2023-03-27T10:09:53.291546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291924+0000","last_change":"2023-03-27T10:09:52.106003+0000","last_active":"2023-03-27T10:09:53.291924+0000","last_peered":"2023-03-27T10:09:53.291924+0000","last_clean":"2023-03-27T10:09:53.291924+0000","last_became_active":"2023-03-27T10:09:52.105235+0000","last_became_peered":"2023-03-27T10:09:52.105235+0000","last_unstale":"2023-03-27T10:09:53.291924+0000","last_undegraded":"2023-03-27T10:09:53.291924+0000","last_fullsized":"2023-03-27T10:09:53.291924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:37:52.011457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076894+0000","last_change":"2023-03-27T10:09:51.614759+0000","last_active":"2023-03-27T10:09:53.076894+0000","last_peered":"2023-03-27T10:09:53.076894+0000","last_clean":"2023-03-27T10:09:53.076894+0000","last_became_active":"2023-03-27T10:09:51.613946+0000","last_became_peered":"2023-03-27T10:09:51.613946+0000","last_unstale":"2023-03-27T10:09:53.076894+0000","last_undegraded":"2023-03-27T10:09:53.076894+0000","last_fullsized":"2023-03-27T10:09:53.076894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078757+0000","last_change":"2023-03-27T10:09:52.099430+0000","last_active":"2023-03-27T10:09:53.078757+0000","last_peered":"2023-03-27T10:09:53.078757+0000","last_clean":"2023-03-27T10:09:53.078757+0000","last_became_active":"2023-03-27T10:09:52.098704+0000","last_became_peered":"2023-03-27T10:09:52.098704+0000","last_unstale":"2023-03-27T10:09:53.078757+0000","last_undegraded":"2023-03-27T10:09:53.078757+0000","last_fullsized":"2023-03-27T10:09:53.078757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:57:55.576349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301312+0000","last_change":"2023-03-27T10:09:51.618553+0000","last_active":"2023-03-27T10:09:53.301312+0000","last_peered":"2023-03-27T10:09:53.301312+0000","last_clean":"2023-03-27T10:09:53.301312+0000","last_became_active":"2023-03-27T10:09:51.618221+0000","last_became_peered":"2023-03-27T10:09:51.618221+0000","last_unstale":"2023-03-27T10:09:53.301312+0000","last_undegraded":"2023-03-27T10:09:53.301312+0000","last_fullsized":"2023-03-27T10:09:53.301312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078676+0000","last_change":"2023-03-27T10:09:52.097963+0000","last_active":"2023-03-27T10:09:53.078676+0000","last_peered":"2023-03-27T10:09:53.078676+0000","last_clean":"2023-03-27T10:09:53.078676+0000","last_became_active":"2023-03-27T10:09:52.097246+0000","last_became_peered":"2023-03-27T10:09:52.097246+0000","last_unstale":"2023-03-27T10:09:53.078676+0000","last_undegraded":"2023-03-27T10:09:53.078676+0000","last_fullsized":"2023-03-27T10:09:53.078676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078174+0000","last_change":"2023-03-27T10:09:51.607348+0000","last_active":"2023-03-27T10:09:53.078174+0000","last_peered":"2023-03-27T10:09:53.078174+0000","last_clean":"2023-03-27T10:09:53.078174+0000","last_became_active":"2023-03-27T10:09:51.605922+0000","last_became_peered":"2023-03-27T10:09:51.605922+0000","last_unstale":"2023-03-27T10:09:53.078174+0000","last_undegraded":"2023-03-27T10:09:53.078174+0000","last_fullsized":"2023-03-27T10:09:53.078174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:42:49.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078583+0000","last_change":"2023-03-27T10:09:52.095246+0000","last_active":"2023-03-27T10:09:53.078583+0000","last_peered":"2023-03-27T10:09:53.078583+0000","last_clean":"2023-03-27T10:09:53.078583+0000","last_became_active":"2023-03-27T10:09:52.094368+0000","last_became_peered":"2023-03-27T10:09:52.094368+0000","last_unstale":"2023-03-27T10:09:53.078583+0000","last_undegraded":"2023-03-27T10:09:53.078583+0000","last_fullsized":"2023-03-27T10:09:53.078583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076378+0000","last_change":"2023-03-27T10:09:51.615859+0000","last_active":"2023-03-27T10:09:53.076378+0000","last_peered":"2023-03-27T10:09:53.076378+0000","last_clean":"2023-03-27T10:09:53.076378+0000","last_became_active":"2023-03-27T10:09:51.615589+0000","last_became_peered":"2023-03-27T10:09:51.615589+0000","last_unstale":"2023-03-27T10:09:53.076378+0000","last_undegraded":"2023-03-27T10:09:53.076378+0000","last_fullsized":"2023-03-27T10:09:53.076378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302204+0000","last_change":"2023-03-27T10:09:52.108218+0000","last_active":"2023-03-27T10:09:53.302204+0000","last_peered":"2023-03-27T10:09:53.302204+0000","last_clean":"2023-03-27T10:09:53.302204+0000","last_became_active":"2023-03-27T10:09:52.107884+0000","last_became_peered":"2023-03-27T10:09:52.107884+0000","last_unstale":"2023-03-27T10:09:53.302204+0000","last_undegraded":"2023-03-27T10:09:53.302204+0000","last_fullsized":"2023-03-27T10:09:53.302204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097493+0000","last_change":"2023-03-27T10:09:46.107098+0000","last_active":"2023-03-27T10:09:52.097493+0000","last_peered":"2023-03-27T10:09:52.097493+0000","last_clean":"2023-03-27T10:09:52.097493+0000","last_became_active":"2023-03-27T10:09:46.106831+0000","last_became_peered":"2023-03-27T10:09:46.106831+0000","last_unstale":"2023-03-27T10:09:52.097493+0000","last_undegraded":"2023-03-27T10:09:52.097493+0000","last_fullsized":"2023-03-27T10:09:52.097493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291603+0000","last_change":"2023-03-27T10:09:51.614610+0000","last_active":"2023-03-27T10:09:53.291603+0000","last_peered":"2023-03-27T10:09:53.291603+0000","last_clean":"2023-03-27T10:09:53.291603+0000","last_became_active":"2023-03-27T10:09:51.614320+0000","last_became_peered":"2023-03-27T10:09:51.614320+0000","last_unstale":"2023-03-27T10:09:53.291603+0000","last_undegraded":"2023-03-27T10:09:53.291603+0000","last_fullsized":"2023-03-27T10:09:53.291603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302115+0000","last_change":"2023-03-27T10:09:52.102379+0000","last_active":"2023-03-27T10:09:53.302115+0000","last_peered":"2023-03-27T10:09:53.302115+0000","last_clean":"2023-03-27T10:09:53.302115+0000","last_became_active":"2023-03-27T10:09:52.102073+0000","last_became_peered":"2023-03-27T10:09:52.102073+0000","last_unstale":"2023-03-27T10:09:53.302115+0000","last_undegraded":"2023-03-27T10:09:53.302115+0000","last_fullsized":"2023-03-27T10:09:53.302115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:15:29.175724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.080707+0000","last_change":"2023-03-27T10:09:46.107305+0000","last_active":"2023-03-27T10:09:52.080707+0000","last_peered":"2023-03-27T10:09:52.080707+0000","last_clean":"2023-03-27T10:09:52.080707+0000","last_became_active":"2023-03-27T10:09:46.107038+0000","last_became_peered":"2023-03-27T10:09:46.107038+0000","last_unstale":"2023-03-27T10:09:52.080707+0000","last_undegraded":"2023-03-27T10:09:52.080707+0000","last_fullsized":"2023-03-27T10:09:52.080707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078493+0000","last_change":"2023-03-27T10:09:51.619230+0000","last_active":"2023-03-27T10:09:53.078493+0000","last_peered":"2023-03-27T10:09:53.078493+0000","last_clean":"2023-03-27T10:09:53.078493+0000","last_became_active":"2023-03-27T10:09:51.618937+0000","last_became_peered":"2023-03-27T10:09:51.618937+0000","last_unstale":"2023-03-27T10:09:53.078493+0000","last_undegraded":"2023-03-27T10:09:53.078493+0000","last_fullsized":"2023-03-27T10:09:53.078493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:22:21.905882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302143+0000","last_change":"2023-03-27T10:09:52.099004+0000","last_active":"2023-03-27T10:09:53.302143+0000","last_peered":"2023-03-27T10:09:53.302143+0000","last_clean":"2023-03-27T10:09:53.302143+0000","last_became_active":"2023-03-27T10:09:52.098396+0000","last_became_peered":"2023-03-27T10:09:52.098396+0000","last_unstale":"2023-03-27T10:09:53.302143+0000","last_undegraded":"2023-03-27T10:09:53.302143+0000","last_fullsized":"2023-03-27T10:09:53.302143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.076320+0000","last_change":"2023-03-27T10:09:46.326263+0000","last_active":"2023-03-27T10:09:52.076320+0000","last_peered":"2023-03-27T10:09:52.076320+0000","last_clean":"2023-03-27T10:09:52.076320+0000","last_became_active":"2023-03-27T10:09:46.325963+0000","last_became_peered":"2023-03-27T10:09:46.325963+0000","last_unstale":"2023-03-27T10:09:52.076320+0000","last_undegraded":"2023-03-27T10:09:52.076320+0000","last_fullsized":"2023-03-27T10:09:52.076320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302084+0000","last_change":"2023-03-27T10:09:51.614527+0000","last_active":"2023-03-27T10:09:53.302084+0000","last_peered":"2023-03-27T10:09:53.302084+0000","last_clean":"2023-03-27T10:09:53.302084+0000","last_became_active":"2023-03-27T10:09:51.614208+0000","last_became_peered":"2023-03-27T10:09:51.614208+0000","last_unstale":"2023-03-27T10:09:53.302084+0000","last_undegraded":"2023-03-27T10:09:53.302084+0000","last_fullsized":"2023-03-27T10:09:53.302084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302196+0000","last_change":"2023-03-27T10:09:52.096517+0000","last_active":"2023-03-27T10:09:53.302196+0000","last_peered":"2023-03-27T10:09:53.302196+0000","last_clean":"2023-03-27T10:09:53.302196+0000","last_became_active":"2023-03-27T10:09:52.096184+0000","last_became_peered":"2023-03-27T10:09:52.096184+0000","last_unstale":"2023-03-27T10:09:53.302196+0000","last_undegraded":"2023-03-27T10:09:53.302196+0000","last_fullsized":"2023-03-27T10:09:53.302196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:37.440374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.080807+0000","last_change":"2023-03-27T10:09:46.106690+0000","last_active":"2023-03-27T10:09:52.080807+0000","last_peered":"2023-03-27T10:09:52.080807+0000","last_clean":"2023-03-27T10:09:52.080807+0000","last_became_active":"2023-03-27T10:09:46.106393+0000","last_became_peered":"2023-03-27T10:09:46.106393+0000","last_unstale":"2023-03-27T10:09:52.080807+0000","last_undegraded":"2023-03-27T10:09:52.080807+0000","last_fullsized":"2023-03-27T10:09:52.080807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083438+0000","last_change":"2023-03-27T10:09:40.691310+0000","last_active":"2023-03-27T10:09:52.083438+0000","last_peered":"2023-03-27T10:09:52.083438+0000","last_clean":"2023-03-27T10:09:52.083438+0000","last_became_active":"2023-03-27T10:09:40.690248+0000","last_became_peered":"2023-03-27T10:09:40.690248+0000","last_unstale":"2023-03-27T10:09:52.083438+0000","last_undegraded":"2023-03-27T10:09:52.083438+0000","last_fullsized":"2023-03-27T10:09:52.083438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_clean_scrub_stamp":"2023-03-27T10:09:39.335229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:58:29.036302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076523+0000","last_change":"2023-03-27T10:09:51.612759+0000","last_active":"2023-03-27T10:09:53.076523+0000","last_peered":"2023-03-27T10:09:53.076523+0000","last_clean":"2023-03-27T10:09:53.076523+0000","last_became_active":"2023-03-27T10:09:51.612495+0000","last_became_peered":"2023-03-27T10:09:51.612495+0000","last_unstale":"2023-03-27T10:09:53.076523+0000","last_undegraded":"2023-03-27T10:09:53.076523+0000","last_fullsized":"2023-03-27T10:09:53.076523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:11:00.890150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301379+0000","last_change":"2023-03-27T10:09:52.100115+0000","last_active":"2023-03-27T10:09:53.301379+0000","last_peered":"2023-03-27T10:09:53.301379+0000","last_clean":"2023-03-27T10:09:53.301379+0000","last_became_active":"2023-03-27T10:09:52.099833+0000","last_became_peered":"2023-03-27T10:09:52.099833+0000","last_unstale":"2023-03-27T10:09:53.301379+0000","last_undegraded":"2023-03-27T10:09:53.301379+0000","last_fullsized":"2023-03-27T10:09:53.301379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:02:14.752486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083885+0000","last_change":"2023-03-27T10:09:46.108163+0000","last_active":"2023-03-27T10:09:52.083885+0000","last_peered":"2023-03-27T10:09:52.083885+0000","last_clean":"2023-03-27T10:09:52.083885+0000","last_became_active":"2023-03-27T10:09:46.107807+0000","last_became_peered":"2023-03-27T10:09:46.107807+0000","last_unstale":"2023-03-27T10:09:52.083885+0000","last_undegraded":"2023-03-27T10:09:52.083885+0000","last_fullsized":"2023-03-27T10:09:52.083885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291779+0000","last_change":"2023-03-27T10:09:51.620513+0000","last_active":"2023-03-27T10:09:53.291779+0000","last_peered":"2023-03-27T10:09:53.291779+0000","last_clean":"2023-03-27T10:09:53.291779+0000","last_became_active":"2023-03-27T10:09:51.620285+0000","last_became_peered":"2023-03-27T10:09:51.620285+0000","last_unstale":"2023-03-27T10:09:53.291779+0000","last_undegraded":"2023-03-27T10:09:53.291779+0000","last_fullsized":"2023-03-27T10:09:53.291779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:23:37.756691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291990+0000","last_change":"2023-03-27T10:09:52.103681+0000","last_active":"2023-03-27T10:09:53.291990+0000","last_peered":"2023-03-27T10:09:53.291990+0000","last_clean":"2023-03-27T10:09:53.291990+0000","last_became_active":"2023-03-27T10:09:52.103419+0000","last_became_peered":"2023-03-27T10:09:52.103419+0000","last_unstale":"2023-03-27T10:09:53.291990+0000","last_undegraded":"2023-03-27T10:09:53.291990+0000","last_fullsized":"2023-03-27T10:09:53.291990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:19:50.859090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.083018+0000","last_change":"2023-03-27T10:09:46.107100+0000","last_active":"2023-03-27T10:09:52.083018+0000","last_peered":"2023-03-27T10:09:52.083018+0000","last_clean":"2023-03-27T10:09:52.083018+0000","last_became_active":"2023-03-27T10:09:46.106766+0000","last_became_peered":"2023-03-27T10:09:46.106766+0000","last_unstale":"2023-03-27T10:09:52.083018+0000","last_undegraded":"2023-03-27T10:09:52.083018+0000","last_fullsized":"2023-03-27T10:09:52.083018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:44:01.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302152+0000","last_change":"2023-03-27T10:09:51.611165+0000","last_active":"2023-03-27T10:09:53.302152+0000","last_peered":"2023-03-27T10:09:53.302152+0000","last_clean":"2023-03-27T10:09:53.302152+0000","last_became_active":"2023-03-27T10:09:51.610854+0000","last_became_peered":"2023-03-27T10:09:51.610854+0000","last_unstale":"2023-03-27T10:09:53.302152+0000","last_undegraded":"2023-03-27T10:09:53.302152+0000","last_fullsized":"2023-03-27T10:09:53.302152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291887+0000","last_change":"2023-03-27T10:09:52.088129+0000","last_active":"2023-03-27T10:09:53.291887+0000","last_peered":"2023-03-27T10:09:53.291887+0000","last_clean":"2023-03-27T10:09:53.291887+0000","last_became_active":"2023-03-27T10:09:52.087826+0000","last_became_peered":"2023-03-27T10:09:52.087826+0000","last_unstale":"2023-03-27T10:09:53.291887+0000","last_undegraded":"2023-03-27T10:09:53.291887+0000","last_fullsized":"2023-03-27T10:09:53.291887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077036+0000","last_change":"2023-03-27T10:09:51.614313+0000","last_active":"2023-03-27T10:09:53.077036+0000","last_peered":"2023-03-27T10:09:53.077036+0000","last_clean":"2023-03-27T10:09:53.077036+0000","last_became_active":"2023-03-27T10:09:51.613995+0000","last_became_peered":"2023-03-27T10:09:51.613995+0000","last_unstale":"2023-03-27T10:09:53.077036+0000","last_undegraded":"2023-03-27T10:09:53.077036+0000","last_fullsized":"2023-03-27T10:09:53.077036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.097475+0000","last_change":"2023-03-27T10:09:46.108779+0000","last_active":"2023-03-27T10:09:52.097475+0000","last_peered":"2023-03-27T10:09:52.097475+0000","last_clean":"2023-03-27T10:09:52.097475+0000","last_became_active":"2023-03-27T10:09:46.108307+0000","last_became_peered":"2023-03-27T10:09:46.108307+0000","last_unstale":"2023-03-27T10:09:52.097475+0000","last_undegraded":"2023-03-27T10:09:52.097475+0000","last_fullsized":"2023-03-27T10:09:52.097475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076313+0000","last_change":"2023-03-27T10:09:52.089355+0000","last_active":"2023-03-27T10:09:53.076313+0000","last_peered":"2023-03-27T10:09:53.076313+0000","last_clean":"2023-03-27T10:09:53.076313+0000","last_became_active":"2023-03-27T10:09:52.089075+0000","last_became_peered":"2023-03-27T10:09:52.089075+0000","last_unstale":"2023-03-27T10:09:53.076313+0000","last_undegraded":"2023-03-27T10:09:53.076313+0000","last_fullsized":"2023-03-27T10:09:53.076313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:52.084381+0000","last_change":"2023-03-27T10:09:46.108791+0000","last_active":"2023-03-27T10:09:52.084381+0000","last_peered":"2023-03-27T10:09:52.084381+0000","last_clean":"2023-03-27T10:09:52.084381+0000","last_became_active":"2023-03-27T10:09:46.108203+0000","last_became_peered":"2023-03-27T10:09:46.108203+0000","last_unstale":"2023-03-27T10:09:52.084381+0000","last_undegraded":"2023-03-27T10:09:52.084381+0000","last_fullsized":"2023-03-27T10:09:52.084381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:54.365595+0000","last_change":"2023-03-27T10:09:51.617246+0000","last_active":"2023-03-27T10:09:54.365595+0000","last_peered":"2023-03-27T10:09:54.365595+0000","last_clean":"2023-03-27T10:09:54.365595+0000","last_became_active":"2023-03-27T10:09:51.616745+0000","last_became_peered":"2023-03-27T10:09:51.616745+0000","last_unstale":"2023-03-27T10:09:54.365595+0000","last_undegraded":"2023-03-27T10:09:54.365595+0000","last_fullsized":"2023-03-27T10:09:54.365595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:34:42.182555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078179+0000","last_change":"2023-03-27T10:09:52.100091+0000","last_active":"2023-03-27T10:09:53.078179+0000","last_peered":"2023-03-27T10:09:53.078179+0000","last_clean":"2023-03-27T10:09:53.078179+0000","last_became_active":"2023-03-27T10:09:52.099822+0000","last_became_peered":"2023-03-27T10:09:52.099822+0000","last_unstale":"2023-03-27T10:09:53.078179+0000","last_undegraded":"2023-03-27T10:09:53.078179+0000","last_fullsized":"2023-03-27T10:09:53.078179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:49:13.190241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291905+0000","last_change":"2023-03-27T10:09:51.624415+0000","last_active":"2023-03-27T10:09:53.291905+0000","last_peered":"2023-03-27T10:09:53.291905+0000","last_clean":"2023-03-27T10:09:53.291905+0000","last_became_active":"2023-03-27T10:09:51.624151+0000","last_became_peered":"2023-03-27T10:09:51.624151+0000","last_unstale":"2023-03-27T10:09:53.291905+0000","last_undegraded":"2023-03-27T10:09:53.291905+0000","last_fullsized":"2023-03-27T10:09:53.291905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:12:46.903596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078453+0000","last_change":"2023-03-27T10:09:52.097854+0000","last_active":"2023-03-27T10:09:53.078453+0000","last_peered":"2023-03-27T10:09:53.078453+0000","last_clean":"2023-03-27T10:09:53.078453+0000","last_became_active":"2023-03-27T10:09:52.097592+0000","last_became_peered":"2023-03-27T10:09:52.097592+0000","last_unstale":"2023-03-27T10:09:53.078453+0000","last_undegraded":"2023-03-27T10:09:53.078453+0000","last_fullsized":"2023-03-27T10:09:53.078453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291535+0000","last_change":"2023-03-27T10:09:51.620648+0000","last_active":"2023-03-27T10:09:53.291535+0000","last_peered":"2023-03-27T10:09:53.291535+0000","last_clean":"2023-03-27T10:09:53.291535+0000","last_became_active":"2023-03-27T10:09:51.620327+0000","last_became_peered":"2023-03-27T10:09:51.620327+0000","last_unstale":"2023-03-27T10:09:53.291535+0000","last_undegraded":"2023-03-27T10:09:53.291535+0000","last_fullsized":"2023-03-27T10:09:53.291535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:19:48.856271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078428+0000","last_change":"2023-03-27T10:09:52.083060+0000","last_active":"2023-03-27T10:09:53.078428+0000","last_peered":"2023-03-27T10:09:53.078428+0000","last_clean":"2023-03-27T10:09:53.078428+0000","last_became_active":"2023-03-27T10:09:52.082804+0000","last_became_peered":"2023-03-27T10:09:52.082804+0000","last_unstale":"2023-03-27T10:09:53.078428+0000","last_undegraded":"2023-03-27T10:09:53.078428+0000","last_fullsized":"2023-03-27T10:09:53.078428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.291615+0000","last_change":"2023-03-27T10:09:51.620593+0000","last_active":"2023-03-27T10:09:53.291615+0000","last_peered":"2023-03-27T10:09:53.291615+0000","last_clean":"2023-03-27T10:09:53.291615+0000","last_became_active":"2023-03-27T10:09:51.620287+0000","last_became_peered":"2023-03-27T10:09:51.620287+0000","last_unstale":"2023-03-27T10:09:53.291615+0000","last_undegraded":"2023-03-27T10:09:53.291615+0000","last_fullsized":"2023-03-27T10:09:53.291615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:51:27.418817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078402+0000","last_change":"2023-03-27T10:09:52.080606+0000","last_active":"2023-03-27T10:09:53.078402+0000","last_peered":"2023-03-27T10:09:53.078402+0000","last_clean":"2023-03-27T10:09:53.078402+0000","last_became_active":"2023-03-27T10:09:52.080331+0000","last_became_peered":"2023-03-27T10:09:52.080331+0000","last_unstale":"2023-03-27T10:09:53.078402+0000","last_undegraded":"2023-03-27T10:09:53.078402+0000","last_fullsized":"2023-03-27T10:09:53.078402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:50:36.610757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076857+0000","last_change":"2023-03-27T10:09:51.616366+0000","last_active":"2023-03-27T10:09:53.076857+0000","last_peered":"2023-03-27T10:09:53.076857+0000","last_clean":"2023-03-27T10:09:53.076857+0000","last_became_active":"2023-03-27T10:09:51.615908+0000","last_became_peered":"2023-03-27T10:09:51.615908+0000","last_unstale":"2023-03-27T10:09:53.076857+0000","last_undegraded":"2023-03-27T10:09:53.076857+0000","last_fullsized":"2023-03-27T10:09:53.076857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:42:26.509848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076487+0000","last_change":"2023-03-27T10:09:52.102730+0000","last_active":"2023-03-27T10:09:53.076487+0000","last_peered":"2023-03-27T10:09:53.076487+0000","last_clean":"2023-03-27T10:09:53.076487+0000","last_became_active":"2023-03-27T10:09:52.102450+0000","last_became_peered":"2023-03-27T10:09:52.102450+0000","last_unstale":"2023-03-27T10:09:53.076487+0000","last_undegraded":"2023-03-27T10:09:53.076487+0000","last_fullsized":"2023-03-27T10:09:53.076487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:45:39.170360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.292078+0000","last_change":"2023-03-27T10:09:51.621408+0000","last_active":"2023-03-27T10:09:53.292078+0000","last_peered":"2023-03-27T10:09:53.292078+0000","last_clean":"2023-03-27T10:09:53.292078+0000","last_became_active":"2023-03-27T10:09:51.620743+0000","last_became_peered":"2023-03-27T10:09:51.620743+0000","last_unstale":"2023-03-27T10:09:53.292078+0000","last_undegraded":"2023-03-27T10:09:53.292078+0000","last_fullsized":"2023-03-27T10:09:53.292078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:50.582419+0000","last_clean_scrub_stamp":"2023-03-27T10:09:50.582419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:50:38.255024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.077753+0000","last_change":"2023-03-27T10:09:52.088963+0000","last_active":"2023-03-27T10:09:53.077753+0000","last_peered":"2023-03-27T10:09:53.077753+0000","last_clean":"2023-03-27T10:09:53.077753+0000","last_became_active":"2023-03-27T10:09:52.088695+0000","last_became_peered":"2023-03-27T10:09:52.088695+0000","last_unstale":"2023-03-27T10:09:53.077753+0000","last_undegraded":"2023-03-27T10:09:53.077753+0000","last_fullsized":"2023-03-27T10:09:53.077753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:03:52.464102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.301293+0000","last_change":"2023-03-27T10:09:52.098801+0000","last_active":"2023-03-27T10:09:53.301293+0000","last_peered":"2023-03-27T10:09:53.301293+0000","last_clean":"2023-03-27T10:09:53.301293+0000","last_became_active":"2023-03-27T10:09:52.098214+0000","last_became_peered":"2023-03-27T10:09:52.098214+0000","last_unstale":"2023-03-27T10:09:53.301293+0000","last_undegraded":"2023-03-27T10:09:53.301293+0000","last_fullsized":"2023-03-27T10:09:53.301293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:13:25.051414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076365+0000","last_change":"2023-03-27T10:09:52.101353+0000","last_active":"2023-03-27T10:09:53.076365+0000","last_peered":"2023-03-27T10:09:53.076365+0000","last_clean":"2023-03-27T10:09:53.076365+0000","last_became_active":"2023-03-27T10:09:52.101060+0000","last_became_peered":"2023-03-27T10:09:52.101060+0000","last_unstale":"2023-03-27T10:09:53.076365+0000","last_undegraded":"2023-03-27T10:09:53.076365+0000","last_fullsized":"2023-03-27T10:09:53.076365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:50:38.968838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.078027+0000","last_change":"2023-03-27T10:09:52.090063+0000","last_active":"2023-03-27T10:09:53.078027+0000","last_peered":"2023-03-27T10:09:53.078027+0000","last_clean":"2023-03-27T10:09:53.078027+0000","last_became_active":"2023-03-27T10:09:52.089785+0000","last_became_peered":"2023-03-27T10:09:52.089785+0000","last_unstale":"2023-03-27T10:09:53.078027+0000","last_undegraded":"2023-03-27T10:09:53.078027+0000","last_fullsized":"2023-03-27T10:09:53.078027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:23:37.734370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.076654+0000","last_change":"2023-03-27T10:09:52.102062+0000","last_active":"2023-03-27T10:09:53.076654+0000","last_peered":"2023-03-27T10:09:53.076654+0000","last_clean":"2023-03-27T10:09:53.076654+0000","last_became_active":"2023-03-27T10:09:52.101762+0000","last_became_peered":"2023-03-27T10:09:52.101762+0000","last_unstale":"2023-03-27T10:09:53.076654+0000","last_undegraded":"2023-03-27T10:09:53.076654+0000","last_fullsized":"2023-03-27T10:09:53.076654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:42:00.409012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-03-27T10:09:53.302124+0000","last_change":"2023-03-27T10:09:52.100627+0000","last_active":"2023-03-27T10:09:53.302124+0000","last_peered":"2023-03-27T10:09:53.302124+0000","last_clean":"2023-03-27T10:09:53.302124+0000","last_became_active":"2023-03-27T10:09:52.100237+0000","last_became_peered":"2023-03-27T10:09:52.100237+0000","last_unstale":"2023-03-27T10:09:53.302124+0000","last_undegraded":"2023-03-27T10:09:53.302124+0000","last_fullsized":"2023-03-27T10:09:53.302124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:51.585121+0000","last_clean_scrub_stamp":"2023-03-27T10:09:51.585121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:23:39.424294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7936,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363904,"statfs":{"total":96636764160,"available":96628637696,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9120,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362720,"statfs":{"total":96636764160,"available":96627425280,"internally_reserved":0,"allocated":876544,"data_stored":686118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0779999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.133}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.972}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":851968,"data_stored":684920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0059999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":94076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":95590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8008,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363832,"statfs":{"total":96636764160,"available":96628563968,"internally_reserved":0,"allocated":262144,"data_stored":94622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8000,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363840,"statfs":{"total":96636764160,"available":96628572160,"internally_reserved":0,"allocated":253952,"data_stored":93986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-27T10:10:02.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-27T10:10:02.412 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-27T10:10:02.412 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-27T10:10:02.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-27T10:10:02.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.627+0000 7ff5fd1ff700 1 Processor -- start 2023-03-27T10:10:02.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.628+0000 7ff5fd1ff700 1 -- start start 2023-03-27T10:10:02.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5fd1ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f80d0b90 0x7ff5f80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5fd1ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80cebc0 con 0x7ff5f815ca20 2023-03-27T10:10:02.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5fd1ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80ceea0 con 0x7ff5f80cd610 2023-03-27T10:10:02.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5fd1ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80cf180 con 0x7ff5f80d0b90 2023-03-27T10:10:02.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5effff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff5f815ca20 0x7ff5f80d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53122/0 (socket says 172.21.15.172:53122) 2023-03-27T10:10:02.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5effff700 1 -- 172.21.15.172:0/2716675909 learned_addr learned my addr 172.21.15.172:0/2716675909 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:02.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5f6d9d700 1 --2- 172.21.15.172:0/2716675909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f80d0b90 0x7ff5f80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598347210 0 0) 0x7ff5f80cebc0 con 0x7ff5f815ca20 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.629+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e40035b0 con 0x7ff5f815ca20 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600126350 0 0) 0x7ff5f80ceea0 con 0x7ff5f80cd610 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f80cebc0 con 0x7ff5f80cd610 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592398487 0 0) 0x7ff5e40035b0 con 0x7ff5f815ca20 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f6d9d700 1 -- 172.21.15.172:0/2716675909 >> v1:172.21.15.191:6789/0 conn(0x7ff5f80cd610 legacy=0x7ff5f80b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f6d9d700 1 -- 172.21.15.172:0/2716675909 >> v1:172.21.15.172:6789/0 conn(0x7ff5f815ca20 legacy=0x7ff5f80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f6d9d700 1 -- 172.21.15.172:0/2716675909 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80cf460 con 0x7ff5f80d0b90 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f6d9d700 1 --2- 172.21.15.172:0/2716675909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f80d0b90 0x7ff5f80ce500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009850 tx=0x7ff5e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f111cc1dcab5040 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0001670 con 0x7ff5f80d0b90 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8005c30 con 0x7ff5f80d0b90 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.630+0000 7ff5f659c700 1 -- 172.21.15.172:0/2716675909 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8004030 con 0x7ff5f80d0b90 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/2716675909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f80d0b90 msgr2=0x7ff5f80ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/2716675909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f80d0b90 0x7ff5f80ce500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009850 tx=0x7ff5e8009b60 comp rx=0 tx=0).stop 2023-03-27T10:10:02.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/2716675909 shutdown_connections 2023-03-27T10:10:02.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/2716675909 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f80d0b90 0x7ff5f80ce500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/2716675909 >> 172.21.15.172:0/2716675909 conn(0x7ff5f80721f0 msgr2=0x7ff5f809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:02.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/2716675909 shutdown_connections 2023-03-27T10:10:02.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.631+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/2716675909 wait complete. 2023-03-27T10:10:02.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.632+0000 7ff5fd1ff700 1 Processor -- start 2023-03-27T10:10:02.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 -- start start 2023-03-27T10:10:02.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f80cd610 0x7ff5f8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 0x7ff5f81e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f815ca20 0x7ff5f806b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815b690 con 0x7ff5f80d0b90 2023-03-27T10:10:02.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815a300 con 0x7ff5f80cd610 2023-03-27T10:10:02.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.633+0000 7ff5fd1ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f815aa80 con 0x7ff5f815ca20 2023-03-27T10:10:02.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 0x7ff5f81e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 0x7ff5f81e6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40982/0 (socket says 172.21.15.172:40982) 2023-03-27T10:10:02.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 -- 172.21.15.172:0/17650438 learned_addr learned my addr 172.21.15.172:0/17650438 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:02.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5f6d9d700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f80cd610 0x7ff5f8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5f759e700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f815ca20 0x7ff5f806b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 -- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f815ca20 msgr2=0x7ff5f806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f815ca20 0x7ff5f806b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 -- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f80cd610 msgr2=0x7ff5f8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f80cd610 0x7ff5f8159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 -- 172.21.15.172:0/17650438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8009430 con 0x7ff5f80d0b90 2023-03-27T10:10:02.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5f759e700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f815ca20 0x7ff5f806b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:02.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5effff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 0x7ff5f81e6bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c550 tx=0x7ff5e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:02.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.634+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0004c80 con 0x7ff5f80d0b90 2023-03-27T10:10:02.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.635+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0004de0 con 0x7ff5f80d0b90 2023-03-27T10:10:02.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.635+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00072f0 con 0x7ff5f80d0b90 2023-03-27T10:10:02.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.635+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f80d2d30 con 0x7ff5f80d0b90 2023-03-27T10:10:02.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.635+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f80afc50 con 0x7ff5f80d0b90 2023-03-27T10:10:02.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.636+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f80b0880 con 0x7ff5f80d0b90 2023-03-27T10:10:02.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.637+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff5e001a020 con 0x7ff5f80d0b90 2023-03-27T10:10:02.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.637+0000 7ff5ef7fe700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff5d8066e30 0x7ff5d80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:02.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.637+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5e0083e50 con 0x7ff5f80d0b90 2023-03-27T10:10:02.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.638+0000 7ff5f6d9d700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff5d8066e30 0x7ff5d80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:02.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.638+0000 7ff5f6d9d700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff5d8066e30 0x7ff5d80692e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80097a0 tx=0x7ff5e8008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:02.646 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.641+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff5e00511a0 con 0x7ff5f80d0b90 2023-03-27T10:10:02.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.873+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff5f8074290 con 0x7ff5f80d0b90 2023-03-27T10:10:02.872 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.873+0000 7ff5ef7fe700 1 -- 172.21.15.172:0/17650438 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff5e0007db0 con 0x7ff5f80d0b90 2023-03-27T10:10:02.872 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:02.872 INFO:teuthology.orchestra.run.smithi172.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-27T10:10:02.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.875+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff5d8066e30 msgr2=0x7ff5d80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.875+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff5d8066e30 0x7ff5d80692e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80097a0 tx=0x7ff5e8008070 comp rx=0 tx=0).stop 2023-03-27T10:10:02.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.875+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 msgr2=0x7ff5f81e6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:02.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.875+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 0x7ff5f81e6bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c550 tx=0x7ff5e000c910 comp rx=0 tx=0).stop 2023-03-27T10:10:02.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.875+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 shutdown_connections 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.875+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f815ca20 0x7ff5f806b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.876+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff5d8066e30 0x7ff5d80692e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.876+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f80cd610 0x7ff5f8159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.876+0000 7ff5fd1ff700 1 --2- 172.21.15.172:0/17650438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5f80d0b90 0x7ff5f81e6bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.876+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 >> 172.21.15.172:0/17650438 conn(0x7ff5f80721f0 msgr2=0x7ff5f809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.876+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 shutdown_connections 2023-03-27T10:10:02.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:02.876+0000 7ff5fd1ff700 1 -- 172.21.15.172:0/17650438 wait complete. 2023-03-27T10:10:02.891 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-27T10:10:02.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:03.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.076+0000 7fd27e3ff700 1 Processor -- start 2023-03-27T10:10:03.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.076+0000 7fd27e3ff700 1 -- start start 2023-03-27T10:10:03.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27e3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd2780d0b90 0x7fd2780ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27e3ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd27815ca20 0x7fd2780d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2780cd610 0x7fd2780cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27e3ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780d14a0 con 0x7fd27815ca20 2023-03-27T10:10:03.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27e3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780cebc0 con 0x7fd2780d0b90 2023-03-27T10:10:03.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780ceea0 con 0x7fd2780cd610 2023-03-27T10:10:03.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd27815ca20 0x7fd2780d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd27815ca20 0x7fd2780d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40992/0 (socket says 172.21.15.172:40992) 2023-03-27T10:10:03.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 -- 172.21.15.172:0/3054932596 learned_addr learned my addr 172.21.15.172:0/3054932596 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:03.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd277fff700 1 --2- 172.21.15.172:0/3054932596 >> v2:172.21.15.191:3300/0 conn(0x7fd2780d0b90 0x7fd2780ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd27c99c700 1 --2- 172.21.15.172:0/3054932596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2780cd610 0x7fd2780cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 -- 172.21.15.172:0/3054932596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2780cd610 msgr2=0x7fd2780cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:03.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 --2- 172.21.15.172:0/3054932596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2780cd610 0x7fd2780cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 -- 172.21.15.172:0/3054932596 >> v2:172.21.15.191:3300/0 conn(0x7fd2780d0b90 msgr2=0x7fd2780ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:03.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 --2- 172.21.15.172:0/3054932596 >> v2:172.21.15.191:3300/0 conn(0x7fd2780d0b90 0x7fd2780ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd2777fe700 1 -- 172.21.15.172:0/3054932596 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780cf180 con 0x7fd27815ca20 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.078+0000 7fd277fff700 1 --2- 172.21.15.172:0/3054932596 >> v2:172.21.15.191:3300/0 conn(0x7fd2780d0b90 0x7fd2780ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd2777fe700 1 --2- 172.21.15.172:0/3054932596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd27815ca20 0x7fd2780d0f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd27808c260 tx=0x7fd26c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6174be1de909b93c server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd276ffd700 1 -- 172.21.15.172:0/3054932596 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011830 con 0x7fd27815ca20 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd276ffd700 1 -- 172.21.15.172:0/3054932596 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c011990 con 0x7fd27815ca20 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd276ffd700 1 -- 172.21.15.172:0/3054932596 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011d20 con 0x7fd27815ca20 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 -- 172.21.15.172:0/3054932596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd27815ca20 msgr2=0x7fd2780d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/3054932596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd27815ca20 0x7fd2780d0f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd27808c260 tx=0x7fd26c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 -- 172.21.15.172:0/3054932596 shutdown_connections 2023-03-27T10:10:03.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/3054932596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2780cd610 0x7fd2780cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/3054932596 >> v2:172.21.15.191:3300/0 conn(0x7fd2780d0b90 0x7fd2780ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/3054932596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd27815ca20 0x7fd2780d0f60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.079+0000 7fd27e3ff700 1 -- 172.21.15.172:0/3054932596 >> 172.21.15.172:0/3054932596 conn(0x7fd2780721f0 msgr2=0x7fd27809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:03.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.080+0000 7fd27e3ff700 1 -- 172.21.15.172:0/3054932596 shutdown_connections 2023-03-27T10:10:03.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.080+0000 7fd27e3ff700 1 -- 172.21.15.172:0/3054932596 wait complete. 2023-03-27T10:10:03.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.081+0000 7fd27e3ff700 1 Processor -- start 2023-03-27T10:10:03.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.081+0000 7fd27e3ff700 1 -- start start 2023-03-27T10:10:03.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.082+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2780cd610 0x7fd2781577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.082+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 0x7fd2780b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.082+0000 7fd27e3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27815ca20 0x7fd2780b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.082+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780ccc40 con 0x7fd2780d0b90 2023-03-27T10:10:03.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.082+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780cc960 con 0x7fd2780cd610 2023-03-27T10:10:03.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.082+0000 7fd27e3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780ca1c0 con 0x7fd27815ca20 2023-03-27T10:10:03.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 0x7fd2780b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 0x7fd2780b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41006/0 (socket says 172.21.15.172:41006) 2023-03-27T10:10:03.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 -- 172.21.15.172:0/1257935724 learned_addr learned my addr 172.21.15.172:0/1257935724 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:03.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd277fff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2780cd610 0x7fd2781577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd27c99c700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27815ca20 0x7fd2780b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 -- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27815ca20 msgr2=0x7fd2780b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27815ca20 0x7fd2780b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 -- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2780cd610 msgr2=0x7fd2781577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2780cd610 0x7fd2781577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 -- 172.21.15.172:0/1257935724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd268009430 con 0x7fd2780d0b90 2023-03-27T10:10:03.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd2777fe700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 0x7fd2780b43f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000c00 tx=0x7fd26c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.083+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c004450 con 0x7fd2780d0b90 2023-03-27T10:10:03.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.084+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0045b0 con 0x7fd2780d0b90 2023-03-27T10:10:03.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.084+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c009550 con 0x7fd2780d0b90 2023-03-27T10:10:03.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.084+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0038e0 con 0x7fd2780d0b90 2023-03-27T10:10:03.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.084+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2780afc50 con 0x7fd2780d0b90 2023-03-27T10:10:03.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.085+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2780cf460 con 0x7fd2780d0b90 2023-03-27T10:10:03.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.085+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd26c00f050 con 0x7fd2780d0b90 2023-03-27T10:10:03.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.086+0000 7fd274ff9700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd264066e30 0x7fd2640692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.086+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd26c084d90 con 0x7fd2780d0b90 2023-03-27T10:10:03.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.087+0000 7fd277fff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd264066e30 0x7fd2640692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.087+0000 7fd277fff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd264066e30 0x7fd2640692e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d50 tx=0x7fd2680091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.090+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd26c051fd0 con 0x7fd2780d0b90 2023-03-27T10:10:03.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.277+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2780d2d30 con 0x7fd2780d0b90 2023-03-27T10:10:03.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.279+0000 7fd274ff9700 1 -- 172.21.15.172:0/1257935724 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7fd26c0555f0 con 0x7fd2780d0b90 2023-03-27T10:10:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:03.278 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:03.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd264066e30 msgr2=0x7fd2640692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd264066e30 0x7fd2640692e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d50 tx=0x7fd2680091c0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 msgr2=0x7fd2780b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 0x7fd2780b43f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd26c000c00 tx=0x7fd26c004750 comp rx=0 tx=0).stop 2023-03-27T10:10:03.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 shutdown_connections 2023-03-27T10:10:03.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd27815ca20 0x7fd2780b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd264066e30 0x7fd2640692e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2780cd610 0x7fd2781577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 --2- 172.21.15.172:0/1257935724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2780d0b90 0x7fd2780b43f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 >> 172.21.15.172:0/1257935724 conn(0x7fd2780721f0 msgr2=0x7fd27809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:03.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.281+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 shutdown_connections 2023-03-27T10:10:03.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.282+0000 7fd27e3ff700 1 -- 172.21.15.172:0/1257935724 wait complete. 2023-03-27T10:10:03.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:03.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:03.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.486+0000 7ff190fff700 1 Processor -- start 2023-03-27T10:10:03.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.487+0000 7ff190fff700 1 -- start start 2023-03-27T10:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff190fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff18c15a240 0x7ff18c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff190fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c0d3a30 0x7ff18c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff190fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff18c1604b0 0x7ff18c160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff190fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c161200 con 0x7ff18c15a240 2023-03-27T10:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff190fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0d29d0 con 0x7ff18c1604b0 2023-03-27T10:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff190fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15a610 con 0x7ff18c0d3a30 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff18c15a240 0x7ff18c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff18c15a240 0x7ff18c0d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41014/0 (socket says 172.21.15.172:41014) 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 -- 172.21.15.172:0/1221082561 learned_addr learned my addr 172.21.15.172:0/1221082561 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18ad9d700 1 --2- 172.21.15.172:0/1221082561 >> v2:172.21.15.191:3300/0 conn(0x7ff18c1604b0 0x7ff18c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff183fff700 1 --2- 172.21.15.172:0/1221082561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c0d3a30 0x7ff18c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 -- 172.21.15.172:0/1221082561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c0d3a30 msgr2=0x7ff18c0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:03.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 --2- 172.21.15.172:0/1221082561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c0d3a30 0x7ff18c0d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 -- 172.21.15.172:0/1221082561 >> v2:172.21.15.191:3300/0 conn(0x7ff18c1604b0 msgr2=0x7ff18c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:03.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 --2- 172.21.15.172:0/1221082561 >> v2:172.21.15.191:3300/0 conn(0x7ff18c1604b0 0x7ff18c160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.488+0000 7ff18a59c700 1 -- 172.21.15.172:0/1221082561 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0d2c70 con 0x7ff18c15a240 2023-03-27T10:10:03.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.489+0000 7ff18a59c700 1 --2- 172.21.15.172:0/1221082561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0d0ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff18c08c1b0 tx=0x7ff17c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56b4531756dafcd server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.489+0000 7ff189d9b700 1 -- 172.21.15.172:0/1221082561 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011830 con 0x7ff18c15a240 2023-03-27T10:10:03.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.489+0000 7ff189d9b700 1 -- 172.21.15.172:0/1221082561 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c011990 con 0x7ff18c15a240 2023-03-27T10:10:03.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.489+0000 7ff189d9b700 1 -- 172.21.15.172:0/1221082561 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011d20 con 0x7ff18c15a240 2023-03-27T10:10:03.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.489+0000 7ff190fff700 1 -- 172.21.15.172:0/1221082561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 msgr2=0x7ff18c0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.489+0000 7ff190fff700 1 --2- 172.21.15.172:0/1221082561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0d0ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff18c08c1b0 tx=0x7ff17c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 -- 172.21.15.172:0/1221082561 shutdown_connections 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 --2- 172.21.15.172:0/1221082561 >> v2:172.21.15.191:3300/0 conn(0x7ff18c1604b0 0x7ff18c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 --2- 172.21.15.172:0/1221082561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0d0ac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 --2- 172.21.15.172:0/1221082561 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c0d3a30 0x7ff18c0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 -- 172.21.15.172:0/1221082561 >> 172.21.15.172:0/1221082561 conn(0x7ff18c0721f0 msgr2=0x7ff18c09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:03.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 -- 172.21.15.172:0/1221082561 shutdown_connections 2023-03-27T10:10:03.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.490+0000 7ff190fff700 1 -- 172.21.15.172:0/1221082561 wait complete. 2023-03-27T10:10:03.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.491+0000 7ff190fff700 1 Processor -- start 2023-03-27T10:10:03.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.491+0000 7ff190fff700 1 -- start start 2023-03-27T10:10:03.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.492+0000 7ff190fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff18c0d3a30 0x7ff18c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.492+0000 7ff190fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.492+0000 7ff190fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c1604b0 0x7ff18c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.492+0000 7ff190fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15cc50 con 0x7ff18c15a240 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.492+0000 7ff190fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c1f36a0 con 0x7ff18c0d3a30 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.492+0000 7ff190fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c1f3980 con 0x7ff18c1604b0 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41030/0 (socket says 172.21.15.172:41030) 2023-03-27T10:10:03.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 -- 172.21.15.172:0/232512633 learned_addr learned my addr 172.21.15.172:0/232512633 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff18a59c700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff18c0d3a30 0x7ff18c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff18ad9d700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c1604b0 0x7ff18c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 -- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c1604b0 msgr2=0x7ff18c0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c1604b0 0x7ff18c0c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 -- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff18c0d3a30 msgr2=0x7ff18c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff18c0d3a30 0x7ff18c0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 -- 172.21.15.172:0/232512633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009550 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff183fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0c90f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff17400d7d0 tx=0x7ff17400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1740125f0 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff174012750 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c0d3230 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.493+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174012b00 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.494+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c0d2f50 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.495+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0d3510 con 0x7ff18c15a240 2023-03-27T10:10:03.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.495+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff174012c60 con 0x7ff18c15a240 2023-03-27T10:10:03.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.496+0000 7ff182ffd700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff16c066e30 0x7ff16c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.496+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff174084370 con 0x7ff18c15a240 2023-03-27T10:10:03.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.497+0000 7ff18a59c700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff16c066e30 0x7ff16c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.497+0000 7ff18a59c700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff16c066e30 0x7ff16c0692e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009c10 tx=0x7ff17c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.500+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff1740516f0 con 0x7ff18c15a240 2023-03-27T10:10:03.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.690+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff18c074300 con 0x7ff18c15a240 2023-03-27T10:10:03.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.691+0000 7ff182ffd700 1 -- 172.21.15.172:0/232512633 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff174054d10 con 0x7ff18c15a240 2023-03-27T10:10:03.690 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:03.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff16c066e30 msgr2=0x7ff16c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff16c066e30 0x7ff16c0692e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009c10 tx=0x7ff17c008030 comp rx=0 tx=0).stop 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 msgr2=0x7ff18c0c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0c90f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff17400d7d0 tx=0x7ff17400dae0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 shutdown_connections 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff18c1604b0 0x7ff18c0c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff16c066e30 0x7ff16c0692e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff18c0d3a30 0x7ff18c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 --2- 172.21.15.172:0/232512633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff18c15a240 0x7ff18c0c90f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 >> 172.21.15.172:0/232512633 conn(0x7ff18c0721f0 msgr2=0x7ff18c0d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:03.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 shutdown_connections 2023-03-27T10:10:03.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.693+0000 7ff190fff700 1 -- 172.21.15.172:0/232512633 wait complete. 2023-03-27T10:10:03.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:03.894 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.896+0000 7f2bea9ff700 1 Processor -- start 2023-03-27T10:10:03.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.896+0000 7f2bea9ff700 1 -- start start 2023-03-27T10:10:03.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2bea9ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2be40d11d0 0x7f2be41604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2bea9ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be40d29d0 con 0x7f2be415a240 2023-03-27T10:10:03.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2bea9ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be415a610 con 0x7f2be40d3a30 2023-03-27T10:10:03.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2bea9ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be4161200 con 0x7f2be40d11d0 2023-03-27T10:10:03.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2be37fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2be40d11d0 0x7f2be41604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2be37fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2be40d11d0 0x7f2be41604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41036/0 (socket says 172.21.15.172:41036) 2023-03-27T10:10:03.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2be3fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2be415a240 0x7f2be40d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53132/0 (socket says 172.21.15.172:53132) 2023-03-27T10:10:03.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.897+0000 7f2be37fe700 1 -- 172.21.15.172:0/4279463874 learned_addr learned my addr 172.21.15.172:0/4279463874 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:03.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be37fe700 1 -- 172.21.15.172:0/4279463874 >> v1:172.21.15.191:6789/0 conn(0x7f2be40d3a30 legacy=0x7f2be41609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be37fe700 1 -- 172.21.15.172:0/4279463874 >> v1:172.21.15.172:6789/0 conn(0x7f2be415a240 legacy=0x7f2be40d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be37fe700 1 -- 172.21.15.172:0/4279463874 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40d2c70 con 0x7f2be40d11d0 2023-03-27T10:10:03.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be2ffd700 1 -- 172.21.15.172:0/4279463874 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043992343 0 0) 0x7f2be40d29d0 con 0x7f2be415a240 2023-03-27T10:10:03.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be37fe700 1 --2- 172.21.15.172:0/4279463874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d11d0 0x7f2be41604b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80098f0 tx=0x7f2bd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8483952b236072e6 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be2ffd700 1 -- 172.21.15.172:0/4279463874 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800b8a0 con 0x7f2be40d11d0 2023-03-27T10:10:03.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be2ffd700 1 -- 172.21.15.172:0/4279463874 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800ba00 con 0x7f2be40d11d0 2023-03-27T10:10:03.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.898+0000 7f2be2ffd700 1 -- 172.21.15.172:0/4279463874 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800bd90 con 0x7f2be40d11d0 2023-03-27T10:10:03.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 -- 172.21.15.172:0/4279463874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d11d0 msgr2=0x7f2be41604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/4279463874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d11d0 0x7f2be41604b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80098f0 tx=0x7f2bd8009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 -- 172.21.15.172:0/4279463874 shutdown_connections 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/4279463874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d11d0 0x7f2be41604b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 -- 172.21.15.172:0/4279463874 >> 172.21.15.172:0/4279463874 conn(0x7f2be40721f0 msgr2=0x7f2be409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 -- 172.21.15.172:0/4279463874 shutdown_connections 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.899+0000 7f2bea9ff700 1 -- 172.21.15.172:0/4279463874 wait complete. 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.901+0000 7f2bea9ff700 1 Processor -- start 2023-03-27T10:10:03.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.901+0000 7f2bea9ff700 1 -- start start 2023-03-27T10:10:03.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2bea9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2be40d11d0 0x7f2be40b8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2bea9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 0x7f2be41f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2bea9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2be415a240 0x7f2be415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2bea9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40b2170 con 0x7f2be40d3a30 2023-03-27T10:10:03.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2bea9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be4157c80 con 0x7f2be40d11d0 2023-03-27T10:10:03.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2bea9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40b2410 con 0x7f2be415a240 2023-03-27T10:10:03.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 0x7f2be41f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 0x7f2be41f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41050/0 (socket says 172.21.15.172:41050) 2023-03-27T10:10:03.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 -- 172.21.15.172:0/779434732 learned_addr learned my addr 172.21.15.172:0/779434732 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:03.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be3fff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2be40d11d0 0x7f2be40b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 -- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2be415a240 msgr2=0x7f2be415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be8f9c700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2be415a240 0x7f2be415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2be415a240 0x7f2be415e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 -- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2be40d11d0 msgr2=0x7f2be40b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:03.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2be40d11d0 0x7f2be40b8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:03.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be37fe700 1 -- 172.21.15.172:0/779434732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8009550 con 0x7f2be40d3a30 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be3fff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2be40d11d0 0x7f2be40b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.902+0000 7f2be8f9c700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2be415a240 0x7f2be415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.903+0000 7f2be37fe700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 0x7f2be41f19f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8014040 tx=0x7f2bd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.903+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8011a70 con 0x7f2be40d3a30 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.903+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd801e070 con 0x7f2be40d3a30 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.903+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be40d3230 con 0x7f2be40d3a30 2023-03-27T10:10:03.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.903+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8011dd0 con 0x7f2be40d3a30 2023-03-27T10:10:03.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.903+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be40d2f50 con 0x7f2be40d3a30 2023-03-27T10:10:03.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.904+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be40d3510 con 0x7f2be40d3a30 2023-03-27T10:10:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.905+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f2bd800f050 con 0x7f2be40d3a30 2023-03-27T10:10:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.906+0000 7f2be0ff9700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bd0066e30 0x7f2bd00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.906+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bd80852c0 con 0x7f2be40d3a30 2023-03-27T10:10:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.906+0000 7f2be3fff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bd0066e30 0x7f2bd00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:03.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.907+0000 7f2be3fff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bd0066e30 0x7f2bd00692e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4000f60 tx=0x7f2bd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:03.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:03.910+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f2bd80525f0 con 0x7f2be40d3a30 2023-03-27T10:10:04.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.096+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2be4074300 con 0x7f2be40d3a30 2023-03-27T10:10:04.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.097+0000 7f2be0ff9700 1 -- 172.21.15.172:0/779434732 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2bd8020020 con 0x7f2be40d3a30 2023-03-27T10:10:04.095 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bd0066e30 msgr2=0x7f2bd00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bd0066e30 0x7f2bd00692e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4000f60 tx=0x7f2bd4009040 comp rx=0 tx=0).stop 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 msgr2=0x7f2be41f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 0x7f2be41f19f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8014040 tx=0x7f2bd8004750 comp rx=0 tx=0).stop 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 shutdown_connections 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2be415a240 0x7f2be415e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bd0066e30 0x7f2bd00692e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2be40d11d0 0x7f2be40b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 --2- 172.21.15.172:0/779434732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2be40d3a30 0x7f2be41f19f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 >> 172.21.15.172:0/779434732 conn(0x7f2be40721f0 msgr2=0x7f2be406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:04.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 shutdown_connections 2023-03-27T10:10:04.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.099+0000 7f2bea9ff700 1 -- 172.21.15.172:0/779434732 wait complete. 2023-03-27T10:10:04.115 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.303+0000 7f7fdf1ff700 1 Processor -- start 2023-03-27T10:10:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.303+0000 7f7fdf1ff700 1 -- start start 2023-03-27T10:10:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.304+0000 7f7fdf1ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7fd80ce270 0x7f7fd80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.304+0000 7f7fdf1ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd806b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdf1ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd80cb940 con 0x7f7fd815c620 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdf1ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd80ce6e0 con 0x7f7fd80ce270 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdf1ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd806bc70 con 0x7f7fd806b2b0 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd806b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd806b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56276/0 (socket says 172.21.15.172:56276) 2023-03-27T10:10:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 -- 172.21.15.172:0/2344124961 learned_addr learned my addr 172.21.15.172:0/2344124961 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fd7fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7fd80ce270 0x7f7fd80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdcf9b700 1 --1- 172.21.15.172:0/2344124961 >> v1:172.21.15.191:6789/0 conn(0x7f7fd815c620 0x7f7fd80ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:48598/0 (socket says 172.21.15.172:48598) 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 -- 172.21.15.172:0/2344124961 >> v2:172.21.15.191:3300/0 conn(0x7f7fd80ce270 msgr2=0x7f7fd80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 --2- 172.21.15.172:0/2344124961 >> v2:172.21.15.191:3300/0 conn(0x7f7fd80ce270 0x7f7fd80cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fd77fe700 1 -- 172.21.15.172:0/2344124961 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631846987 0 0) 0x7f7fd80cb940 con 0x7f7fd815c620 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 -- 172.21.15.172:0/2344124961 >> v1:172.21.15.191:6789/0 conn(0x7f7fd815c620 legacy=0x7f7fd80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fdd79c700 1 -- 172.21.15.172:0/2344124961 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80cc780 con 0x7f7fd806b2b0 2023-03-27T10:10:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.305+0000 7f7fd7fff700 1 --2- 172.21.15.172:0/2344124961 >> v2:172.21.15.191:3300/0 conn(0x7f7fd80ce270 0x7f7fd80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.306+0000 7f7fdd79c700 1 --2- 172.21.15.172:0/2344124961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd806b730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009e50 tx=0x7f7fd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2122d46066bf2909 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.306+0000 7f7fd77fe700 1 -- 172.21.15.172:0/2344124961 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000e070 con 0x7f7fd806b2b0 2023-03-27T10:10:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.306+0000 7f7fd77fe700 1 -- 172.21.15.172:0/2344124961 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd000b910 con 0x7f7fd806b2b0 2023-03-27T10:10:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.306+0000 7f7fd77fe700 1 -- 172.21.15.172:0/2344124961 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000bcc0 con 0x7f7fd806b2b0 2023-03-27T10:10:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/2344124961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 msgr2=0x7f7fd806b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/2344124961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd806b730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009e50 tx=0x7f7fd000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/2344124961 shutdown_connections 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/2344124961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd806b730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/2344124961 >> v2:172.21.15.191:3300/0 conn(0x7f7fd80ce270 0x7f7fd80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/2344124961 >> 172.21.15.172:0/2344124961 conn(0x7f7fd8072230 msgr2=0x7f7fd806aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/2344124961 shutdown_connections 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.307+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/2344124961 wait complete. 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.309+0000 7f7fdf1ff700 1 Processor -- start 2023-03-27T10:10:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.309+0000 7f7fdf1ff700 1 -- start start 2023-03-27T10:10:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.310+0000 7f7fdf1ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd8156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.310+0000 7f7fdf1ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fd80ce270 0x7f7fd80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.310+0000 7f7fdf1ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 0x7f7fd80b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdf1ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80d0a00 con 0x7f7fd815c620 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdf1ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80b0ee0 con 0x7f7fd80ce270 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdf1ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80b11c0 con 0x7f7fd806b2b0 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 0x7f7fd80b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 0x7f7fd80b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41052/0 (socket says 172.21.15.172:41052) 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 -- 172.21.15.172:0/1859230089 learned_addr learned my addr 172.21.15.172:0/1859230089 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdcf9b700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd8156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fd7fff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fd80ce270 0x7f7fd80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 -- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 msgr2=0x7f7fd8156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd8156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 -- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fd80ce270 msgr2=0x7f7fd80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fd80ce270 0x7f7fd80b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 -- 172.21.15.172:0/1859230089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40094a0 con 0x7f7fd815c620 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdcf9b700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd8156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fd7fff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fd80ce270 0x7f7fd80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.311+0000 7f7fdd79c700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 0x7f7fd80b0370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b680 tx=0x7f7fd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.312+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00092e0 con 0x7f7fd815c620 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.312+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd001c440 con 0x7f7fd815c620 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.312+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd0009b30 con 0x7f7fd815c620 2023-03-27T10:10:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.312+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd001c810 con 0x7f7fd815c620 2023-03-27T10:10:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.312+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd80cbb70 con 0x7f7fd815c620 2023-03-27T10:10:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.313+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd815c9f0 con 0x7f7fd815c620 2023-03-27T10:10:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.314+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7fd0022030 con 0x7f7fd815c620 2023-03-27T10:10:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.315+0000 7f7fd57fa700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7fbc066e30 0x7f7fbc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.315+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fd0085ba0 con 0x7f7fd815c620 2023-03-27T10:10:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.315+0000 7f7fdcf9b700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7fbc066e30 0x7f7fbc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.316+0000 7f7fdcf9b700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7fbc066e30 0x7f7fbc0692e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc007fd0 tx=0x7f7fcc007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.319+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f7fd0052de0 con 0x7f7fd815c620 2023-03-27T10:10:04.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.506+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fd80cbe50 con 0x7f7fd815c620 2023-03-27T10:10:04.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.507+0000 7f7fd57fa700 1 -- 172.21.15.172:0/1859230089 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7fd0056400 con 0x7f7fd815c620 2023-03-27T10:10:04.506 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:04.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7fbc066e30 msgr2=0x7f7fbc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7fbc066e30 0x7f7fbc0692e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc007fd0 tx=0x7f7fcc007d80 comp rx=0 tx=0).stop 2023-03-27T10:10:04.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 msgr2=0x7f7fd80b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 0x7f7fd80b0370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b680 tx=0x7f7fd0004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 shutdown_connections 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd815c620 0x7f7fd80b0370 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fd806b2b0 0x7f7fd8156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7fbc066e30 0x7f7fbc0692e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 --2- 172.21.15.172:0/1859230089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fd80ce270 0x7f7fd80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.509+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 >> 172.21.15.172:0/1859230089 conn(0x7f7fd8072230 msgr2=0x7f7fd80b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.510+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 shutdown_connections 2023-03-27T10:10:04.509 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.510+0000 7f7fdf1ff700 1 -- 172.21.15.172:0/1859230089 wait complete. 2023-03-27T10:10:04.525 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:04.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.713+0000 7f67f81ff700 1 Processor -- start 2023-03-27T10:10:04.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.713+0000 7f67f81ff700 1 -- start start 2023-03-27T10:10:04.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f81ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f0072400 0x7f67f0160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f81ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f01463e0 con 0x7f67f006da00 2023-03-27T10:10:04.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f81ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f0160be0 con 0x7f67f006ab40 2023-03-27T10:10:04.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f81ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01611a0 con 0x7f67f0072400 2023-03-27T10:10:04.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f5f9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f67f006da00 0x7f67f006ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53134/0 (socket says 172.21.15.172:53134) 2023-03-27T10:10:04.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f5f9b700 1 -- 172.21.15.172:0/4100940228 learned_addr learned my addr 172.21.15.172:0/4100940228 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:04.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.714+0000 7f67f579a700 1 --2- 172.21.15.172:0/4100940228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f0072400 0x7f67f0160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195643104 0 0) 0x7f67f01463e0 con 0x7f67f006da00 2023-03-27T10:10:04.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67dc0035b0 con 0x7f67f006da00 2023-03-27T10:10:04.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542895536 0 0) 0x7f67f0160be0 con 0x7f67f006ab40 2023-03-27T10:10:04.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f01463e0 con 0x7f67f006ab40 2023-03-27T10:10:04.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f579a700 1 -- 172.21.15.172:0/4100940228 >> v1:172.21.15.191:6789/0 conn(0x7f67f006ab40 legacy=0x7f67f015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f579a700 1 -- 172.21.15.172:0/4100940228 >> v1:172.21.15.172:6789/0 conn(0x7f67f006da00 legacy=0x7f67f006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f579a700 1 -- 172.21.15.172:0/4100940228 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0160ec0 con 0x7f67f0072400 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f579a700 1 --2- 172.21.15.172:0/4100940228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f0072400 0x7f67f0160270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009870 tx=0x7f67e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0c2de681038dc2 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.715+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011830 con 0x7f67f0072400 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0011990 con 0x7f67f0072400 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f4f99700 1 -- 172.21.15.172:0/4100940228 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0011d20 con 0x7f67f0072400 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 -- 172.21.15.172:0/4100940228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f0072400 msgr2=0x7f67f0160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 --2- 172.21.15.172:0/4100940228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f0072400 0x7f67f0160270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009870 tx=0x7f67e0009b80 comp rx=0 tx=0).stop 2023-03-27T10:10:04.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 -- 172.21.15.172:0/4100940228 shutdown_connections 2023-03-27T10:10:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 --2- 172.21.15.172:0/4100940228 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f0072400 0x7f67f0160270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 -- 172.21.15.172:0/4100940228 >> 172.21.15.172:0/4100940228 conn(0x7f67f00b1010 msgr2=0x7f67f00b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 -- 172.21.15.172:0/4100940228 shutdown_connections 2023-03-27T10:10:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.716+0000 7f67f81ff700 1 -- 172.21.15.172:0/4100940228 wait complete. 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.718+0000 7f67f81ff700 1 Processor -- start 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.718+0000 7f67f81ff700 1 -- start start 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f81ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f006ab40 0x7f67f0130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f81ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f006da00 0x7f67f015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f81ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 0x7f67f00ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f81ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0131360 con 0x7f67f0072400 2023-03-27T10:10:04.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f81ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0131640 con 0x7f67f006da00 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f81ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0131920 con 0x7f67f006ab40 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f679c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 0x7f67f00ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f679c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 0x7f67f00ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41066/0 (socket says 172.21.15.172:41066) 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f679c700 1 -- 172.21.15.172:0/554247781 learned_addr learned my addr 172.21.15.172:0/554247781 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f5f9b700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f006ab40 0x7f67f0130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.719+0000 7f67f579a700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f006da00 0x7f67f015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f679c700 1 -- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f006ab40 msgr2=0x7f67f0130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f679c700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f006ab40 0x7f67f0130b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f679c700 1 -- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f006da00 msgr2=0x7f67f015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f679c700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f006da00 0x7f67f015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f679c700 1 -- 172.21.15.172:0/554247781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00094a0 con 0x7f67f0072400 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f679c700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 0x7f67f00ada20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e800cc20 tx=0x7f67e800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8003c00 con 0x7f67f0072400 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8003d60 con 0x7f67f0072400 2023-03-27T10:10:04.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f006a620 con 0x7f67f0072400 2023-03-27T10:10:04.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e800aae0 con 0x7f67f0072400 2023-03-27T10:10:04.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.720+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f006a340 con 0x7f67f0072400 2023-03-27T10:10:04.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.721+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f01607b0 con 0x7f67f0072400 2023-03-27T10:10:04.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.722+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f67e8010050 con 0x7f67f0072400 2023-03-27T10:10:04.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.723+0000 7f67e67fc700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f67d4066e30 0x7f67d40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:04.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.723+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67e8084260 con 0x7f67f0072400 2023-03-27T10:10:04.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.723+0000 7f67f5f9b700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f67d4066e30 0x7f67d40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:04.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.724+0000 7f67f5f9b700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f67d4066e30 0x7f67d40692e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67ec007fd0 tx=0x7f67ec007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:04.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.727+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f67e8051410 con 0x7f67f0072400 2023-03-27T10:10:04.913 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.915+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67f00ce3e0 con 0x7f67f0072400 2023-03-27T10:10:04.914 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.916+0000 7f67e67fc700 1 -- 172.21.15.172:0/554247781 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67f00ce3e0 con 0x7f67f0072400 2023-03-27T10:10:04.914 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:04.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f67d4066e30 msgr2=0x7f67d40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f67d4066e30 0x7f67d40692e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67ec007fd0 tx=0x7f67ec007dc0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 msgr2=0x7f67f00ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:04.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 0x7f67f00ada20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f67e800cc20 tx=0x7f67e800cf30 comp rx=0 tx=0).stop 2023-03-27T10:10:04.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 shutdown_connections 2023-03-27T10:10:04.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0072400 0x7f67f00ada20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67f006ab40 0x7f67f0130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f67d4066e30 0x7f67d40692e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 --2- 172.21.15.172:0/554247781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67f006da00 0x7f67f015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:04.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 >> 172.21.15.172:0/554247781 conn(0x7f67f00b1010 msgr2=0x7f67f00b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:04.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 shutdown_connections 2023-03-27T10:10:04.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:04.918+0000 7f67f81ff700 1 -- 172.21.15.172:0/554247781 wait complete. 2023-03-27T10:10:04.934 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:10:05.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.119+0000 7f217efff700 1 Processor -- start 2023-03-27T10:10:05.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.119+0000 7f217efff700 1 -- start start 2023-03-27T10:10:05.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.120+0000 7f217efff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f217806b0e0 0x7f217806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.120+0000 7f217efff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780c60e0 con 0x7f21780aeb50 2023-03-27T10:10:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.120+0000 7f217efff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780c63c0 con 0x7f21780712d0 2023-03-27T10:10:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.120+0000 7f217efff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217806c2a0 con 0x7f217806b0e0 2023-03-27T10:10:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.120+0000 7f217cd9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f217806b0e0 0x7f217806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f2177fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f21780aeb50 0x7f2178070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:53138/0 (socket says 172.21.15.172:53138) 2023-03-27T10:10:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f2177fff700 1 -- 172.21.15.172:0/3838972844 learned_addr learned my addr 172.21.15.172:0/3838972844 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:05.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f217cd9b700 1 -- 172.21.15.172:0/3838972844 >> v1:172.21.15.191:6789/0 conn(0x7f21780712d0 legacy=0x7f21780ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f217cd9b700 1 -- 172.21.15.172:0/3838972844 >> v1:172.21.15.172:6789/0 conn(0x7f21780aeb50 legacy=0x7f2178070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f217cd9b700 1 -- 172.21.15.172:0/3838972844 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780c66a0 con 0x7f217806b0e0 2023-03-27T10:10:05.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f21777fe700 1 -- 172.21.15.172:0/3838972844 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655539728 0 0) 0x7f21780c60e0 con 0x7f21780aeb50 2023-03-27T10:10:05.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f217cd9b700 1 --2- 172.21.15.172:0/3838972844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f217806b0e0 0x7f217806a1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f216c009840 tx=0x7f216c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2409817f4b742e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f21777fe700 1 -- 172.21.15.172:0/3838972844 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c011830 con 0x7f217806b0e0 2023-03-27T10:10:05.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.121+0000 7f21777fe700 1 -- 172.21.15.172:0/3838972844 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c011990 con 0x7f217806b0e0 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f21777fe700 1 -- 172.21.15.172:0/3838972844 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c011d20 con 0x7f217806b0e0 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 -- 172.21.15.172:0/3838972844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f217806b0e0 msgr2=0x7f217806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 --2- 172.21.15.172:0/3838972844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f217806b0e0 0x7f217806a1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f216c009840 tx=0x7f216c009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 -- 172.21.15.172:0/3838972844 shutdown_connections 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 --2- 172.21.15.172:0/3838972844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f217806b0e0 0x7f217806a1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 -- 172.21.15.172:0/3838972844 >> 172.21.15.172:0/3838972844 conn(0x7f21780cc830 msgr2=0x7f21780ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 -- 172.21.15.172:0/3838972844 shutdown_connections 2023-03-27T10:10:05.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.122+0000 7f217efff700 1 -- 172.21.15.172:0/3838972844 wait complete. 2023-03-27T10:10:05.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.124+0000 7f217efff700 1 Processor -- start 2023-03-27T10:10:05.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.124+0000 7f217efff700 1 -- start start 2023-03-27T10:10:05.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217efff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f217806b0e0 0x7f21780b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217efff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21780712d0 0x7f21781dd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217efff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 0x7f217806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217efff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780b3ff0 con 0x7f21780aeb50 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217efff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21781dded0 con 0x7f217806b0e0 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217efff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21781e72b0 con 0x7f21780712d0 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.125+0000 7f217d59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 0x7f217806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 0x7f217806b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41090/0 (socket says 172.21.15.172:41090) 2023-03-27T10:10:05.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 -- 172.21.15.172:0/761332783 learned_addr learned my addr 172.21.15.172:0/761332783 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217cd9b700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f217806b0e0 0x7f21780b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f2177fff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21780712d0 0x7f21781dd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 -- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21780712d0 msgr2=0x7f21781dd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21780712d0 0x7f21781dd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 -- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f217806b0e0 msgr2=0x7f21780b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f217806b0e0 0x7f21780b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 -- 172.21.15.172:0/761332783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0094a0 con 0x7f21780aeb50 2023-03-27T10:10:05.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217d59c700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 0x7f217806b4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f217000cc50 tx=0x7f217000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000ad80 con 0x7f21780aeb50 2023-03-27T10:10:05.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000ce50 con 0x7f21780aeb50 2023-03-27T10:10:05.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170003c40 con 0x7f21780aeb50 2023-03-27T10:10:05.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217806a6e0 con 0x7f21780aeb50 2023-03-27T10:10:05.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.126+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21780c6980 con 0x7f21780aeb50 2023-03-27T10:10:05.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.127+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21780c5d90 con 0x7f21780aeb50 2023-03-27T10:10:05.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.128+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f2170010050 con 0x7f21780aeb50 2023-03-27T10:10:05.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.130+0000 7f21757fa700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f215c066e30 0x7f215c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.130+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2170084290 con 0x7f21780aeb50 2023-03-27T10:10:05.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.130+0000 7f217cd9b700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f215c066e30 0x7f215c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.131+0000 7f217cd9b700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f215c066e30 0x7f215c0692e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f216c000c00 tx=0x7f216c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.134+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f21700514d0 con 0x7f21780aeb50 2023-03-27T10:10:05.363 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.365+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21780b4130 con 0x7f21780aeb50 2023-03-27T10:10:05.364 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.365+0000 7f21757fa700 1 -- 172.21.15.172:0/761332783 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4624 (secure 0 0 0) 0x7f21780b4130 con 0x7f21780aeb50 2023-03-27T10:10:05.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:05.365 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:09:52.070050+0000","modified":"2023-03-27T10:09:55.094484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-27T10:10:05.367 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f215c066e30 msgr2=0x7f215c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.367 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f215c066e30 0x7f215c0692e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f216c000c00 tx=0x7f216c01c040 comp rx=0 tx=0).stop 2023-03-27T10:10:05.367 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 msgr2=0x7f217806b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 0x7f217806b4b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f217000cc50 tx=0x7f217000a340 comp rx=0 tx=0).stop 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 shutdown_connections 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21780aeb50 0x7f217806b4b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f215c066e30 0x7f215c0692e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f217806b0e0 0x7f21780b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 --2- 172.21.15.172:0/761332783 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21780712d0 0x7f21781dd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 >> 172.21.15.172:0/761332783 conn(0x7f21780cc830 msgr2=0x7f21780ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:05.369 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 shutdown_connections 2023-03-27T10:10:05.369 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.368+0000 7f217efff700 1 -- 172.21.15.172:0/761332783 wait complete. 2023-03-27T10:10:05.369 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2023-03-27T10:10:05.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-27T10:09:52.070050+0000', 'modified': '2023-03-27T10:09:55.094484+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6835/4073767112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6833', 'nonce': 4073767112}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 4073767112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-27T10:10:05.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-27T10:10:05.787 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-27T10:10:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.973+0000 7f7281dff700 1 Processor -- start 2023-03-27T10:10:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.973+0000 7f7281dff700 1 -- start start 2023-03-27T10:10:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.974+0000 7f7281dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f727c15a240 0x7f727c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.974+0000 7f7281dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f727c0d3a30 0x7f727c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.974+0000 7f7281dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c1604b0 0x7f727c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.974+0000 7f7281dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c161200 con 0x7f727c0d3a30 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7281dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c0d29d0 con 0x7f727c15a240 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7281dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c15a610 con 0x7f727c1604b0 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f727c0d3a30 0x7f727c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f727c0d3a30 0x7f727c0d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41092/0 (socket says 172.21.15.172:41092) 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 -- 172.21.15.172:0/3716662399 learned_addr learned my addr 172.21.15.172:0/3716662399 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f727b7fe700 1 --2- 172.21.15.172:0/3716662399 >> v2:172.21.15.191:3300/0 conn(0x7f727c15a240 0x7f727c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f727bfff700 1 --2- 172.21.15.172:0/3716662399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c1604b0 0x7f727c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 -- 172.21.15.172:0/3716662399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c1604b0 msgr2=0x7f727c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 --2- 172.21.15.172:0/3716662399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c1604b0 0x7f727c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 -- 172.21.15.172:0/3716662399 >> v2:172.21.15.191:3300/0 conn(0x7f727c15a240 msgr2=0x7f727c0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 --2- 172.21.15.172:0/3716662399 >> v2:172.21.15.191:3300/0 conn(0x7f727c15a240 0x7f727c0d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.975+0000 7f7273fff700 1 -- 172.21.15.172:0/3716662399 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0d2c70 con 0x7f727c0d3a30 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7273fff700 1 --2- 172.21.15.172:0/3716662399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c0d3a30 0x7f727c0d1000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f727c0d09b0 tx=0x7f7264009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5522ca176b22bb server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f727affd700 1 -- 172.21.15.172:0/3716662399 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264011830 con 0x7f727c0d3a30 2023-03-27T10:10:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f727affd700 1 -- 172.21.15.172:0/3716662399 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264011990 con 0x7f727c0d3a30 2023-03-27T10:10:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f727affd700 1 -- 172.21.15.172:0/3716662399 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264011d20 con 0x7f727c0d3a30 2023-03-27T10:10:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 -- 172.21.15.172:0/3716662399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c0d3a30 msgr2=0x7f727c0d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 --2- 172.21.15.172:0/3716662399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c0d3a30 0x7f727c0d1000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f727c0d09b0 tx=0x7f7264009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 -- 172.21.15.172:0/3716662399 shutdown_connections 2023-03-27T10:10:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 --2- 172.21.15.172:0/3716662399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c1604b0 0x7f727c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 --2- 172.21.15.172:0/3716662399 >> v2:172.21.15.191:3300/0 conn(0x7f727c15a240 0x7f727c0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 --2- 172.21.15.172:0/3716662399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c0d3a30 0x7f727c0d1000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 -- 172.21.15.172:0/3716662399 >> 172.21.15.172:0/3716662399 conn(0x7f727c0721f0 msgr2=0x7f727c09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.976+0000 7f7281dff700 1 -- 172.21.15.172:0/3716662399 shutdown_connections 2023-03-27T10:10:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.977+0000 7f7281dff700 1 -- 172.21.15.172:0/3716662399 wait complete. 2023-03-27T10:10:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.978+0000 7f7281dff700 1 Processor -- start 2023-03-27T10:10:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.978+0000 7f7281dff700 1 -- start start 2023-03-27T10:10:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7281dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c0d3a30 0x7f727c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7281dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 0x7f727c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7281dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727c1604b0 0x7f727c0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7281dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b6050 con 0x7f727c15a240 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7281dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b6330 con 0x7f727c1604b0 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7281dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b6610 con 0x7f727c0d3a30 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 0x7f727c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 0x7f727c0b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41094/0 (socket says 172.21.15.172:41094) 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.979+0000 7f7273fff700 1 -- 172.21.15.172:0/2523081967 learned_addr learned my addr 172.21.15.172:0/2523081967 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:05.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c0d3a30 0x7f727c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f727bfff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727c1604b0 0x7f727c0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7273fff700 1 -- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c0d3a30 msgr2=0x7f727c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7273fff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c0d3a30 0x7f727c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7273fff700 1 -- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727c1604b0 msgr2=0x7f727c0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7273fff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727c1604b0 0x7f727c0b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7273fff700 1 -- 172.21.15.172:0/2523081967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009550 con 0x7f727c15a240 2023-03-27T10:10:05.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c0d3a30 0x7f727c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f727bfff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727c1604b0 0x7f727c0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7273fff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 0x7f727c0b7120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7264000c00 tx=0x7f7264004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7278ff9700 1 -- 172.21.15.172:0/2523081967 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264004300 con 0x7f727c15a240 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7278ff9700 1 -- 172.21.15.172:0/2523081967 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726401f070 con 0x7f727c15a240 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0d3230 con 0x7f727c15a240 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7278ff9700 1 -- 172.21.15.172:0/2523081967 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640036a0 con 0x7f727c15a240 2023-03-27T10:10:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.980+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0d2f50 con 0x7f727c15a240 2023-03-27T10:10:05.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.983+0000 7f7278ff9700 1 -- 172.21.15.172:0/2523081967 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f726402a020 con 0x7f727c15a240 2023-03-27T10:10:05.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.983+0000 7f7278ff9700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f725c066e30 0x7f725c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.983+0000 7f7278ff9700 1 -- 172.21.15.172:0/2523081967 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72640856d0 con 0x7f727c15a240 2023-03-27T10:10:05.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.984+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f725c066e30 0x7f725c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.985+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f725c066e30 0x7f725c0692e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f727c0c7270 tx=0x7f726c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.985+0000 7f7295650b80 1 Processor -- start 2023-03-27T10:10:05.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 -- start start 2023-03-27T10:10:05.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe032150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe04c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe04cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fdef0c40 con 0x5627fe0052b0 2023-03-27T10:10:05.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fdf5fbb0 con 0x5627fe007ef0 2023-03-27T10:10:05.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.986+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627fdf58f20 con 0x5627fe031d80 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe04c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe04c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41104/0 (socket says 172.21.15.172:41104) 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 -- 172.21.15.172:0/1313991151 learned_addr learned my addr 172.21.15.172:0/1313991151 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f727b7fe700 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe032150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f727bfff700 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe04cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 -- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 msgr2=0x5627fe032150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe032150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 -- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 msgr2=0x5627fe04cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe04cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 -- 172.21.15.172:0/1313991151 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627fdd4d540 con 0x5627fe0052b0 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f7273fff700 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe04c5f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7264056190 tx=0x7f72640561c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb245a5452d9a7e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f72717fa700 1 -- 172.21.15.172:0/1313991151 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726405db90 con 0x5627fe0052b0 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f72717fa700 1 -- 172.21.15.172:0/1313991151 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264055ac0 con 0x5627fe0052b0 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.987+0000 7f72717fa700 1 -- 172.21.15.172:0/1313991151 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726405d700 con 0x5627fe0052b0 2023-03-27T10:10:05.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 -- 172.21.15.172:0/1313991151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 msgr2=0x5627fe04c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe04c5f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7264056190 tx=0x7f72640561c0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 -- 172.21.15.172:0/1313991151 shutdown_connections 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe04cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe032150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 --2- 172.21.15.172:0/1313991151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe04c5f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 -- 172.21.15.172:0/1313991151 >> 172.21.15.172:0/1313991151 conn(0x5627fdffc840 msgr2=0x5627fe001d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 -- 172.21.15.172:0/1313991151 shutdown_connections 2023-03-27T10:10:05.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.988+0000 7f7295650b80 1 -- 172.21.15.172:0/1313991151 wait complete. 2023-03-27T10:10:05.993 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.989+0000 7f7295650b80 1 -- start start 2023-03-27T10:10:05.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.989+0000 7f7295650b80 1 Processor -- start 2023-03-27T10:10:05.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe0052b0 0x5627fe04d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe007750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe050010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fdd4e140 con 0x5627fe007ef0 2023-03-27T10:10:05.994 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fe0354e0 con 0x5627fe0052b0 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627fe04c900 con 0x5627fe031d80 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7295650b80 10 client.0 _ll_register_callbacks cb 0x5627fdf61450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe007750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe007750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41112/0 (socket says 172.21.15.172:41112) 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.990+0000 7f7273fff700 1 -- 172.21.15.172:0/3080142347 learned_addr learned my addr 172.21.15.172:0/3080142347 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f727b7fe700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe0052b0 0x5627fe04d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f727bfff700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe050010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.995 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7273fff700 1 -- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 msgr2=0x5627fe050010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7273fff700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe050010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7273fff700 1 -- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe0052b0 msgr2=0x5627fe04d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7273fff700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe0052b0 0x5627fe04d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7273fff700 1 -- 172.21.15.172:0/3080142347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0d2f50 con 0x5627fe007ef0 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f727b7fe700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe0052b0 0x5627fe04d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f727bfff700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe050010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:05.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7273fff700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe007750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7264009c10 tx=0x7f726406c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d142ec233c31d3e7 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f725a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f725a7fc700 1 -- 172.21.15.172:0/3080142347 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264062070 con 0x5627fe007ef0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f725a7fc700 1 -- 172.21.15.172:0/3080142347 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f726405db90 con 0x5627fe007ef0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627fdff9e50 con 0x5627fe007ef0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f725a7fc700 1 -- 172.21.15.172:0/3080142347 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7264055c30 con 0x5627fe007ef0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7295650b80 10 client.4629 fetch_fsmap learned FSMap version 8 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.991+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5627fdd87b10 con 0x5627fe007ef0 2023-03-27T10:10:05.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f725a7fc700 1 -- 172.21.15.172:0/3080142347 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627fdff9e50 con 0x5627fe007ef0 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f725a7fc700 1 -- 172.21.15.172:0/3080142347 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f726405d700 con 0x5627fe007ef0 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f7295650b80 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f7295650b80 10 client.4629 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f7295650b80 20 client.4629 populate_metadata read hostname 'smithi172' 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f7295650b80 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe005b80 0x5627fe005f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f7295650b80 4 client.4629 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 --> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627fdfd6ae0 con 0x5627fe005b80 2023-03-27T10:10:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f727b7fe700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe005b80 0x5627fe005f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f725a7fc700 10 client.4629 ms_handle_connect on v2:172.21.15.172:6833/4073767112 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.992+0000 7f727b7fe700 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe005b80 0x5627fe005f50 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78cf4db500b21b3 server_cookie=bc99bdbc308b1ca3 in_seq=0 out_seq=0 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f725a7fc700 1 -- 172.21.15.172:0/3080142347 <== mds.0 v2:172.21.15.172:6833/4073767112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x5627fdfd6ae0 con 0x5627fe005b80 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f725a7fc700 10 client.4629 handle_command_reply: tid=0 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f7295650b80 1 client.4629 shutdown 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 msgr2=0x5627fe007750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f7295650b80 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe007750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7264009c10 tx=0x7f726406c000 comp rx=0 tx=0).stop 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 shutdown_connections 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.993+0000 7f7295650b80 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe005b80 0x5627fe005f50 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe050010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe0052b0 0x5627fe04d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f725a7fc700 0 client.4629 ms_handle_reset on v2:172.21.15.172:6833/4073767112 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 1 --2- 172.21.15.172:0/3080142347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe007750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 >> 172.21.15.172:0/3080142347 conn(0x5627fdffc840 msgr2=0x5627fe003bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:06.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 shutdown_connections 2023-03-27T10:10:06.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 1 -- 172.21.15.172:0/3080142347 wait complete. 2023-03-27T10:10:06.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:05.994+0000 7f7295650b80 20 client.4629 trim_cache size 0 max 16384 2023-03-27T10:10:06.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.011+0000 7f7295650b80 1 Processor -- start 2023-03-27T10:10:06.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.011+0000 7f7295650b80 1 -- start start 2023-03-27T10:10:06.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f7295650b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe01bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe0654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe065a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f7295650b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fe035020 con 0x5627fe0052b0 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fe007c00 con 0x5627fe007ef0 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627fe034430 con 0x5627fe031d80 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe01bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe01bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41118/0 (socket says 172.21.15.172:41118) 2023-03-27T10:10:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.012+0000 7f727b7fe700 1 -- 172.21.15.172:0/2576641703 learned_addr learned my addr 172.21.15.172:0/2576641703 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f7273fff700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe0654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727bfff700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727b7fe700 1 -- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 msgr2=0x5627fe065a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe065a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727b7fe700 1 -- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 msgr2=0x5627fe0654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe0654c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727b7fe700 1 -- 172.21.15.172:0/2576641703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627fdf20230 con 0x5627fe0052b0 2023-03-27T10:10:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f7273fff700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe0654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727bfff700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe065a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f727b7fe700 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe01bbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f726c011ba0 tx=0x7f726c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2565cc836714d086 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f7271ffb700 1 -- 172.21.15.172:0/2576641703 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c028040 con 0x5627fe0052b0 2023-03-27T10:10:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f7271ffb700 1 -- 172.21.15.172:0/2576641703 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c029240 con 0x5627fe0052b0 2023-03-27T10:10:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.013+0000 7f7271ffb700 1 -- 172.21.15.172:0/2576641703 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c015de0 con 0x5627fe0052b0 2023-03-27T10:10:06.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 -- 172.21.15.172:0/2576641703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 msgr2=0x5627fe01bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe01bbf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f726c011ba0 tx=0x7f726c017000 comp rx=0 tx=0).stop 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 -- 172.21.15.172:0/2576641703 shutdown_connections 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe031d80 0x5627fe065a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe0052b0 0x5627fe01bbf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 --2- 172.21.15.172:0/2576641703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe007ef0 0x5627fe0654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 -- 172.21.15.172:0/2576641703 >> 172.21.15.172:0/2576641703 conn(0x5627fdffc840 msgr2=0x5627fe003bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 -- 172.21.15.172:0/2576641703 shutdown_connections 2023-03-27T10:10:06.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 -- 172.21.15.172:0/2576641703 wait complete. 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.014+0000 7f7295650b80 1 -- start start 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.015+0000 7f7295650b80 1 Processor -- start 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe0052b0 0x5627fe09ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe042520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe031d80 0x5627fe003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fe0b1d20 con 0x5627fe007ef0 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627fe0b4f50 con 0x5627fe031d80 2023-03-27T10:10:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627fe0b51a0 con 0x5627fe0052b0 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7295650b80 10 client.0 _ll_register_callbacks cb 0x7f7274009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe042520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe042520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41134/0 (socket says 172.21.15.172:41134) 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 -- 172.21.15.172:0/1428642429 learned_addr learned my addr 172.21.15.172:0/1428642429 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f727bfff700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe031d80 0x5627fe003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f727b7fe700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe0052b0 0x5627fe09ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 -- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe0052b0 msgr2=0x5627fe09ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe0052b0 0x5627fe09ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 -- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe031d80 msgr2=0x5627fe003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe031d80 0x5627fe003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 -- 172.21.15.172:0/1428642429 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c011dd0 con 0x5627fe007ef0 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f7273fff700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe042520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5627fdfcd460 tx=0x7f7264085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddc067f38ef8cd3 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.016+0000 7f725a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f725a7fc700 1 -- 172.21.15.172:0/1428642429 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264052490 con 0x5627fe007ef0 2023-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f725a7fc700 1 -- 172.21.15.172:0/1428642429 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72640525f0 con 0x5627fe007ef0 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7264055ac0 con 0x5627fe007ef0 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f725a7fc700 1 -- 172.21.15.172:0/1428642429 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7264055530 con 0x5627fe007ef0 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 10 client.4635 fetch_fsmap learned FSMap version 8 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5627fdd70990 con 0x5627fe007ef0 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f725a7fc700 1 -- 172.21.15.172:0/1428642429 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264036020 con 0x5627fe007ef0 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f725a7fc700 1 -- 172.21.15.172:0/1428642429 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7264055690 con 0x5627fe007ef0 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2023-03-27T10:10:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 10 client.4635 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 20 client.4635 populate_metadata read hostname 'smithi172' 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe0042d0 0x5627fe02e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 4 client.4635 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 --> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5627fdf52100 con 0x5627fe0042d0 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.017+0000 7f727b7fe700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe0042d0 0x5627fe02e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f727b7fe700 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe0042d0 0x5627fe02e3e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27510f50d8454a65 server_cookie=8cec9ef4d1bfadeb in_seq=0 out_seq=0 2023-03-27T10:10:06.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f725a7fc700 10 client.4635 ms_handle_connect on v2:172.21.15.172:6833/4073767112 2023-03-27T10:10:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f725a7fc700 1 -- 172.21.15.172:0/1428642429 <== mds.0 v2:172.21.15.172:6833/4073767112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5627fdf52100 con 0x5627fe0042d0 2023-03-27T10:10:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f725a7fc700 10 client.4635 handle_command_reply: tid=0 2023-03-27T10:10:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 client.4635 shutdown 2023-03-27T10:10:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 msgr2=0x5627fe042520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe042520 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x5627fdfcd460 tx=0x7f7264085040 comp rx=0 tx=0).stop 2023-03-27T10:10:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 shutdown_connections 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:6833/4073767112,v1:172.21.15.172:6835/4073767112] conn(0x5627fe0042d0 0x5627fe02e3e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627fe031d80 0x5627fe003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f725a7fc700 0 client.4635 ms_handle_reset on v2:172.21.15.172:6833/4073767112 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627fe0052b0 0x5627fe09ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 --2- 172.21.15.172:0/1428642429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe007ef0 0x5627fe042520 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 >> 172.21.15.172:0/1428642429 conn(0x5627fdffc840 msgr2=0x5627fe033240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 shutdown_connections 2023-03-27T10:10:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.018+0000 7f7295650b80 1 -- 172.21.15.172:0/1428642429 wait complete. 2023-03-27T10:10:06.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7295650b80 20 client.4635 trim_cache size 0 max 16384 2023-03-27T10:10:06.026 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-03-27T10:10:06.026 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "b9fe5031-957d-4f6c-a6ac-e7da3c176686", 2023-03-27T10:10:06.026 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4290, 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 13.946181433, 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 8, 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 24, 2023-03-27T10:10:06.027 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 24, 2023-03-27T10:10:06.028 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 19.746012188000002 2023-03-27T10:10:06.028 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-03-27T10:10:06.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f725c066e30 msgr2=0x7f725c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f725c066e30 0x7f725c0692e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f727c0c7270 tx=0x7f726c008040 comp rx=0 tx=0).stop 2023-03-27T10:10:06.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 msgr2=0x7f727c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 0x7f727c0b7120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7264000c00 tx=0x7f7264004750 comp rx=0 tx=0).stop 2023-03-27T10:10:06.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 shutdown_connections 2023-03-27T10:10:06.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f725c066e30 0x7f725c0692e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f727c1604b0 0x7f727c0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f727c0d3a30 0x7f727c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 --2- 172.21.15.172:0/2523081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c15a240 0x7f727c0b7120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 >> 172.21.15.172:0/2523081967 conn(0x7f727c0721f0 msgr2=0x7f727c15f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:06.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 shutdown_connections 2023-03-27T10:10:06.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.019+0000 7f7281dff700 1 -- 172.21.15.172:0/2523081967 wait complete. 2023-03-27T10:10:06.034 INFO:teuthology.run_tasks:Running task kclient... 2023-03-27T10:10:06.058 INFO:tasks.kclient:Mounting kernel clients... 2023-03-27T10:10:06.058 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-03-27T10:10:06.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.059 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-03-27T10:10:06.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.103 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-03-27T10:10:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-03-27T10:10:06.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T10:10:06.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.211 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-03-27T10:10:06.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-03-27T10:10:06.358 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-03-27T10:10:06.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T10:10:06.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.361 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-27T10:10:06.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-03-27T10:10:06.477 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2023-03-27T10:10:06.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T10:10:06.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.480 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-27T10:10:06.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:06.527 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-03-27T10:10:06.592 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2023-03-27T10:10:06.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T10:10:06.595 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-03-27T10:10:06.595 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-27T10:10:06.596 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-27T10:10:06.596 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-27T10:10:06.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.782+0000 7faaf93ff700 1 Processor -- start 2023-03-27T10:10:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.782+0000 7faaf93ff700 1 -- start start 2023-03-27T10:10:06.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.783+0000 7faaf93ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faaf40cd760 0x7faaf40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.783+0000 7faaf93ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faaf415c8f0 0x7faaf406f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.783+0000 7faaf93ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40cb3a0 con 0x7faaf40b27d0 2023-03-27T10:10:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.783+0000 7faaf93ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf406b9a0 con 0x7faaf40cd760 2023-03-27T10:10:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.783+0000 7faaf93ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf4070220 con 0x7faaf415c8f0 2023-03-27T10:10:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.783+0000 7faaf2ffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faaf40cd760 0x7faaf40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faaf40cd760 0x7faaf40cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46736/0 (socket says 172.21.15.172:46736) 2023-03-27T10:10:06.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 -- 172.21.15.172:0/868560472 learned_addr learned my addr 172.21.15.172:0/868560472 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:06.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf27fc700 1 --2- 172.21.15.172:0/868560472 >> v2:172.21.15.191:3300/0 conn(0x7faaf415c8f0 0x7faaf406f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 -- 172.21.15.172:0/868560472 >> v2:172.21.15.191:3300/0 conn(0x7faaf415c8f0 msgr2=0x7faaf406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 --2- 172.21.15.172:0/868560472 >> v2:172.21.15.191:3300/0 conn(0x7faaf415c8f0 0x7faaf406f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 -- 172.21.15.172:0/868560472 >> v1:172.21.15.191:6789/0 conn(0x7faaf40b27d0 legacy=0x7faaf40b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 -- 172.21.15.172:0/868560472 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40ce070 con 0x7faaf40cd760 2023-03-27T10:10:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf2ffd700 1 --2- 172.21.15.172:0/868560472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf40cdb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faaf40ce420 tx=0x7faae4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d7cd0a5c5175ec server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:06.786 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.784+0000 7faaf1ffb700 1 -- 172.21.15.172:0/868560472 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011830 con 0x7faaf40cd760 2023-03-27T10:10:06.786 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf1ffb700 1 -- 172.21.15.172:0/868560472 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae4011990 con 0x7faaf40cd760 2023-03-27T10:10:06.786 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf1ffb700 1 -- 172.21.15.172:0/868560472 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae4011d20 con 0x7faaf40cd760 2023-03-27T10:10:06.786 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 -- 172.21.15.172:0/868560472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 msgr2=0x7faaf40cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.786 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 --2- 172.21.15.172:0/868560472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf40cdb30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faaf40ce420 tx=0x7faae4009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 -- 172.21.15.172:0/868560472 shutdown_connections 2023-03-27T10:10:06.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 --2- 172.21.15.172:0/868560472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf40cdb30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 --2- 172.21.15.172:0/868560472 >> v2:172.21.15.191:3300/0 conn(0x7faaf415c8f0 0x7faaf406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 -- 172.21.15.172:0/868560472 >> 172.21.15.172:0/868560472 conn(0x7faaf406dd60 msgr2=0x7faaf406e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:06.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 -- 172.21.15.172:0/868560472 shutdown_connections 2023-03-27T10:10:06.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.785+0000 7faaf93ff700 1 -- 172.21.15.172:0/868560472 wait complete. 2023-03-27T10:10:06.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.787+0000 7faaf93ff700 1 Processor -- start 2023-03-27T10:10:06.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.787+0000 7faaf93ff700 1 -- start start 2023-03-27T10:10:06.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf93ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faaf40b27d0 0x7faaf40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf93ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf93ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaf415c8f0 0x7faaf40ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf93ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40b3f40 con 0x7faaf40cd760 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf93ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40b4e10 con 0x7faaf415c8f0 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf93ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40b67f0 con 0x7faaf40b27d0 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf41546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46752/0 (socket says 172.21.15.172:46752) 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 -- 172.21.15.172:0/1675508606 learned_addr learned my addr 172.21.15.172:0/1675508606 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:06.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf37fe700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaf415c8f0 0x7faaf40ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf2ffd700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faaf40b27d0 0x7faaf40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 -- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faaf40b27d0 msgr2=0x7faaf40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faaf40b27d0 0x7faaf40ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 -- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaf415c8f0 msgr2=0x7faaf40ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.788+0000 7faaf27fc700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaf415c8f0 0x7faaf40ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faaf27fc700 1 -- 172.21.15.172:0/1675508606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4009550 con 0x7faaf40cd760 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faaf37fe700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaf415c8f0 0x7faaf40ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faaf27fc700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf41546e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faae800e9b0 tx=0x7faae800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8009710 con 0x7faaf40cd760 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae800c850 con 0x7faaf40cd760 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800cc00 con 0x7faaf40cd760 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf40d0a90 con 0x7faaf40cd760 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.789+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40d07b0 con 0x7faaf40cd760 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.790+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf406b350 con 0x7faaf40cd760 2023-03-27T10:10:06.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.791+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7faae8019030 con 0x7faaf40cd760 2023-03-27T10:10:06.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.792+0000 7faadb7fe700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7faae0066e30 0x7faae00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:06.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.793+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faae8084230 con 0x7faaf40cd760 2023-03-27T10:10:06.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.793+0000 7faaf2ffd700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7faae0066e30 0x7faae00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:06.795 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.794+0000 7faaf2ffd700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7faae0066e30 0x7faae00692e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faae4014040 tx=0x7faae4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:06.795 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:06.797+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7faae8051470 con 0x7faaf40cd760 2023-03-27T10:10:07.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.025+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faaf40b6ad0 con 0x7faaf40cd760 2023-03-27T10:10:07.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.026+0000 7faadb7fe700 1 -- 172.21.15.172:0/1675508606 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7faae8054a90 con 0x7faaf40cd760 2023-03-27T10:10:07.025 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-27T10:10:07.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7faae0066e30 msgr2=0x7faae00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:07.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7faae0066e30 0x7faae00692e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faae4014040 tx=0x7faae4008030 comp rx=0 tx=0).stop 2023-03-27T10:10:07.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 msgr2=0x7faaf41546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:07.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf41546e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faae800e9b0 tx=0x7faae800ed70 comp rx=0 tx=0).stop 2023-03-27T10:10:07.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 shutdown_connections 2023-03-27T10:10:07.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7faae0066e30 0x7faae00692e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:07.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faaf415c8f0 0x7faaf40ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:07.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faaf40b27d0 0x7faaf40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:07.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 --2- 172.21.15.172:0/1675508606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf40cd760 0x7faaf41546e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:07.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 >> 172.21.15.172:0/1675508606 conn(0x7faaf406dd60 msgr2=0x7faaf40cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:07.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 shutdown_connections 2023-03-27T10:10:07.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:07.028+0000 7faaf93ff700 1 -- 172.21.15.172:0/1675508606 wait complete. 2023-03-27T10:10:07.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-27T10:10:07.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-27T10:10:07.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-03-27T10:10:07.046 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-27T10:10:07.046 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-27T10:10:07.046 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-27T10:10:07.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-27T10:10:07.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-27T10:10:07.047 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-27T10:10:07.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:07.047 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-03-27T10:10:07.089 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:07.089 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:07.090 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:07.091 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-27T10:10:07.092 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-03-27T10:10:07.092 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-03-27T10:10:07.092 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:07.092 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-27T10:10:07.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:07.093 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:07.093 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:07.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2023-03-27T10:10:07.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2023-03-27T10:10:07.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2023-03-27T10:10:07.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-27T10:10:07.094 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:07.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:07.535 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-27T10:10:07.602 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-03-27T10:10:07.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:07.603 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-03-27T10:10:07.671 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-03-27T10:10:07.671 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-27T10:10:07.672 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-27T10:10:07.672 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-27T10:10:07.672 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-27T10:10:07.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:07.673 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:07.673 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:07.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-27T10:10:07.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-27T10:10:07.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-27T10:10:07.674 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:08.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:08.319 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-03-27T10:10:08.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:08.362 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-03-27T10:10:08.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:08.444 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:08.444 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:08.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-27T10:10:08.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-27T10:10:08.445 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:08.611 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-27T10:10:08.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:08.612 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:08.612 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:08.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-27T10:10:08.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-27T10:10:08.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-27T10:10:08.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-27T10:10:08.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-27T10:10:08.614 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:08.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:08.855 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:08.855 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:08.855 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-03-27T10:10:08.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2023-03-27T10:10:08.856 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:09.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:09.023 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-27T10:10:09.065 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-27T10:10:09.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:09.065 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-27T10:10:09.146 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-27T10:10:09.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:09.146 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:10:09.283 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:10:09.283 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-27T10:10:09.284 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:10:09.707 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:10:09.707 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-27T10:10:09.707 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:10:09.708 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:09.708 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:09.731 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:10:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-27T10:10:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:10:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-27T10:10:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-27T10:10:09.733 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=b9fe5031-957d-4f6c-a6ac-e7da3c176686" will pass to kernel 2023-03-27T10:10:09.736 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-27T10:10:09.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:09.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-27T10:10:09.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:09.801 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:09.902 INFO:teuthology.orchestra.run.smithi172.stdout:client4644 2023-03-27T10:10:09.902 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:09.903 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:09.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:09.945 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:10.072 INFO:teuthology.orchestra.run.smithi172.stdout:client4644 2023-03-27T10:10:10.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:10.073 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:10.161 INFO:teuthology.orchestra.run.smithi172.stdout:client4644 2023-03-27T10:10:10.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:10.162 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b9fe5031-957d-4f6c-a6ac-e7da3c176686.client4644/status') 2023-03-27T10:10:10.268 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4644 (3)192.168.0.1:0/365806723 2023-03-27T10:10:10.268 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2023-03-27T10:10:10.268 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2023-03-27T10:10:10.269 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2023-03-27T10:10:10.269 INFO:teuthology.orchestra.run.smithi172.stderr:68 bytes copied, 4.825e-05 s, 1.4 MB/s 2023-03-27T10:10:10.270 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-03-27T10:10:10.271 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-27T10:10:10.271 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-03-27T10:10:10.271 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-27T10:10:10.454 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.455+0000 7f3b987ff700 1 Processor -- start 2023-03-27T10:10:10.454 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.455+0000 7f3b987ff700 1 -- start start 2023-03-27T10:10:10.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.456+0000 7f3b987ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3b900cbfc0 0x7f3b900af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:10.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b987ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b900afd10 0x7f3b9015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:10.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b987ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b900c4290 con 0x7f3b90142680 2023-03-27T10:10:10.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b987ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b900c9a10 con 0x7f3b900afd10 2023-03-27T10:10:10.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b987ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b900af0c0 con 0x7f3b900cbfc0 2023-03-27T10:10:10.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b9659b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3b90142680 0x7f3b900c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38786/0 (socket says 172.21.15.172:38786) 2023-03-27T10:10:10.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b9659b700 1 -- 172.21.15.172:0/1946428195 learned_addr learned my addr 172.21.15.172:0/1946428195 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:10.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b96d9c700 1 --2- 172.21.15.172:0/1946428195 >> v2:172.21.15.172:3300/0 conn(0x7f3b900afd10 0x7f3b9015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:10.457 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b95d9a700 1 --2- 172.21.15.172:0/1946428195 >> v2:172.21.15.191:3300/0 conn(0x7f3b900cbfc0 0x7f3b900af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b95599700 1 -- 172.21.15.172:0/1946428195 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798341655 0 0) 0x7f3b900c4290 con 0x7f3b90142680 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b95599700 1 -- 172.21.15.172:0/1946428195 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b7c0035b0 con 0x7f3b90142680 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b96d9c700 1 -- 172.21.15.172:0/1946428195 >> v2:172.21.15.191:3300/0 conn(0x7f3b900cbfc0 msgr2=0x7f3b900af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.457+0000 7f3b96d9c700 1 --2- 172.21.15.172:0/1946428195 >> v2:172.21.15.191:3300/0 conn(0x7f3b900cbfc0 0x7f3b900af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b96d9c700 1 -- 172.21.15.172:0/1946428195 >> v1:172.21.15.172:6789/0 conn(0x7f3b90142680 legacy=0x7f3b900c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b95599700 1 -- 172.21.15.172:0/1946428195 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3271646456 0 0) 0x7f3b7c0035b0 con 0x7f3b90142680 2023-03-27T10:10:10.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b96d9c700 1 -- 172.21.15.172:0/1946428195 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b900c3cd0 con 0x7f3b900afd10 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b96d9c700 1 --2- 172.21.15.172:0/1946428195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9015ca00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3b90067920 tx=0x7f3b8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8246dbdbed6d51 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b95599700 1 -- 172.21.15.172:0/1946428195 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800e070 con 0x7f3b900afd10 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b95599700 1 -- 172.21.15.172:0/1946428195 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b88003a20 con 0x7f3b900afd10 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b95599700 1 -- 172.21.15.172:0/1946428195 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c001670 con 0x7f3b900afd10 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b987ff700 1 -- 172.21.15.172:0/1946428195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 msgr2=0x7f3b9015ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.458+0000 7f3b987ff700 1 --2- 172.21.15.172:0/1946428195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9015ca00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3b90067920 tx=0x7f3b8800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.459+0000 7f3b987ff700 1 -- 172.21.15.172:0/1946428195 shutdown_connections 2023-03-27T10:10:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.459+0000 7f3b987ff700 1 --2- 172.21.15.172:0/1946428195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9015ca00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.459+0000 7f3b987ff700 1 --2- 172.21.15.172:0/1946428195 >> v2:172.21.15.191:3300/0 conn(0x7f3b900cbfc0 0x7f3b900af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.459+0000 7f3b987ff700 1 -- 172.21.15.172:0/1946428195 >> 172.21.15.172:0/1946428195 conn(0x7f3b9006a1a0 msgr2=0x7f3b9006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.459+0000 7f3b987ff700 1 -- 172.21.15.172:0/1946428195 shutdown_connections 2023-03-27T10:10:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.459+0000 7f3b987ff700 1 -- 172.21.15.172:0/1946428195 wait complete. 2023-03-27T10:10:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.461+0000 7f3b987ff700 1 Processor -- start 2023-03-27T10:10:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.461+0000 7f3b987ff700 1 -- start start 2023-03-27T10:10:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b987ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b987ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b900cbfc0 0x7f3b900c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b987ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b90142680 0x7f3b9013f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:10.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b987ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900c6670 con 0x7f3b900afd10 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b987ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9015a190 con 0x7f3b900cbfc0 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b987ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9015a470 con 0x7f3b90142680 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b9659b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b9659b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9006ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46776/0 (socket says 172.21.15.172:46776) 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b9659b700 1 -- 172.21.15.172:0/4034778250 learned_addr learned my addr 172.21.15.172:0/4034778250 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b95d9a700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b900cbfc0 0x7f3b900c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:10.463 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.462+0000 7f3b96d9c700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b90142680 0x7f3b9013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b9659b700 1 -- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b90142680 msgr2=0x7f3b9013f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b9659b700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b90142680 0x7f3b9013f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b9659b700 1 -- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b900cbfc0 msgr2=0x7f3b900c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b9659b700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b900cbfc0 0x7f3b900c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b9659b700 1 -- 172.21.15.172:0/4034778250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88009a70 con 0x7f3b900afd10 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b9659b700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9006ce40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c750 tx=0x7f3b8c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c004c80 con 0x7f3b900afd10 2023-03-27T10:10:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c004de0 con 0x7f3b900afd10 2023-03-27T10:10:10.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0072d0 con 0x7f3b900afd10 2023-03-27T10:10:10.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b900af2b0 con 0x7f3b900afd10 2023-03-27T10:10:10.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.463+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b900c3fb0 con 0x7f3b900afd10 2023-03-27T10:10:10.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.464+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b900c5a30 con 0x7f3b900afd10 2023-03-27T10:10:10.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.465+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f3b8c01a020 con 0x7f3b900afd10 2023-03-27T10:10:10.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.466+0000 7f3b86ffd700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3b74066e30 0x7f3b740692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:10.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.466+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b8c083e40 con 0x7f3b900afd10 2023-03-27T10:10:10.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.467+0000 7f3b95d9a700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3b74066e30 0x7f3b740692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:10.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.467+0000 7f3b95d9a700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3b74066e30 0x7f3b740692e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b900acb80 tx=0x7f3b80009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:10.468 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.470+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f3b8c051080 con 0x7f3b900afd10 2023-03-27T10:10:10.702 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.704+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3b90074290 con 0x7f3b900afd10 2023-03-27T10:10:10.703 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.705+0000 7f3b86ffd700 1 -- 172.21.15.172:0/4034778250 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3b8c0546a0 con 0x7f3b900afd10 2023-03-27T10:10:10.703 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-27T10:10:10.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3b74066e30 msgr2=0x7f3b740692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3b74066e30 0x7f3b740692e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b900acb80 tx=0x7f3b80009210 comp rx=0 tx=0).stop 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 msgr2=0x7f3b9006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9006ce40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c750 tx=0x7f3b8c00ca60 comp rx=0 tx=0).stop 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 shutdown_connections 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3b90142680 0x7f3b9013f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b900afd10 0x7f3b9006ce40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3b74066e30 0x7f3b740692e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 --2- 172.21.15.172:0/4034778250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b900cbfc0 0x7f3b900c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:10.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 >> 172.21.15.172:0/4034778250 conn(0x7f3b9006a1a0 msgr2=0x7f3b900acbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:10.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 shutdown_connections 2023-03-27T10:10:10.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:10.707+0000 7f3b987ff700 1 -- 172.21.15.172:0/4034778250 wait complete. 2023-03-27T10:10:10.722 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-27T10:10:10.723 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-27T10:10:10.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-03-27T10:10:10.723 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-03-27T10:10:10.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-03-27T10:10:10.724 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-27T10:10:10.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-27T10:10:10.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-27T10:10:10.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-03-27T10:10:10.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:10.725 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-03-27T10:10:10.766 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:10.766 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:10.767 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:10.768 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42355sec preferred_lft 42355sec 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 8e:d4:13:5b:33:89 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-27T10:10:10.769 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:10.770 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::cc49:a6ff:fe8a:ce67/64 scope link 2023-03-27T10:10:10.770 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:10.770 INFO:teuthology.orchestra.run.smithi172.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-27T10:10:10.770 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 8e:d4:13:5b:33:89 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-27T10:10:10.770 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::8cd4:13ff:fe5b:3389/64 scope link 2023-03-27T10:10:10.770 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:10.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:10.771 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-27T10:10:10.872 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-03-27T10:10:10.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:10.875 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-03-27T10:10:10.918 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-03-27T10:10:10.918 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-27T10:10:10.919 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-27T10:10:10.919 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-27T10:10:10.919 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-27T10:10:10.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:10.920 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:10.920 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:10.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-27T10:10:10.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-27T10:10:10.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-27T10:10:10.921 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:11.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.108 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-03-27T10:10:11.149 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-27T10:10:11.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.150 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-03-27T10:10:11.231 INFO:teuthology.orchestra.run.smithi172.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-03-27T10:10:11.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.232 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:11.232 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:11.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-27T10:10:11.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-03-27T10:10:11.233 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:11.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.397 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-03-27T10:10:11.460 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:11.460 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:11.460 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:11.460 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether fe:2b:77:24:b6:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.461 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::fc2b:77ff:fe24:b698/64 scope link 2023-03-27T10:10:11.462 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-03-27T10:10:11.525 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:11.525 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:11.526 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:11.526 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.526 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:11.526 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.526 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:10:11.526 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether fe:2b:77:24:b6:98 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-27T10:10:11.527 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-27T10:10:11.527 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.527 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::fc2b:77ff:fe24:b698/64 scope link 2023-03-27T10:10:11.527 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:11.528 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-03-27T10:10:11.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.529 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:11.529 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:11.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-03-27T10:10:11.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-03-27T10:10:11.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-03-27T10:10:11.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-03-27T10:10:11.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-03-27T10:10:11.531 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:11.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:11.749 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:10:11.749 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:10:11.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.1 up 2023-03-27T10:10:11.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.1 master ceph-brx 2023-03-27T10:10:11.750 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:10:11.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:11.915 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-03-27T10:10:11.956 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-03-27T10:10:11.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:11.957 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-03-27T10:10:12.036 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-27T10:10:12.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:12.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-27T10:10:12.169 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-27T10:10:12.170 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-03-27T10:10:12.170 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:10:12.184 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-27T10:10:12.184 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-03-27T10:10:12.184 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:10:12.185 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:12.185 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:12.209 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-03-27T10:10:12.209 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-03-27T10:10:12.210 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:10:12.210 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:12.210 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:12.211 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-27T10:10:12.211 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-27T10:10:12.211 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=b9fe5031-957d-4f6c-a6ac-e7da3c176686" will pass to kernel 2023-03-27T10:10:12.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-27T10:10:12.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:12.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-03-27T10:10:12.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:12.277 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:12.354 INFO:teuthology.orchestra.run.smithi172.stdout:client4615 2023-03-27T10:10:12.355 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:12.355 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:12.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:12.397 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:12.514 INFO:teuthology.orchestra.run.smithi172.stdout:client4615 2023-03-27T10:10:12.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:12.516 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:12.593 INFO:teuthology.orchestra.run.smithi172.stdout:client4615 2023-03-27T10:10:12.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:12.594 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b9fe5031-957d-4f6c-a6ac-e7da3c176686.client4615/status') 2023-03-27T10:10:12.691 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4615 (3)172.21.15.172:0/128653219 2023-03-27T10:10:12.691 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2023-03-27T10:10:12.692 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2023-03-27T10:10:12.692 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2023-03-27T10:10:12.692 INFO:teuthology.orchestra.run.smithi172.stderr:70 bytes copied, 6.0514e-05 s, 1.2 MB/s 2023-03-27T10:10:12.694 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-03-27T10:10:12.694 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-27T10:10:12.696 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-03-27T10:10:12.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-27T10:10:12.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.880+0000 7fca1e5ff700 1 Processor -- start 2023-03-27T10:10:12.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.880+0000 7fca1e5ff700 1 -- start start 2023-03-27T10:10:12.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca1e5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca1815ca20 0x7fca180ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:12.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca1e5ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fca180cd610 0x7fca180b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:12.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca1e5ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180cebc0 con 0x7fca180d0b90 2023-03-27T10:10:12.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca1e5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180ceea0 con 0x7fca1815ca20 2023-03-27T10:10:12.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca1e5ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180cf180 con 0x7fca180cd610 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca177fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca1815ca20 0x7fca180ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca177fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca1815ca20 0x7fca180ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46780/0 (socket says 172.21.15.172:46780) 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca177fe700 1 -- 172.21.15.172:0/3547018436 learned_addr learned my addr 172.21.15.172:0/3547018436 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.881+0000 7fca1cb9c700 1 --2- 172.21.15.172:0/3547018436 >> v2:172.21.15.191:3300/0 conn(0x7fca180cd610 0x7fca180b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca177fe700 1 -- 172.21.15.172:0/3547018436 >> v2:172.21.15.191:3300/0 conn(0x7fca180cd610 msgr2=0x7fca180b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca177fe700 1 --2- 172.21.15.172:0/3547018436 >> v2:172.21.15.191:3300/0 conn(0x7fca180cd610 0x7fca180b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca177fe700 1 -- 172.21.15.172:0/3547018436 >> v1:172.21.15.191:6789/0 conn(0x7fca180d0b90 legacy=0x7fca180d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca177fe700 1 -- 172.21.15.172:0/3547018436 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180cf460 con 0x7fca1815ca20 2023-03-27T10:10:12.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca177fe700 1 --2- 172.21.15.172:0/3547018436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca180ce500 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca1808c720 tx=0x7fca0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567fb4ed5a81347a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:12.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca16ffd700 1 -- 172.21.15.172:0/3547018436 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c004230 con 0x7fca1815ca20 2023-03-27T10:10:12.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca16ffd700 1 -- 172.21.15.172:0/3547018436 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c004390 con 0x7fca1815ca20 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.882+0000 7fca16ffd700 1 -- 172.21.15.172:0/3547018436 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0036a0 con 0x7fca1815ca20 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 -- 172.21.15.172:0/3547018436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 msgr2=0x7fca180ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/3547018436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca180ce500 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca1808c720 tx=0x7fca0c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 -- 172.21.15.172:0/3547018436 shutdown_connections 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/3547018436 >> v2:172.21.15.191:3300/0 conn(0x7fca180cd610 0x7fca180b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/3547018436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca180ce500 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:12.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 -- 172.21.15.172:0/3547018436 >> 172.21.15.172:0/3547018436 conn(0x7fca180721f0 msgr2=0x7fca1809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:12.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 -- 172.21.15.172:0/3547018436 shutdown_connections 2023-03-27T10:10:12.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.883+0000 7fca1e5ff700 1 -- 172.21.15.172:0/3547018436 wait complete. 2023-03-27T10:10:12.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.885+0000 7fca1e5ff700 1 Processor -- start 2023-03-27T10:10:12.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.885+0000 7fca1e5ff700 1 -- start start 2023-03-27T10:10:12.888 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.885+0000 7fca1e5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca180cd610 0x7fca180cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:12.888 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1e5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca180d0b90 0x7fca181558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:12.888 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1e5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca18158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1e5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cb290 con 0x7fca1815ca20 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1e5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cb570 con 0x7fca180cd610 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1e5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cb850 con 0x7fca180d0b90 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca18158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca18158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46786/0 (socket says 172.21.15.172:46786) 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 -- 172.21.15.172:0/2358450258 learned_addr learned my addr 172.21.15.172:0/2358450258 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca17fff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca180cd610 0x7fca180cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca177fe700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca180d0b90 0x7fca181558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 -- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca180d0b90 msgr2=0x7fca181558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca180d0b90 0x7fca181558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 -- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca180cd610 msgr2=0x7fca180cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca180cd610 0x7fca180cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 -- 172.21.15.172:0/2358450258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c009550 con 0x7fca1815ca20 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.886+0000 7fca1cb9c700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca18158050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fca10007e40 tx=0x7fca1000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.887+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000ed30 con 0x7fca1815ca20 2023-03-27T10:10:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.887+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10014420 con 0x7fca1815ca20 2023-03-27T10:10:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.887+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100147d0 con 0x7fca1815ca20 2023-03-27T10:10:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.887+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca180d2d30 con 0x7fca1815ca20 2023-03-27T10:10:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.887+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca180afc50 con 0x7fca1815ca20 2023-03-27T10:10:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.888+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca180b06b0 con 0x7fca1815ca20 2023-03-27T10:10:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.889+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fca10012050 con 0x7fca1815ca20 2023-03-27T10:10:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.889+0000 7fca14ff9700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fca04066e30 0x7fca040692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.890+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca10084830 con 0x7fca1815ca20 2023-03-27T10:10:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.890+0000 7fca17fff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fca04066e30 0x7fca040692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.890+0000 7fca17fff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fca04066e30 0x7fca040692e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca080050c0 tx=0x7fca08007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:12.893+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fca10051a70 con 0x7fca1815ca20 2023-03-27T10:10:13.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.123+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca18074290 con 0x7fca1815ca20 2023-03-27T10:10:13.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.124+0000 7fca14ff9700 1 -- 172.21.15.172:0/2358450258 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca10055090 con 0x7fca1815ca20 2023-03-27T10:10:13.124 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-27T10:10:13.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fca04066e30 msgr2=0x7fca040692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:13.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fca04066e30 0x7fca040692e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca080050c0 tx=0x7fca08007f10 comp rx=0 tx=0).stop 2023-03-27T10:10:13.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 msgr2=0x7fca18158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:13.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca18158050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fca10007e40 tx=0x7fca1000e3c0 comp rx=0 tx=0).stop 2023-03-27T10:10:13.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 shutdown_connections 2023-03-27T10:10:13.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca1815ca20 0x7fca18158050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:13.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fca04066e30 0x7fca040692e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:13.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca180cd610 0x7fca180cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 --2- 172.21.15.172:0/2358450258 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca180d0b90 0x7fca181558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.126+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 >> 172.21.15.172:0/2358450258 conn(0x7fca180721f0 msgr2=0x7fca180cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.127+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 shutdown_connections 2023-03-27T10:10:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:13.127+0000 7fca1e5ff700 1 -- 172.21.15.172:0/2358450258 wait complete. 2023-03-27T10:10:13.143 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-27T10:10:13.144 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-27T10:10:13.144 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-03-27T10:10:13.144 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-03-27T10:10:13.144 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-03-27T10:10:13.144 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-27T10:10:13.145 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-27T10:10:13.145 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-27T10:10:13.145 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-03-27T10:10:13.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:13.146 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-03-27T10:10:13.192 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:13.192 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:13.193 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:13.194 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-27T10:10:13.195 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42355sec preferred_lft 42355sec 2023-03-27T10:10:13.195 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2023-03-27T10:10:13.195 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:13.195 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-27T10:10:13.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:13.196 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:13.196 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:13.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2023-03-27T10:10:13.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2023-03-27T10:10:13.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2023-03-27T10:10:13.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-27T10:10:13.197 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:13.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:13.745 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-27T10:10:13.807 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-03-27T10:10:13.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:13.811 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-03-27T10:10:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-03-27T10:10:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-27T10:10:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-27T10:10:13.866 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-27T10:10:13.867 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-27T10:10:13.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:13.867 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:13.868 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:13.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-27T10:10:13.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-27T10:10:13.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-27T10:10:13.868 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:14.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:14.527 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-27T10:10:14.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:14.569 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-03-27T10:10:14.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:14.651 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:14.652 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:14.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-27T10:10:14.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-03-27T10:10:14.652 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:14.819 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-03-27T10:10:14.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:14.820 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:14.820 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:14.820 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-03-27T10:10:14.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-27T10:10:14.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-03-27T10:10:14.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-03-27T10:10:14.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-03-27T10:10:14.822 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:14.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:10:14.840 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:10:15.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:15.063 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:15.064 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:15.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2023-03-27T10:10:15.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2023-03-27T10:10:15.064 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:15.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:15.229 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-03-27T10:10:15.271 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-03-27T10:10:15.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:15.272 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-03-27T10:10:15.351 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-27T10:10:15.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:15.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-27T10:10:15.485 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-27T10:10:15.486 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-03-27T10:10:15.486 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2023-03-27T10:10:15.940 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-27T10:10:15.940 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-03-27T10:10:15.940 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2023-03-27T10:10:15.940 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:15.940 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:15.964 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-03-27T10:10:15.964 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-03-27T10:10:15.964 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2023-03-27T10:10:15.965 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:15.965 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:15.965 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-27T10:10:15.965 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-27T10:10:15.965 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=b9fe5031-957d-4f6c-a6ac-e7da3c176686" will pass to kernel 2023-03-27T10:10:15.968 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-27T10:10:15.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:15.969 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-03-27T10:10:16.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:16.031 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:16.118 INFO:teuthology.orchestra.run.smithi191.stdout:client4662 2023-03-27T10:10:16.118 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:16.119 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:16.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:16.160 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:16.279 INFO:teuthology.orchestra.run.smithi191.stdout:client4662 2023-03-27T10:10:16.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:16.280 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:16.357 INFO:teuthology.orchestra.run.smithi191.stdout:client4662 2023-03-27T10:10:16.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:16.359 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b9fe5031-957d-4f6c-a6ac-e7da3c176686.client4662/status') 2023-03-27T10:10:16.455 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.4662 (3)172.21.15.191:0/6554205 2023-03-27T10:10:16.456 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2023-03-27T10:10:16.456 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2023-03-27T10:10:16.456 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2023-03-27T10:10:16.456 INFO:teuthology.orchestra.run.smithi191.stderr:68 bytes copied, 6.5462e-05 s, 1.0 MB/s 2023-03-27T10:10:16.458 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-03-27T10:10:16.458 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-27T10:10:16.458 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-03-27T10:10:16.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-27T10:10:16.653 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.653+0000 7f80357ff700 1 Processor -- start 2023-03-27T10:10:16.654 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.654+0000 7f80357ff700 1 -- start start 2023-03-27T10:10:16.655 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f80357ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f803015ca20 0x7f80300ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:16.655 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f80357ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80300cebc0 con 0x7f80300cd610 2023-03-27T10:10:16.655 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f80357ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80300ceea0 con 0x7f80300d0b90 2023-03-27T10:10:16.655 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f80357ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300cf180 con 0x7f803015ca20 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f802f7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f80300cd610 0x7f80300b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37324/0 (socket says 172.21.15.172:37324) 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f802f7fe700 1 -- 172.21.15.172:0/2807504395 learned_addr learned my addr 172.21.15.172:0/2807504395 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.655+0000 7f8027fff700 1 --2- 172.21.15.172:0/2807504395 >> v2:172.21.15.191:3300/0 conn(0x7f803015ca20 0x7f80300ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172794483 0 0) 0x7f80300cebc0 con 0x7f80300cd610 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f801c0035b0 con 0x7f80300cd610 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406269570 0 0) 0x7f80300ceea0 con 0x7f80300d0b90 2023-03-27T10:10:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80300cebc0 con 0x7f80300d0b90 2023-03-27T10:10:16.657 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f8027fff700 1 -- 172.21.15.172:0/2807504395 >> v1:172.21.15.191:6789/0 conn(0x7f80300d0b90 legacy=0x7f80300d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.657 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f8027fff700 1 -- 172.21.15.172:0/2807504395 >> v1:172.21.15.172:6789/0 conn(0x7f80300cd610 legacy=0x7f80300b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.657 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f8027fff700 1 -- 172.21.15.172:0/2807504395 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300cf460 con 0x7f803015ca20 2023-03-27T10:10:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f8027fff700 1 --2- 172.21.15.172:0/2807504395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803015ca20 0x7f80300ce500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8018009840 tx=0x7f8018009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c991e4d7ec5c012 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018011830 con 0x7f803015ca20 2023-03-27T10:10:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8018011990 con 0x7f803015ca20 2023-03-27T10:10:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.656+0000 7f802e7fc700 1 -- 172.21.15.172:0/2807504395 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018011d20 con 0x7f803015ca20 2023-03-27T10:10:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 -- 172.21.15.172:0/2807504395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803015ca20 msgr2=0x7f80300ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 --2- 172.21.15.172:0/2807504395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803015ca20 0x7f80300ce500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8018009840 tx=0x7f8018009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 -- 172.21.15.172:0/2807504395 shutdown_connections 2023-03-27T10:10:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 --2- 172.21.15.172:0/2807504395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f803015ca20 0x7f80300ce500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 -- 172.21.15.172:0/2807504395 >> 172.21.15.172:0/2807504395 conn(0x7f80300721f0 msgr2=0x7f803009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 -- 172.21.15.172:0/2807504395 shutdown_connections 2023-03-27T10:10:16.660 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.657+0000 7f80357ff700 1 -- 172.21.15.172:0/2807504395 wait complete. 2023-03-27T10:10:16.660 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.659+0000 7f80357ff700 1 Processor -- start 2023-03-27T10:10:16.660 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.659+0000 7f80357ff700 1 -- start start 2023-03-27T10:10:16.661 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f80357ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 0x7f80300b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f80357ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80300d0b90 0x7f80300b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f80357ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f803015ca20 0x7f80300b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f80357ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b77f0 con 0x7f80300cd610 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f80357ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80301e4d30 con 0x7f80300d0b90 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f80357ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b8460 con 0x7f803015ca20 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f802effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 0x7f80300b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:16.662 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f802effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 0x7f80300b7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49484/0 (socket says 172.21.15.172:49484) 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f802effd700 1 -- 172.21.15.172:0/2314104379 learned_addr learned my addr 172.21.15.172:0/2314104379 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f8027fff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80300d0b90 0x7f80300b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f802f7fe700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f803015ca20 0x7f80300b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.660+0000 7f802effd700 1 -- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f803015ca20 msgr2=0x7f80300b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f802effd700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f803015ca20 0x7f80300b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f802effd700 1 -- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80300d0b90 msgr2=0x7f80300b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f802effd700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80300d0b90 0x7f80300b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f802effd700 1 -- 172.21.15.172:0/2314104379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80180094a0 con 0x7f80300cd610 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f802effd700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 0x7f80300b7f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f802000c730 tx=0x7f802000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80200052d0 con 0x7f80300cd610 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8020005430 con 0x7f80300cd610 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80200038f0 con 0x7f80300cd610 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80300d2d30 con 0x7f80300cd610 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.661+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80300afc50 con 0x7f80300cd610 2023-03-27T10:10:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.662+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80300b0880 con 0x7f80300cd610 2023-03-27T10:10:16.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.663+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f8020019030 con 0x7f80300cd610 2023-03-27T10:10:16.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.664+0000 7f80277fe700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8010066e30 0x7f80100692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:16.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.664+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8020083500 con 0x7f80300cd610 2023-03-27T10:10:16.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.664+0000 7f8027fff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8010066e30 0x7f80100692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:16.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.665+0000 7f8027fff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8010066e30 0x7f80100692e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8018009fd0 tx=0x7f801801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:16.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.668+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f80200507d0 con 0x7f80300cd610 2023-03-27T10:10:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.898+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8030074290 con 0x7f80300cd610 2023-03-27T10:10:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.898+0000 7f80277fe700 1 -- 172.21.15.172:0/2314104379 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8020053df0 con 0x7f80300cd610 2023-03-27T10:10:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-27T10:10:16.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8010066e30 msgr2=0x7f80100692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8010066e30 0x7f80100692e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8018009fd0 tx=0x7f801801c040 comp rx=0 tx=0).stop 2023-03-27T10:10:16.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 msgr2=0x7f80300b7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:16.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 0x7f80300b7f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f802000c730 tx=0x7f802000ca40 comp rx=0 tx=0).stop 2023-03-27T10:10:16.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 shutdown_connections 2023-03-27T10:10:16.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f803015ca20 0x7f80300b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80300cd610 0x7f80300b7f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8010066e30 0x7f80100692e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 --2- 172.21.15.172:0/2314104379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f80300d0b90 0x7f80300b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 >> 172.21.15.172:0/2314104379 conn(0x7f80300721f0 msgr2=0x7f803006b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 shutdown_connections 2023-03-27T10:10:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:16.901+0000 7f80357ff700 1 -- 172.21.15.172:0/2314104379 wait complete. 2023-03-27T10:10:16.918 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-27T10:10:16.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-27T10:10:16.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-03-27T10:10:16.919 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-03-27T10:10:16.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-03-27T10:10:16.919 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-27T10:10:16.919 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-27T10:10:16.919 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-27T10:10:16.920 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-03-27T10:10:16.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:16.920 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-03-27T10:10:16.962 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:16.962 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:16.962 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:16.963 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:16.963 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:16.963 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:16.963 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:16.964 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:16.964 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f0 2023-03-27T10:10:16.964 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:16.965 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:16.965 INFO:teuthology.orchestra.run.smithi191.stdout: altname enp7s0f1 2023-03-27T10:10:16.965 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:10:16.965 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:16.966 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-27T10:10:16.966 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:16.966 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-27T10:10:16.966 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42351sec preferred_lft 42351sec 2023-03-27T10:10:16.967 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::ec4:7aff:fe88:7211/64 scope link 2023-03-27T10:10:16.967 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:16.967 INFO:teuthology.orchestra.run.smithi191.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:10:16.968 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether a2:ca:93:0a:42:6d brd ff:ff:ff:ff:ff:ff 2023-03-27T10:10:16.968 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-27T10:10:16.968 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:16.968 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::a000:4aff:fe24:fec7/64 scope link 2023-03-27T10:10:16.969 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:16.969 INFO:teuthology.orchestra.run.smithi191.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-27T10:10:16.969 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether a2:ca:93:0a:42:6d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-27T10:10:16.970 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::a0ca:93ff:fe0a:426d/64 scope link 2023-03-27T10:10:16.970 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:16.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:16.971 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-27T10:10:17.063 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-03-27T10:10:17.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.066 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-03-27T10:10:17.109 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-03-27T10:10:17.109 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-27T10:10:17.110 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-27T10:10:17.110 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-27T10:10:17.110 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-27T10:10:17.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.111 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:17.111 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:17.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-27T10:10:17.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-27T10:10:17.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-27T10:10:17.112 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:17.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.301 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-27T10:10:17.341 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-03-27T10:10:17.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.342 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-03-27T10:10:17.423 INFO:teuthology.orchestra.run.smithi191.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-03-27T10:10:17.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.424 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:17.424 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:17.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-03-27T10:10:17.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-03-27T10:10:17.425 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:17.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.588 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-03-27T10:10:17.650 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:17.651 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.651 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:10:17.652 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 9a:5e:91:9e:bc:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-27T10:10:17.652 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-27T10:10:17.652 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.652 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::985e:91ff:fe9e:bc1a/64 scope link 2023-03-27T10:10:17.652 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.653 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-03-27T10:10:17.717 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:10:17.717 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:10:17.717 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:10:17.717 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.717 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 9a:5e:91:9e:bc:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::985e:91ff:fe9e:bc1a/64 scope link 2023-03-27T10:10:17.718 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:10:17.719 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-03-27T10:10:17.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.720 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:17.720 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:17.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-03-27T10:10:17.721 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-03-27T10:10:17.721 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-03-27T10:10:17.721 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-03-27T10:10:17.722 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-03-27T10:10:17.722 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:17.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:17.940 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-27T10:10:17.941 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-27T10:10:17.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.1 up 2023-03-27T10:10:17.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.1 master ceph-brx 2023-03-27T10:10:17.941 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-27T10:10:18.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:18.107 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-03-27T10:10:18.149 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-03-27T10:10:18.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:10:18.150 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-03-27T10:10:18.229 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-27T10:10:18.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:18.230 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-27T10:10:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-27T10:10:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-03-27T10:10:18.364 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2023-03-27T10:10:18.378 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-27T10:10:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-03-27T10:10:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2023-03-27T10:10:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:18.379 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-03-27T10:10:18.401 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-03-27T10:10:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:invalid new device string format 2023-03-27T10:10:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:10:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:10:18.402 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-27T10:10:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-27T10:10:18.403 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=b9fe5031-957d-4f6c-a6ac-e7da3c176686" will pass to kernel 2023-03-27T10:10:18.407 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-27T10:10:18.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:18.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-03-27T10:10:18.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:18.471 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:18.549 INFO:teuthology.orchestra.run.smithi191.stdout:client4502 2023-03-27T10:10:18.550 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:18.551 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:18.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:18.595 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:18.713 INFO:teuthology.orchestra.run.smithi191.stdout:client4502 2023-03-27T10:10:18.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:18.714 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:10:18.793 INFO:teuthology.orchestra.run.smithi191.stdout:client4502 2023-03-27T10:10:18.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:18.794 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b9fe5031-957d-4f6c-a6ac-e7da3c176686.client4502/status') 2023-03-27T10:10:18.890 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.4502 (3)192.168.0.2:0/2992597163 2023-03-27T10:10:18.890 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2023-03-27T10:10:18.891 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2023-03-27T10:10:18.891 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2023-03-27T10:10:18.891 INFO:teuthology.orchestra.run.smithi191.stderr:69 bytes copied, 5.2968e-05 s, 1.3 MB/s 2023-03-27T10:10:18.893 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-03-27T10:10:18.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.115+0000 7ff1bd3ff700 1 Processor -- start 2023-03-27T10:10:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.115+0000 7ff1bd3ff700 1 -- start start 2023-03-27T10:10:19.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.116+0000 7ff1bd3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1b80d0b90 0x7ff1b80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.116+0000 7ff1bd3ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1b80cd610 0x7ff1b80b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1bd3ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b80cebc0 con 0x7ff1b815ca20 2023-03-27T10:10:19.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1bd3ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80ceea0 con 0x7ff1b80cd610 2023-03-27T10:10:19.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1bd3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80cf180 con 0x7ff1b80d0b90 2023-03-27T10:10:19.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b77fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1b80cd610 0x7ff1b80b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1affff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff1b815ca20 0x7ff1b80d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37338/0 (socket says 172.21.15.172:37338) 2023-03-27T10:10:19.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b77fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1b80cd610 0x7ff1b80b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49486/0 (socket says 172.21.15.172:49486) 2023-03-27T10:10:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1affff700 1 -- 172.21.15.172:0/397439719 learned_addr learned my addr 172.21.15.172:0/397439719 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b6ffd700 1 --2- 172.21.15.172:0/397439719 >> v2:172.21.15.191:3300/0 conn(0x7ff1b80d0b90 0x7ff1b80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b77fe700 1 -- 172.21.15.172:0/397439719 >> v2:172.21.15.191:3300/0 conn(0x7ff1b80d0b90 msgr2=0x7ff1b80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b77fe700 1 --2- 172.21.15.172:0/397439719 >> v2:172.21.15.191:3300/0 conn(0x7ff1b80d0b90 0x7ff1b80ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b77fe700 1 -- 172.21.15.172:0/397439719 >> v1:172.21.15.172:6789/0 conn(0x7ff1b815ca20 legacy=0x7ff1b80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b77fe700 1 -- 172.21.15.172:0/397439719 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80cf460 con 0x7ff1b80cd610 2023-03-27T10:10:19.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.117+0000 7ff1b67fc700 1 -- 172.21.15.172:0/397439719 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514763625 0 0) 0x7ff1b80cebc0 con 0x7ff1b815ca20 2023-03-27T10:10:19.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1b77fe700 1 --2- 172.21.15.172:0/397439719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b0170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff1b808c260 tx=0x7ff1b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d176de1260031032 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1b67fc700 1 -- 172.21.15.172:0/397439719 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000e070 con 0x7ff1b80cd610 2023-03-27T10:10:19.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1b67fc700 1 -- 172.21.15.172:0/397439719 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b000bb20 con 0x7ff1b80cd610 2023-03-27T10:10:19.123 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1b67fc700 1 -- 172.21.15.172:0/397439719 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0012430 con 0x7ff1b80cd610 2023-03-27T10:10:19.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/397439719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 msgr2=0x7ff1b80b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/397439719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b0170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff1b808c260 tx=0x7ff1b000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:19.124 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/397439719 shutdown_connections 2023-03-27T10:10:19.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/397439719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b0170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/397439719 >> v2:172.21.15.191:3300/0 conn(0x7ff1b80d0b90 0x7ff1b80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.118+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/397439719 >> 172.21.15.172:0/397439719 conn(0x7ff1b80721f0 msgr2=0x7ff1b809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:19.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.119+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/397439719 shutdown_connections 2023-03-27T10:10:19.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.119+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/397439719 wait complete. 2023-03-27T10:10:19.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.120+0000 7ff1bd3ff700 1 Processor -- start 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.120+0000 7ff1bd3ff700 1 -- start start 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1bd3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1bd3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1b80d0b90 0x7ff1b81f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1bd3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1b815ca20 0x7ff1b8143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1bd3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80b50a0 con 0x7ff1b80cd610 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1bd3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81f20e0 con 0x7ff1b80d0b90 2023-03-27T10:10:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1bd3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80b4dc0 con 0x7ff1b815ca20 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1b6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1b6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49492/0 (socket says 172.21.15.172:49492) 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.121+0000 7ff1b6ffd700 1 -- 172.21.15.172:0/718534478 learned_addr learned my addr 172.21.15.172:0/718534478 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1affff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1b80d0b90 0x7ff1b81f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b77fe700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1b815ca20 0x7ff1b8143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b6ffd700 1 -- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1b815ca20 msgr2=0x7ff1b8143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b6ffd700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1b815ca20 0x7ff1b8143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b6ffd700 1 -- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1b80d0b90 msgr2=0x7ff1b81f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b6ffd700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1b80d0b90 0x7ff1b81f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b6ffd700 1 -- 172.21.15.172:0/718534478 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b0009a70 con 0x7ff1b80cd610 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b77fe700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1b815ca20 0x7ff1b8143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1b6ffd700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b2220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800e990 tx=0x7ff1a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80096f0 con 0x7ff1b80cd610 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a800c850 con 0x7ff1b80cd610 2023-03-27T10:10:19.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800eee0 con 0x7ff1b80cd610 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.122+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b80d2d30 con 0x7ff1b80cd610 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.123+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b80afc50 con 0x7ff1b80cd610 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.124+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b80b06b0 con 0x7ff1b80cd610 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.124+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff1a8023070 con 0x7ff1b80cd610 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.125+0000 7ff1af7fe700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff198066e30 0x7ff1980692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.125+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1a80844b0 con 0x7ff1b80cd610 2023-03-27T10:10:19.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.126+0000 7ff1affff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff198066e30 0x7ff1980692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.126+0000 7ff1affff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff198066e30 0x7ff1980692e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff1b814a350 tx=0x7ff1a0007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.132 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.129+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff1a80517e0 con 0x7ff1b80cd610 2023-03-27T10:10:19.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.316+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1b81567d0 con 0x7ff1b80cd610 2023-03-27T10:10:19.316 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.317+0000 7ff1af7fe700 1 -- 172.21.15.172:0/718534478 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7ff1b81567d0 con 0x7ff1b80cd610 2023-03-27T10:10:19.317 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:19.317 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff198066e30 msgr2=0x7ff1980692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff198066e30 0x7ff1980692e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff1b814a350 tx=0x7ff1a0007e70 comp rx=0 tx=0).stop 2023-03-27T10:10:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 msgr2=0x7ff1b80b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b2220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800e990 tx=0x7ff1a800eca0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 shutdown_connections 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1b815ca20 0x7ff1b8143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b80cd610 0x7ff1b80b2220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff198066e30 0x7ff1980692e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 --2- 172.21.15.172:0/718534478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1b80d0b90 0x7ff1b81f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 >> 172.21.15.172:0/718534478 conn(0x7ff1b80721f0 msgr2=0x7ff1b815a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:19.320 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 shutdown_connections 2023-03-27T10:10:19.321 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.320+0000 7ff1bd3ff700 1 -- 172.21.15.172:0/718534478 wait complete. 2023-03-27T10:10:19.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:19.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:19.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.526+0000 7fbb49fff700 1 Processor -- start 2023-03-27T10:10:19.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.526+0000 7fbb49fff700 1 -- start start 2023-03-27T10:10:19.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.527+0000 7fbb49fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb4406da00 0x7fbb4406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.527+0000 7fbb49fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbb44072400 0x7fbb44160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.527+0000 7fbb49fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb441463e0 con 0x7fbb4406ab40 2023-03-27T10:10:19.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.527+0000 7fbb49fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb441611a0 con 0x7fbb4406da00 2023-03-27T10:10:19.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.527+0000 7fbb49fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4406e310 con 0x7fbb44072400 2023-03-27T10:10:19.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb4406da00 0x7fbb4406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb43fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbb4406ab40 0x7fbb4415e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37344/0 (socket says 172.21.15.172:37344) 2023-03-27T10:10:19.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb4406da00 0x7fbb4406ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49502/0 (socket says 172.21.15.172:49502) 2023-03-27T10:10:19.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb43fff700 1 -- 172.21.15.172:0/3410922318 learned_addr learned my addr 172.21.15.172:0/3410922318 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:19.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb42ffd700 1 --2- 172.21.15.172:0/3410922318 >> v2:172.21.15.191:3300/0 conn(0x7fbb44072400 0x7fbb44160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 -- 172.21.15.172:0/3410922318 >> v2:172.21.15.191:3300/0 conn(0x7fbb44072400 msgr2=0x7fbb44160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:19.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 --2- 172.21.15.172:0/3410922318 >> v2:172.21.15.191:3300/0 conn(0x7fbb44072400 0x7fbb44160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 -- 172.21.15.172:0/3410922318 >> v1:172.21.15.172:6789/0 conn(0x7fbb4406ab40 legacy=0x7fbb4415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 -- 172.21.15.172:0/3410922318 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44160be0 con 0x7fbb4406da00 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb427fc700 1 -- 172.21.15.172:0/3410922318 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047117233 0 0) 0x7fbb441463e0 con 0x7fbb4406ab40 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.528+0000 7fbb437fe700 1 --2- 172.21.15.172:0/3410922318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4406ddd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb440b5350 tx=0x7fbb34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b841f7e7076e31 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb427fc700 1 -- 172.21.15.172:0/3410922318 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34011830 con 0x7fbb4406da00 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb427fc700 1 -- 172.21.15.172:0/3410922318 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb34011990 con 0x7fbb4406da00 2023-03-27T10:10:19.530 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb427fc700 1 -- 172.21.15.172:0/3410922318 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34011d20 con 0x7fbb4406da00 2023-03-27T10:10:19.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 -- 172.21.15.172:0/3410922318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 msgr2=0x7fbb4406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 --2- 172.21.15.172:0/3410922318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4406ddd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb440b5350 tx=0x7fbb34009b20 comp rx=0 tx=0).stop 2023-03-27T10:10:19.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 -- 172.21.15.172:0/3410922318 shutdown_connections 2023-03-27T10:10:19.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 --2- 172.21.15.172:0/3410922318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4406ddd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 --2- 172.21.15.172:0/3410922318 >> v2:172.21.15.191:3300/0 conn(0x7fbb44072400 0x7fbb44160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 -- 172.21.15.172:0/3410922318 >> 172.21.15.172:0/3410922318 conn(0x7fbb440b1010 msgr2=0x7fbb440b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:19.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 -- 172.21.15.172:0/3410922318 shutdown_connections 2023-03-27T10:10:19.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.529+0000 7fbb49fff700 1 -- 172.21.15.172:0/3410922318 wait complete. 2023-03-27T10:10:19.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.531+0000 7fbb49fff700 1 Processor -- start 2023-03-27T10:10:19.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.531+0000 7fbb49fff700 1 -- start start 2023-03-27T10:10:19.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb49fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4406ab40 0x7fbb441458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb49fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb49fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb44072400 0x7fbb4415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb49fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4413f8f0 con 0x7fbb4406da00 2023-03-27T10:10:19.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb49fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4413c860 con 0x7fbb4406ab40 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb49fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4413cb40 con 0x7fbb44072400 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb42ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb42ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4415b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49504/0 (socket says 172.21.15.172:49504) 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.532+0000 7fbb42ffd700 1 -- 172.21.15.172:0/1686595709 learned_addr learned my addr 172.21.15.172:0/1686595709 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb43fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb44072400 0x7fbb4415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb437fe700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4406ab40 0x7fbb441458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb42ffd700 1 -- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb44072400 msgr2=0x7fbb4415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb42ffd700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb44072400 0x7fbb4415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb42ffd700 1 -- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4406ab40 msgr2=0x7fbb441458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb42ffd700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4406ab40 0x7fbb441458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb42ffd700 1 -- 172.21.15.172:0/1686595709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb340094a0 con 0x7fbb4406da00 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb43fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb44072400 0x7fbb4415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb42ffd700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4415b890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800d800 tx=0x7fbb3800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380125f0 con 0x7fbb4406da00 2023-03-27T10:10:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb38012750 con 0x7fbb4406da00 2023-03-27T10:10:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38012ae0 con 0x7fbb4406da00 2023-03-27T10:10:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4406a340 con 0x7fbb4406da00 2023-03-27T10:10:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.533+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb44160ec0 con 0x7fbb4406da00 2023-03-27T10:10:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.534+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4406a620 con 0x7fbb4406da00 2023-03-27T10:10:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.535+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fbb38012c40 con 0x7fbb4406da00 2023-03-27T10:10:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.536+0000 7fbb2bfff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbb30066e30 0x7fbb300692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.536+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb38084800 con 0x7fbb4406da00 2023-03-27T10:10:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.536+0000 7fbb437fe700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbb30066e30 0x7fbb300692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.537+0000 7fbb437fe700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbb30066e30 0x7fbb300692e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb340090b0 tx=0x7fbb34008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.540+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fbb38051a40 con 0x7fbb4406da00 2023-03-27T10:10:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.733+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb44074300 con 0x7fbb4406da00 2023-03-27T10:10:19.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.733+0000 7fbb2bfff700 1 -- 172.21.15.172:0/1686595709 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb38012ed0 con 0x7fbb4406da00 2023-03-27T10:10:19.733 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbb30066e30 msgr2=0x7fbb300692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbb30066e30 0x7fbb300692e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb340090b0 tx=0x7fbb34008030 comp rx=0 tx=0).stop 2023-03-27T10:10:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 msgr2=0x7fbb4415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4415b890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800d800 tx=0x7fbb3800dbc0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 shutdown_connections 2023-03-27T10:10:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb44072400 0x7fbb4415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbb30066e30 0x7fbb300692e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb4406ab40 0x7fbb441458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 --2- 172.21.15.172:0/1686595709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406da00 0x7fbb4415b890 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 >> 172.21.15.172:0/1686595709 conn(0x7fbb440b1010 msgr2=0x7fbb440b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 shutdown_connections 2023-03-27T10:10:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.735+0000 7fbb49fff700 1 -- 172.21.15.172:0/1686595709 wait complete. 2023-03-27T10:10:19.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:19.938 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.939+0000 7f375adff700 1 Processor -- start 2023-03-27T10:10:19.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.939+0000 7f375adff700 1 -- start start 2023-03-27T10:10:19.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.940+0000 7f375adff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37540b4300 0x7f37540cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.940+0000 7f375adff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37540ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.940+0000 7f375adff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3754071910 con 0x7f375415aab0 2023-03-27T10:10:19.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.940+0000 7f375adff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37540cbf00 con 0x7f37540b4300 2023-03-27T10:10:19.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.940+0000 7f375adff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375406d200 con 0x7f37540cba80 2023-03-27T10:10:19.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37540b4300 0x7f37540cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.941 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37540b4300 0x7f37540cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49514/0 (socket says 172.21.15.172:49514) 2023-03-27T10:10:19.941 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 -- 172.21.15.172:0/3782552039 learned_addr learned my addr 172.21.15.172:0/3782552039 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:19.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f375939c700 1 --2- 172.21.15.172:0/3782552039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37540ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 -- 172.21.15.172:0/3782552039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 msgr2=0x7f37540ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:19.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 --2- 172.21.15.172:0/3782552039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37540ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 -- 172.21.15.172:0/3782552039 >> v1:172.21.15.191:6789/0 conn(0x7f375415aab0 legacy=0x7f375406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 -- 172.21.15.172:0/3782552039 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37540712c0 con 0x7f37540b4300 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f3753fff700 1 --2- 172.21.15.172:0/3782552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37540b4300 0x7f37540cb540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f37400098f0 tx=0x7f3740009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fb9dc00a772959 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.941+0000 7f37537fe700 1 -- 172.21.15.172:0/3782552039 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000b8a0 con 0x7f37540b4300 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f37537fe700 1 -- 172.21.15.172:0/3782552039 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000ba00 con 0x7f37540b4300 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f37537fe700 1 -- 172.21.15.172:0/3782552039 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000bd90 con 0x7f37540b4300 2023-03-27T10:10:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 -- 172.21.15.172:0/3782552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37540b4300 msgr2=0x7f37540cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 --2- 172.21.15.172:0/3782552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37540b4300 0x7f37540cb540 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f37400098f0 tx=0x7f3740009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 -- 172.21.15.172:0/3782552039 shutdown_connections 2023-03-27T10:10:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 --2- 172.21.15.172:0/3782552039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37540ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 --2- 172.21.15.172:0/3782552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37540b4300 0x7f37540cb540 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 -- 172.21.15.172:0/3782552039 >> 172.21.15.172:0/3782552039 conn(0x7f375406a1a0 msgr2=0x7f375406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 -- 172.21.15.172:0/3782552039 shutdown_connections 2023-03-27T10:10:19.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.942+0000 7f375adff700 1 -- 172.21.15.172:0/3782552039 wait complete. 2023-03-27T10:10:19.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.945+0000 7f375adff700 1 Processor -- start 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.945+0000 7f375adff700 1 -- start start 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375adff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37540b4300 0x7f375415b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375adff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37541559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375adff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 0x7f37540c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375adff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375415b550 con 0x7f375415aab0 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375adff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540b1620 con 0x7f37540b4300 2023-03-27T10:10:19.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375adff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375415df90 con 0x7f37540cba80 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375939c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 0x7f37540c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375939c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 0x7f37540c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49518/0 (socket says 172.21.15.172:49518) 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f375939c700 1 -- 172.21.15.172:0/1796190433 learned_addr learned my addr 172.21.15.172:0/1796190433 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f3753fff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37541559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.946+0000 7f3758b9b700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37540b4300 0x7f375415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375939c700 1 -- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 msgr2=0x7f37541559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375939c700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37541559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375939c700 1 -- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37540b4300 msgr2=0x7f375415b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375939c700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37540b4300 0x7f375415b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375939c700 1 -- 172.21.15.172:0/1796190433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009550 con 0x7f375415aab0 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375939c700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 0x7f37540c9700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f374c007e60 tx=0x7f374c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00ed30 con 0x7f375415aab0 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c014420 con 0x7f375415aab0 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375415ae80 con 0x7f375415aab0 2023-03-27T10:10:19.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0147d0 con 0x7f375415aab0 2023-03-27T10:10:19.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.947+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540715a0 con 0x7f375415aab0 2023-03-27T10:10:19.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.948+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37540b19e0 con 0x7f375415aab0 2023-03-27T10:10:19.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.949+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f374c012050 con 0x7f375415aab0 2023-03-27T10:10:19.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.950+0000 7f37517fa700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3738066e30 0x7f37380692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:19.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.950+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f374c0847c0 con 0x7f375415aab0 2023-03-27T10:10:19.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.951+0000 7f3758b9b700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3738066e30 0x7f37380692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:19.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.951+0000 7f3758b9b700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3738066e30 0x7f37380692e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3748007fd0 tx=0x7f3748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:19.953 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:19.954+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f374c051a00 con 0x7f375415aab0 2023-03-27T10:10:20.139 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.139+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37540cc940 con 0x7f375415aab0 2023-03-27T10:10:20.139 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.140+0000 7f37517fa700 1 -- 172.21.15.172:0/1796190433 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37540cc940 con 0x7f375415aab0 2023-03-27T10:10:20.139 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:20.141 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3738066e30 msgr2=0x7f37380692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3738066e30 0x7f37380692e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3748007fd0 tx=0x7f3748009040 comp rx=0 tx=0).stop 2023-03-27T10:10:20.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 msgr2=0x7f37540c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 0x7f37540c9700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f374c007e60 tx=0x7f374c00e3c0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 shutdown_connections 2023-03-27T10:10:20.142 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375415aab0 0x7f37540c9700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3738066e30 0x7f37380692e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37540b4300 0x7f375415b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 --2- 172.21.15.172:0/1796190433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37540cba80 0x7f37541559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 >> 172.21.15.172:0/1796190433 conn(0x7f375406a1a0 msgr2=0x7f3754158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:20.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 shutdown_connections 2023-03-27T10:10:20.143 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.142+0000 7f375adff700 1 -- 172.21.15.172:0/1796190433 wait complete. 2023-03-27T10:10:20.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:20.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.346+0000 7fc1525ff700 1 Processor -- start 2023-03-27T10:10:20.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.346+0000 7fc1525ff700 1 -- start start 2023-03-27T10:10:20.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.347+0000 7fc1525ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc14c0ca280 0x7fc14c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.347+0000 7fc1525ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c15b0f0 0x7fc14c15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.347+0000 7fc1525ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c15d3d0 con 0x7fc14c159a00 2023-03-27T10:10:20.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.347+0000 7fc1525ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c15e1a0 con 0x7fc14c0ca280 2023-03-27T10:10:20.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.347+0000 7fc1525ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15e450 con 0x7fc14c15b0f0 2023-03-27T10:10:20.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc14b7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc14c0ca280 0x7fc14c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc150b9c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c15b0f0 0x7fc14c15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc150b9c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c15b0f0 0x7fc14c15dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:51674/0 (socket says 172.21.15.172:51674) 2023-03-27T10:10:20.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc150b9c700 1 -- 172.21.15.172:0/1947006806 learned_addr learned my addr 172.21.15.172:0/1947006806 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:20.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc14b7fe700 1 -- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c15b0f0 msgr2=0x7fc14c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:20.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc14b7fe700 1 --2- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c15b0f0 0x7fc14c15dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc14b7fe700 1 -- 172.21.15.172:0/1947006806 >> v1:172.21.15.191:6789/0 conn(0x7fc14c159a00 legacy=0x7fc14c0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc14b7fe700 1 -- 172.21.15.172:0/1947006806 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c070050 con 0x7fc14c0ca280 2023-03-27T10:10:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.348+0000 7fc14b7fe700 1 --2- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c0ca280 0x7fc14c15d720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc14000bae0 tx=0x7fc14000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b905f79589930bc server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc14affd700 1 -- 172.21.15.172:0/1947006806 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14000dc70 con 0x7fc14c0ca280 2023-03-27T10:10:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc14affd700 1 -- 172.21.15.172:0/1947006806 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14000ddd0 con 0x7fc14c0ca280 2023-03-27T10:10:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc14affd700 1 -- 172.21.15.172:0/1947006806 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140010690 con 0x7fc14c0ca280 2023-03-27T10:10:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 -- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c0ca280 msgr2=0x7fc14c15d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 --2- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c0ca280 0x7fc14c15d720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc14000bae0 tx=0x7fc14000bdf0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 -- 172.21.15.172:0/1947006806 shutdown_connections 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 --2- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c15b0f0 0x7fc14c15dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 --2- 172.21.15.172:0/1947006806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c0ca280 0x7fc14c15d720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 -- 172.21.15.172:0/1947006806 >> 172.21.15.172:0/1947006806 conn(0x7fc14c06a1a0 msgr2=0x7fc14c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 -- 172.21.15.172:0/1947006806 shutdown_connections 2023-03-27T10:10:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.349+0000 7fc1525ff700 1 -- 172.21.15.172:0/1947006806 wait complete. 2023-03-27T10:10:20.352 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.352+0000 7fc1525ff700 1 Processor -- start 2023-03-27T10:10:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.352+0000 7fc1525ff700 1 -- start start 2023-03-27T10:10:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc1525ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 0x7fc14c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc1525ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c159a00 0x7fc14c13f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc1525ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c15b0f0 0x7fc14c13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc1525ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c151e00 con 0x7fc14c0ca280 2023-03-27T10:10:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc1525ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0b26c0 con 0x7fc14c15b0f0 2023-03-27T10:10:20.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc1525ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0b29a0 con 0x7fc14c159a00 2023-03-27T10:10:20.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 0x7fc14c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 0x7fc14c153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49520/0 (socket says 172.21.15.172:49520) 2023-03-27T10:10:20.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc14bfff700 1 -- 172.21.15.172:0/971396866 learned_addr learned my addr 172.21.15.172:0/971396866 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:20.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc150b9c700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c15b0f0 0x7fc14c13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.354 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.353+0000 7fc14b7fe700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c159a00 0x7fc14c13f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.355 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc14bfff700 1 -- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c159a00 msgr2=0x7fc14c13f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.355 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc14bfff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c159a00 0x7fc14c13f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.355 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc14bfff700 1 -- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c15b0f0 msgr2=0x7fc14c13ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc14bfff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c15b0f0 0x7fc14c13ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc14bfff700 1 -- 172.21.15.172:0/971396866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14000b740 con 0x7fc14c0ca280 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc150b9c700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c15b0f0 0x7fc14c13ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc14bfff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 0x7fc14c153780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c4e0 tx=0x7fc13c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0052d0 con 0x7fc14c0ca280 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c005430 con 0x7fc14c0ca280 2023-03-27T10:10:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0038c0 con 0x7fc14c0ca280 2023-03-27T10:10:20.357 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.354+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c070610 con 0x7fc14c0ca280 2023-03-27T10:10:20.357 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.355+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c070330 con 0x7fc14c0ca280 2023-03-27T10:10:20.357 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.356+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c0708f0 con 0x7fc14c0ca280 2023-03-27T10:10:20.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.356+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc13c019030 con 0x7fc14c0ca280 2023-03-27T10:10:20.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.357+0000 7fc148ff9700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc138066e30 0x7fc1380692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.357+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc13c083550 con 0x7fc14c0ca280 2023-03-27T10:10:20.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.358+0000 7fc14b7fe700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc138066e30 0x7fc1380692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.359+0000 7fc14b7fe700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc138066e30 0x7fc1380692e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0ca670 tx=0x7fc140013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:20.360 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.361+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc13c050790 con 0x7fc14c0ca280 2023-03-27T10:10:20.547 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.548+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc14c151f40 con 0x7fc14c0ca280 2023-03-27T10:10:20.548 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.548+0000 7fc148ff9700 1 -- 172.21.15.172:0/971396866 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc13c053db0 con 0x7fc14c0ca280 2023-03-27T10:10:20.548 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:20.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.550+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc138066e30 msgr2=0x7fc1380692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.550+0000 7fc1525ff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc138066e30 0x7fc1380692e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0ca670 tx=0x7fc140013000 comp rx=0 tx=0).stop 2023-03-27T10:10:20.550 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.550+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 msgr2=0x7fc14c153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.550+0000 7fc1525ff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 0x7fc14c153780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c4e0 tx=0x7fc13c00c7f0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 shutdown_connections 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc138066e30 0x7fc1380692e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc14c15b0f0 0x7fc14c13ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc14c0ca280 0x7fc14c153780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 --2- 172.21.15.172:0/971396866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc14c159a00 0x7fc14c13f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.551 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 >> 172.21.15.172:0/971396866 conn(0x7fc14c06a1a0 msgr2=0x7fc14c15b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:20.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 shutdown_connections 2023-03-27T10:10:20.552 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.551+0000 7fc1525ff700 1 -- 172.21.15.172:0/971396866 wait complete. 2023-03-27T10:10:20.568 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:20.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.756+0000 7f03c7dff700 1 Processor -- start 2023-03-27T10:10:20.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.756+0000 7f03c7dff700 1 -- start start 2023-03-27T10:10:20.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c7dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f03c0159a00 0x7f03c00c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c7dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03c015de30 0x7f03c00ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c7dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c015d3d0 con 0x7f03c015b0f0 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c7dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c015e450 con 0x7f03c015de30 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c7dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c0070050 con 0x7f03c0159a00 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c639c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03c015de30 0x7f03c00ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c639c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03c015de30 0x7f03c00ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49536/0 (socket says 172.21.15.172:49536) 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c639c700 1 -- 172.21.15.172:0/4149540894 learned_addr learned my addr 172.21.15.172:0/4149540894 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.757+0000 7f03c5b9b700 1 --2- 172.21.15.172:0/4149540894 >> v2:172.21.15.191:3300/0 conn(0x7f03c0159a00 0x7f03c00c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c639c700 1 -- 172.21.15.172:0/4149540894 >> v2:172.21.15.191:3300/0 conn(0x7f03c0159a00 msgr2=0x7f03c00c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:20.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c639c700 1 --2- 172.21.15.172:0/4149540894 >> v2:172.21.15.191:3300/0 conn(0x7f03c0159a00 0x7f03c00c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c639c700 1 -- 172.21.15.172:0/4149540894 >> v1:172.21.15.191:6789/0 conn(0x7f03c015b0f0 legacy=0x7f03c015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c639c700 1 -- 172.21.15.172:0/4149540894 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0070330 con 0x7f03c015de30 2023-03-27T10:10:20.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c639c700 1 --2- 172.21.15.172:0/4149540894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c015de30 0x7f03c00ca0b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03c006d530 tx=0x7f03b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edfb34885689fd6 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:20.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c4b99700 1 -- 172.21.15.172:0/4149540894 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b800e070 con 0x7f03c015de30 2023-03-27T10:10:20.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c4b99700 1 -- 172.21.15.172:0/4149540894 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b800b910 con 0x7f03c015de30 2023-03-27T10:10:20.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.758+0000 7f03c4b99700 1 -- 172.21.15.172:0/4149540894 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b800bcc0 con 0x7f03c015de30 2023-03-27T10:10:20.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 -- 172.21.15.172:0/4149540894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c015de30 msgr2=0x7f03c00ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 --2- 172.21.15.172:0/4149540894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c015de30 0x7f03c00ca0b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03c006d530 tx=0x7f03b800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:20.761 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 -- 172.21.15.172:0/4149540894 shutdown_connections 2023-03-27T10:10:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 --2- 172.21.15.172:0/4149540894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c015de30 0x7f03c00ca0b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 --2- 172.21.15.172:0/4149540894 >> v2:172.21.15.191:3300/0 conn(0x7f03c0159a00 0x7f03c00c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 -- 172.21.15.172:0/4149540894 >> 172.21.15.172:0/4149540894 conn(0x7f03c006a1a0 msgr2=0x7f03c006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 -- 172.21.15.172:0/4149540894 shutdown_connections 2023-03-27T10:10:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.759+0000 7f03c7dff700 1 -- 172.21.15.172:0/4149540894 wait complete. 2023-03-27T10:10:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.761+0000 7f03c7dff700 1 Processor -- start 2023-03-27T10:10:20.763 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.761+0000 7f03c7dff700 1 -- start start 2023-03-27T10:10:20.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c7dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 0x7f03c01f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c7dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03c015b0f0 0x7f03c01e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c7dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03c015de30 0x7f03c01f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c7dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01e8a30 con 0x7f03c0159a00 2023-03-27T10:10:20.766 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c7dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01f3ce0 con 0x7f03c015de30 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c7dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01f3f80 con 0x7f03c015b0f0 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 0x7f03c01f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 0x7f03c01f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49550/0 (socket says 172.21.15.172:49550) 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 -- 172.21.15.172:0/321939869 learned_addr learned my addr 172.21.15.172:0/321939869 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c639c700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03c015de30 0x7f03c01f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c539a700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03c015b0f0 0x7f03c01e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 -- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03c015b0f0 msgr2=0x7f03c01e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03c015b0f0 0x7f03c01e84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 -- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03c015de30 msgr2=0x7f03c01f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03c015de30 0x7f03c01f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.762+0000 7f03c5b9b700 1 -- 172.21.15.172:0/321939869 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009b30 con 0x7f03c0159a00 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.763+0000 7f03c5b9b700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 0x7f03c01f2580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00e9b0 tx=0x7f03bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.763+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc009710 con 0x7f03c0159a00 2023-03-27T10:10:20.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.763+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00c850 con 0x7f03c0159a00 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.763+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00cbc0 con 0x7f03c0159a00 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.763+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00708f0 con 0x7f03c0159a00 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.763+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0070610 con 0x7f03c0159a00 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.764+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0159dd0 con 0x7f03c0159a00 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.765+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f03bc019030 con 0x7f03c0159a00 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.766+0000 7f03b67fc700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f03a4066e30 0x7f03a40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.766+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03bc084200 con 0x7f03c0159a00 2023-03-27T10:10:20.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.766+0000 7f03c539a700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f03a4066e30 0x7f03a40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:20.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.767+0000 7f03c539a700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f03a4066e30 0x7f03a40692e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000f60 tx=0x7f03b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:20.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.770+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f03bc051440 con 0x7f03c0159a00 2023-03-27T10:10:20.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.956+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03c01f4e70 con 0x7f03c0159a00 2023-03-27T10:10:20.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.956+0000 7f03b67fc700 1 -- 172.21.15.172:0/321939869 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03bc054a60 con 0x7f03c0159a00 2023-03-27T10:10:20.956 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:20.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f03a4066e30 msgr2=0x7f03a40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f03a4066e30 0x7f03a40692e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f03b0000f60 tx=0x7f03b0009040 comp rx=0 tx=0).stop 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 msgr2=0x7f03c01f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 0x7f03c01f2580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00e9b0 tx=0x7f03bc00ecc0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 shutdown_connections 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f03a4066e30 0x7f03a40692e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03c015de30 0x7f03c01f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c0159a00 0x7f03c01f2580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 --2- 172.21.15.172:0/321939869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03c015b0f0 0x7f03c01e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 >> 172.21.15.172:0/321939869 conn(0x7f03c006a1a0 msgr2=0x7f03c006a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:20.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 shutdown_connections 2023-03-27T10:10:20.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:20.959+0000 7f03c7dff700 1 -- 172.21.15.172:0/321939869 wait complete. 2023-03-27T10:10:20.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:21.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.158+0000 7f6342bff700 1 Processor -- start 2023-03-27T10:10:21.158 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.158+0000 7f6342bff700 1 -- start start 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f6342bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f633c0d0b90 0x7f633c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f6342bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0cebc0 con 0x7f633c0cd610 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f6342bff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0ceea0 con 0x7f633c15ca20 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f6342bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c0cf180 con 0x7f633c0d0b90 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f634099b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f633c0d0b90 0x7f633c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f634099b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f633c0d0b90 0x7f633c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49564/0 (socket says 172.21.15.172:49564) 2023-03-27T10:10:21.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f634099b700 1 -- 172.21.15.172:0/3898325315 learned_addr learned my addr 172.21.15.172:0/3898325315 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:21.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.159+0000 7f634119c700 1 --1- 172.21.15.172:0/3898325315 >> v1:172.21.15.172:6789/0 conn(0x7f633c0cd610 0x7f633c0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37356/0 (socket says 172.21.15.172:37356) 2023-03-27T10:10:21.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f634099b700 1 -- 172.21.15.172:0/3898325315 >> v1:172.21.15.191:6789/0 conn(0x7f633c15ca20 legacy=0x7f633c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f634099b700 1 -- 172.21.15.172:0/3898325315 >> v1:172.21.15.172:6789/0 conn(0x7f633c0cd610 legacy=0x7f633c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f634099b700 1 -- 172.21.15.172:0/3898325315 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0cf460 con 0x7f633c0d0b90 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f634099b700 1 --2- 172.21.15.172:0/3898325315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0d0b90 0x7f633c0ce500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63300098e0 tx=0x7f6330009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c888e83406691938 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f633b7fe700 1 -- 172.21.15.172:0/3898325315 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000b8a0 con 0x7f633c0d0b90 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f633b7fe700 1 -- 172.21.15.172:0/3898325315 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633000ba00 con 0x7f633c0d0b90 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.160+0000 7f633b7fe700 1 -- 172.21.15.172:0/3898325315 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000bdb0 con 0x7f633c0d0b90 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 -- 172.21.15.172:0/3898325315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0d0b90 msgr2=0x7f633c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 --2- 172.21.15.172:0/3898325315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0d0b90 0x7f633c0ce500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63300098e0 tx=0x7f6330009bf0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 -- 172.21.15.172:0/3898325315 shutdown_connections 2023-03-27T10:10:21.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 --2- 172.21.15.172:0/3898325315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0d0b90 0x7f633c0ce500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 -- 172.21.15.172:0/3898325315 >> 172.21.15.172:0/3898325315 conn(0x7f633c0721f0 msgr2=0x7f633c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:21.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 -- 172.21.15.172:0/3898325315 shutdown_connections 2023-03-27T10:10:21.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.161+0000 7f6342bff700 1 -- 172.21.15.172:0/3898325315 wait complete. 2023-03-27T10:10:21.164 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.163+0000 7f6342bff700 1 Processor -- start 2023-03-27T10:10:21.164 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.164+0000 7f6342bff700 1 -- start start 2023-03-27T10:10:21.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f6342bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 0x7f633c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.165 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f6342bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f633c0d0b90 0x7f633c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f6342bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f633c15ca20 0x7f633c06b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f6342bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c79c0 con 0x7f633c0cd610 2023-03-27T10:10:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f6342bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c7ca0 con 0x7f633c15ca20 2023-03-27T10:10:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f6342bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c7f80 con 0x7f633c0d0b90 2023-03-27T10:10:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 0x7f633c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 0x7f633c154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49572/0 (socket says 172.21.15.172:49572) 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 -- 172.21.15.172:0/2899040332 learned_addr learned my addr 172.21.15.172:0/2899040332 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 -- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f633c0d0b90 msgr2=0x7f633c0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f633c0d0b90 0x7f633c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 -- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f633c15ca20 msgr2=0x7f633c06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f633c15ca20 0x7f633c06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.165+0000 7f634099b700 1 -- 172.21.15.172:0/2899040332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300094f0 con 0x7f633c0cd610 2023-03-27T10:10:21.167 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.166+0000 7f634099b700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 0x7f633c154720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6330009c30 tx=0x7f6330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.166+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011e00 con 0x7f633c0cd610 2023-03-27T10:10:21.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.166+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633001f070 con 0x7f633c0cd610 2023-03-27T10:10:21.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.166+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c0d2d30 con 0x7f633c0cd610 2023-03-27T10:10:21.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.166+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300266c0 con 0x7f633c0cd610 2023-03-27T10:10:21.168 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.166+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c0afc50 con 0x7f633c0cd610 2023-03-27T10:10:21.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.167+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c0b0880 con 0x7f633c0cd610 2023-03-27T10:10:21.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.168+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f633000f050 con 0x7f633c0cd610 2023-03-27T10:10:21.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.169+0000 7f63397fa700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6320066e30 0x7f63200692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.169 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.169+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6330021070 con 0x7f633c0cd610 2023-03-27T10:10:21.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.169+0000 7f633bfff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6320066e30 0x7f63200692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.170+0000 7f633bfff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6320066e30 0x7f63200692e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6328000f60 tx=0x7f6328007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.172 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.173+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f6330053300 con 0x7f633c0cd610 2023-03-27T10:10:21.360 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.361+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633c074290 con 0x7f633c0cd610 2023-03-27T10:10:21.361 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.362+0000 7f63397fa700 1 -- 172.21.15.172:0/2899040332 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f633002b090 con 0x7f633c0cd610 2023-03-27T10:10:21.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:21.362 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:21.364 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6320066e30 msgr2=0x7f63200692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6320066e30 0x7f63200692e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6328000f60 tx=0x7f6328007a40 comp rx=0 tx=0).stop 2023-03-27T10:10:21.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 msgr2=0x7f633c154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 0x7f633c154720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6330009c30 tx=0x7f6330004750 comp rx=0 tx=0).stop 2023-03-27T10:10:21.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 shutdown_connections 2023-03-27T10:10:21.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6320066e30 0x7f63200692e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f633c15ca20 0x7f633c06b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.366 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.364+0000 7f6342bff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f633c0cd610 0x7f633c154720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.366 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.365+0000 7f6342bff700 1 --2- 172.21.15.172:0/2899040332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f633c0d0b90 0x7f633c0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.366 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.365+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 >> 172.21.15.172:0/2899040332 conn(0x7f633c0721f0 msgr2=0x7f633c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:21.366 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.365+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 shutdown_connections 2023-03-27T10:10:21.366 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.365+0000 7f6342bff700 1 -- 172.21.15.172:0/2899040332 wait complete. 2023-03-27T10:10:21.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:21.382 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.568+0000 7fc0989ff700 1 Processor -- start 2023-03-27T10:10:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.568+0000 7fc0989ff700 1 -- start start 2023-03-27T10:10:21.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.569+0000 7fc0989ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b1700 0x7fc0940d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.569+0000 7fc0989ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0940d02c0 0x7fc0940d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.569+0000 7fc0989ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940d0880 con 0x7fc0940b2020 2023-03-27T10:10:21.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.569+0000 7fc0989ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940cd680 con 0x7fc0940d02c0 2023-03-27T10:10:21.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.569+0000 7fc0989ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940cd960 con 0x7fc0940b1700 2023-03-27T10:10:21.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0940d02c0 0x7fc0940d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0940d02c0 0x7fc0940d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49584/0 (socket says 172.21.15.172:49584) 2023-03-27T10:10:21.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 -- 172.21.15.172:0/3991855884 learned_addr learned my addr 172.21.15.172:0/3991855884 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc09259c700 1 --2- 172.21.15.172:0/3991855884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b1700 0x7fc0940d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 -- 172.21.15.172:0/3991855884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b1700 msgr2=0x7fc0940d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 --2- 172.21.15.172:0/3991855884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b1700 0x7fc0940d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 -- 172.21.15.172:0/3991855884 >> v1:172.21.15.191:6789/0 conn(0x7fc0940b2020 legacy=0x7fc094160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.570+0000 7fc08bfff700 1 -- 172.21.15.172:0/3991855884 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940cdc40 con 0x7fc0940d02c0 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc08bfff700 1 --2- 172.21.15.172:0/3991855884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940d02c0 0x7fc0940d1030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0098f0 tx=0x7fc07c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493809b6d72c83f4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc091d9b700 1 -- 172.21.15.172:0/3991855884 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00b8a0 con 0x7fc0940d02c0 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc091d9b700 1 -- 172.21.15.172:0/3991855884 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c00ba00 con 0x7fc0940d02c0 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc091d9b700 1 -- 172.21.15.172:0/3991855884 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00bd90 con 0x7fc0940d02c0 2023-03-27T10:10:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc0989ff700 1 -- 172.21.15.172:0/3991855884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940d02c0 msgr2=0x7fc0940d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc0989ff700 1 --2- 172.21.15.172:0/3991855884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940d02c0 0x7fc0940d1030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0098f0 tx=0x7fc07c009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc0989ff700 1 -- 172.21.15.172:0/3991855884 shutdown_connections 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc0989ff700 1 --2- 172.21.15.172:0/3991855884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b1700 0x7fc0940d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc0989ff700 1 --2- 172.21.15.172:0/3991855884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940d02c0 0x7fc0940d1030 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.571+0000 7fc0989ff700 1 -- 172.21.15.172:0/3991855884 >> 172.21.15.172:0/3991855884 conn(0x7fc09409c260 msgr2=0x7fc0940d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.572+0000 7fc0989ff700 1 -- 172.21.15.172:0/3991855884 shutdown_connections 2023-03-27T10:10:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.572+0000 7fc0989ff700 1 -- 172.21.15.172:0/3991855884 wait complete. 2023-03-27T10:10:21.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.573+0000 7fc0989ff700 1 Processor -- start 2023-03-27T10:10:21.576 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.573+0000 7fc0989ff700 1 -- start start 2023-03-27T10:10:21.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.574+0000 7fc0989ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 0x7fc0940ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.574+0000 7fc0989ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b2020 0x7fc0941f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.574+0000 7fc0989ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0940d02c0 0x7fc0940b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.574+0000 7fc0989ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940ca7d0 con 0x7fc0940b1700 2023-03-27T10:10:21.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.574+0000 7fc0989ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940b7540 con 0x7fc0940d02c0 2023-03-27T10:10:21.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.574+0000 7fc0989ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415eb60 con 0x7fc0940b2020 2023-03-27T10:10:21.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 0x7fc0940ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 0x7fc0940ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49588/0 (socket says 172.21.15.172:49588) 2023-03-27T10:10:21.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 -- 172.21.15.172:0/2355192408 learned_addr learned my addr 172.21.15.172:0/2355192408 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:21.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc092d9d700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0940d02c0 0x7fc0940b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc08bfff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b2020 0x7fc0941f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 -- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b2020 msgr2=0x7fc0941f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b2020 0x7fc0941f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 -- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0940d02c0 msgr2=0x7fc0940b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0940d02c0 0x7fc0940b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 -- 172.21.15.172:0/2355192408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c009550 con 0x7fc0940b1700 2023-03-27T10:10:21.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.575+0000 7fc09259c700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 0x7fc0940ca290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc08400d800 tx=0x7fc08400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.576+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084017070 con 0x7fc0940b1700 2023-03-27T10:10:21.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.576+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084005a20 con 0x7fc0940b1700 2023-03-27T10:10:21.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.576+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084005bb0 con 0x7fc0940b1700 2023-03-27T10:10:21.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.576+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940cf450 con 0x7fc0940b1700 2023-03-27T10:10:21.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.576+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940cdf20 con 0x7fc0940b1700 2023-03-27T10:10:21.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.577+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940afb50 con 0x7fc0940b1700 2023-03-27T10:10:21.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.578+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc0840125f0 con 0x7fc0940b1700 2023-03-27T10:10:21.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.578+0000 7fc08affd700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc074066e30 0x7fc0740692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.579+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc084083d40 con 0x7fc0940b1700 2023-03-27T10:10:21.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.579+0000 7fc08bfff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc074066e30 0x7fc0740692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.580+0000 7fc08bfff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc074066e30 0x7fc0740692e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009c40 tx=0x7fc07c01d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.582+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc084050f80 con 0x7fc0940b1700 2023-03-27T10:10:21.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.769+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc09408c6e0 con 0x7fc0940b1700 2023-03-27T10:10:21.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.769+0000 7fc08affd700 1 -- 172.21.15.172:0/2355192408 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0840545a0 con 0x7fc0940b1700 2023-03-27T10:10:21.769 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:21.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc074066e30 msgr2=0x7fc0740692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc074066e30 0x7fc0740692e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009c40 tx=0x7fc07c01d040 comp rx=0 tx=0).stop 2023-03-27T10:10:21.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 msgr2=0x7fc0940ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 0x7fc0940ca290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc08400d800 tx=0x7fc08400db10 comp rx=0 tx=0).stop 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 shutdown_connections 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc074066e30 0x7fc0740692e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0940d02c0 0x7fc0940b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0940b1700 0x7fc0940ca290 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 --2- 172.21.15.172:0/2355192408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0940b2020 0x7fc0941f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 >> 172.21.15.172:0/2355192408 conn(0x7fc09409c260 msgr2=0x7fc0940b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:21.773 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 shutdown_connections 2023-03-27T10:10:21.773 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.772+0000 7fc0989ff700 1 -- 172.21.15.172:0/2355192408 wait complete. 2023-03-27T10:10:21.789 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:21.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.976+0000 7f49fabff700 1 Processor -- start 2023-03-27T10:10:21.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.976+0000 7f49fabff700 1 -- start start 2023-03-27T10:10:21.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.977+0000 7f49fabff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f415c520 0x7f49f40d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.977+0000 7f49fabff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f49f40d1000 0x7f49f40cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.977+0000 7f49fabff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40cdbf0 con 0x7f49f40cfd50 2023-03-27T10:10:21.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.977+0000 7f49fabff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40d2e80 con 0x7f49f40d1000 2023-03-27T10:10:21.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.977+0000 7f49fabff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40d01d0 con 0x7f49f415c520 2023-03-27T10:10:21.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f49f40d1000 0x7f49f40cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f899b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f415c520 0x7f49f40d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f919c700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f49f40cfd50 0x7f49f4160210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:50024/0 (socket says 172.21.15.172:50024) 2023-03-27T10:10:21.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f919c700 1 -- 172.21.15.172:0/909368586 learned_addr learned my addr 172.21.15.172:0/909368586 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f899b700 1 -- 172.21.15.172:0/909368586 >> v2:172.21.15.191:3300/0 conn(0x7f49f40d1000 msgr2=0x7f49f40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f899b700 1 --2- 172.21.15.172:0/909368586 >> v2:172.21.15.191:3300/0 conn(0x7f49f40d1000 0x7f49f40cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f899b700 1 -- 172.21.15.172:0/909368586 >> v1:172.21.15.191:6789/0 conn(0x7f49f40cfd50 legacy=0x7f49f4160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f37fe700 1 -- 172.21.15.172:0/909368586 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46218051 0 0) 0x7f49f40cdbf0 con 0x7f49f40cfd50 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f899b700 1 -- 172.21.15.172:0/909368586 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40d1430 con 0x7f49f415c520 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f3fff700 1 --2- 172.21.15.172:0/909368586 >> v2:172.21.15.191:3300/0 conn(0x7f49f40d1000 0x7f49f40cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.978+0000 7f49f899b700 1 --2- 172.21.15.172:0/909368586 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f415c520 0x7f49f40d0ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009d90 tx=0x7f49e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6b302a7aa36444 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49f37fe700 1 -- 172.21.15.172:0/909368586 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800e070 con 0x7f49f415c520 2023-03-27T10:10:21.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49f37fe700 1 -- 172.21.15.172:0/909368586 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e800bb20 con 0x7f49f415c520 2023-03-27T10:10:21.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49f37fe700 1 -- 172.21.15.172:0/909368586 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8012430 con 0x7f49f415c520 2023-03-27T10:10:21.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 -- 172.21.15.172:0/909368586 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f415c520 msgr2=0x7f49f40d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 --2- 172.21.15.172:0/909368586 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f415c520 0x7f49f40d0ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009d90 tx=0x7f49e800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 -- 172.21.15.172:0/909368586 shutdown_connections 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 --2- 172.21.15.172:0/909368586 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f415c520 0x7f49f40d0ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 --2- 172.21.15.172:0/909368586 >> v2:172.21.15.191:3300/0 conn(0x7f49f40d1000 0x7f49f40cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 -- 172.21.15.172:0/909368586 >> 172.21.15.172:0/909368586 conn(0x7f49f40721f0 msgr2=0x7f49f409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 -- 172.21.15.172:0/909368586 shutdown_connections 2023-03-27T10:10:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.979+0000 7f49fabff700 1 -- 172.21.15.172:0/909368586 wait complete. 2023-03-27T10:10:21.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.981+0000 7f49fabff700 1 Processor -- start 2023-03-27T10:10:21.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.981+0000 7f49fabff700 1 -- start start 2023-03-27T10:10:21.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49fabff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 0x7f49f414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49fabff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f40d1000 0x7f49f40cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49fabff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49f415c520 0x7f49f40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49fabff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f409d710 con 0x7f49f40cfd50 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49fabff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f409cd70 con 0x7f49f415c520 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49fabff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f409d050 con 0x7f49f40d1000 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49f899b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 0x7f49f414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.982+0000 7f49f899b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 0x7f49f414dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49596/0 (socket says 172.21.15.172:49596) 2023-03-27T10:10:21.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 -- 172.21.15.172:0/3951578803 learned_addr learned my addr 172.21.15.172:0/3951578803 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:21.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f3fff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f40d1000 0x7f49f40cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f919c700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49f415c520 0x7f49f40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 -- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f40d1000 msgr2=0x7f49f40cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f40d1000 0x7f49f40cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 -- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49f415c520 msgr2=0x7f49f40b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49f415c520 0x7f49f40b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 -- 172.21.15.172:0/3951578803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00094a0 con 0x7f49f40cfd50 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f899b700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 0x7f49f414dc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49e8014040 tx=0x7f49e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8012430 con 0x7f49f40cfd50 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8020070 con 0x7f49f40cfd50 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.983+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8004280 con 0x7f49f40cfd50 2023-03-27T10:10:21.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.984+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e8009a70 con 0x7f49f40cfd50 2023-03-27T10:10:21.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.984+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f40d0420 con 0x7f49f40cfd50 2023-03-27T10:10:21.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.985+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f40cd5e0 con 0x7f49f40cfd50 2023-03-27T10:10:21.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.985+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f49e802e070 con 0x7f49f40cfd50 2023-03-27T10:10:21.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.986+0000 7f49f17fa700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f49d8066e30 0x7f49d80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:21.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.986+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49e8022070 con 0x7f49f40cfd50 2023-03-27T10:10:21.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.987+0000 7f49f3fff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f49d8066e30 0x7f49d80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:21.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.987+0000 7f49f3fff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f49d8066e30 0x7f49d80692e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49f41f5180 tx=0x7f49e0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:21.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:21.991+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f49e80531a0 con 0x7f49f40cfd50 2023-03-27T10:10:22.177 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.178+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49f40cd880 con 0x7f49f40cfd50 2023-03-27T10:10:22.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.178+0000 7f49f17fa700 1 -- 172.21.15.172:0/3951578803 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49e802c020 con 0x7f49f40cfd50 2023-03-27T10:10:22.178 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:22.180 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f49d8066e30 msgr2=0x7f49d80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.180 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f49d8066e30 0x7f49d80692e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49f41f5180 tx=0x7f49e0009210 comp rx=0 tx=0).stop 2023-03-27T10:10:22.180 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 msgr2=0x7f49f414dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 0x7f49f414dc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49e8014040 tx=0x7f49e8004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 shutdown_connections 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f49d8066e30 0x7f49d80692e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49f415c520 0x7f49f40b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f40cfd50 0x7f49f414dc60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 --2- 172.21.15.172:0/3951578803 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49f40d1000 0x7f49f40cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 >> 172.21.15.172:0/3951578803 conn(0x7f49f40721f0 msgr2=0x7f49f40b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:22.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 shutdown_connections 2023-03-27T10:10:22.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.181+0000 7f49fabff700 1 -- 172.21.15.172:0/3951578803 wait complete. 2023-03-27T10:10:22.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:22.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.386+0000 7fb5525ff700 1 Processor -- start 2023-03-27T10:10:22.386 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.386+0000 7fb5525ff700 1 -- start start 2023-03-27T10:10:22.387 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.387+0000 7fb5525ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb54c159a00 0x7fb54c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.387 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.387+0000 7fb5525ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c0ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.387 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.387+0000 7fb5525ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c15d3d0 con 0x7fb54c15d720 2023-03-27T10:10:22.387 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.387+0000 7fb5525ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c15e450 con 0x7fb54c159a00 2023-03-27T10:10:22.387 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.387+0000 7fb5525ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c070050 con 0x7fb54c15b0f0 2023-03-27T10:10:22.387 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.387+0000 7fb54bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb54c159a00 0x7fb54c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb54c159a00 0x7fb54c0c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49610/0 (socket says 172.21.15.172:49610) 2023-03-27T10:10:22.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 -- 172.21.15.172:0/2082685203 learned_addr learned my addr 172.21.15.172:0/2082685203 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54b7fe700 1 --2- 172.21.15.172:0/2082685203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c0ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 -- 172.21.15.172:0/2082685203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 msgr2=0x7fb54c0ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 --2- 172.21.15.172:0/2082685203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c0ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 -- 172.21.15.172:0/2082685203 >> v1:172.21.15.172:6789/0 conn(0x7fb54c15d720 legacy=0x7fb54c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 -- 172.21.15.172:0/2082685203 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c070330 con 0x7fb54c159a00 2023-03-27T10:10:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54affd700 1 -- 172.21.15.172:0/2082685203 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819508296 0 0) 0x7fb54c15d3d0 con 0x7fb54c15d720 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54bfff700 1 --2- 172.21.15.172:0/2082685203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c159a00 0x7fb54c0c9b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0098f0 tx=0x7fb53c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4072f55274c52868 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54affd700 1 -- 172.21.15.172:0/2082685203 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00b8a0 con 0x7fb54c159a00 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54affd700 1 -- 172.21.15.172:0/2082685203 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c00ba00 con 0x7fb54c159a00 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.388+0000 7fb54affd700 1 -- 172.21.15.172:0/2082685203 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00bd90 con 0x7fb54c159a00 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 -- 172.21.15.172:0/2082685203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c159a00 msgr2=0x7fb54c0c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2082685203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c159a00 0x7fb54c0c9b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0098f0 tx=0x7fb53c009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 -- 172.21.15.172:0/2082685203 shutdown_connections 2023-03-27T10:10:22.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2082685203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c159a00 0x7fb54c0c9b70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2082685203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c0ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 -- 172.21.15.172:0/2082685203 >> 172.21.15.172:0/2082685203 conn(0x7fb54c06a1a0 msgr2=0x7fb54c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:22.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 -- 172.21.15.172:0/2082685203 shutdown_connections 2023-03-27T10:10:22.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.389+0000 7fb5525ff700 1 -- 172.21.15.172:0/2082685203 wait complete. 2023-03-27T10:10:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.391+0000 7fb5525ff700 1 Processor -- start 2023-03-27T10:10:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.391+0000 7fb5525ff700 1 -- start start 2023-03-27T10:10:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb5525ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb54c159a00 0x7fb54c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb5525ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb5525ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 0x7fb54c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb5525ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0b3d00 con 0x7fb54c15d720 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb5525ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c153460 con 0x7fb54c159a00 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb5525ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0b30f0 con 0x7fb54c15b0f0 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb550b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 0x7fb54c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb550b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 0x7fb54c0b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49622/0 (socket says 172.21.15.172:49622) 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb550b9c700 1 -- 172.21.15.172:0/2813227742 learned_addr learned my addr 172.21.15.172:0/2813227742 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb54b7fe700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.392+0000 7fb54bfff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb54c159a00 0x7fb54c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb550b9c700 1 -- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 msgr2=0x7fb54c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb550b9c700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb550b9c700 1 -- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb54c159a00 msgr2=0x7fb54c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb550b9c700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb54c159a00 0x7fb54c155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb550b9c700 1 -- 172.21.15.172:0/2813227742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c009550 con 0x7fb54c15d720 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb54bfff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb54c159a00 0x7fb54c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb550b9c700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 0x7fb54c0b4190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb544001560 tx=0x7fb54400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:22.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544003e30 con 0x7fb54c15d720 2023-03-27T10:10:22.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544005070 con 0x7fb54c15d720 2023-03-27T10:10:22.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c0708f0 con 0x7fb54c15d720 2023-03-27T10:10:22.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544005420 con 0x7fb54c15d720 2023-03-27T10:10:22.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.393+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c070610 con 0x7fb54c15d720 2023-03-27T10:10:22.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.394+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c159dd0 con 0x7fb54c15d720 2023-03-27T10:10:22.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.395+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fb544019030 con 0x7fb54c15d720 2023-03-27T10:10:22.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.396+0000 7fb548ff9700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb538066e30 0x7fb5380692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.396+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb544083830 con 0x7fb54c15d720 2023-03-27T10:10:22.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.397+0000 7fb54bfff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb538066e30 0x7fb5380692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.398+0000 7fb54bfff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb538066e30 0x7fb5380692e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb53c014040 tx=0x7fb53c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:22.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.400+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fb544050a70 con 0x7fb54c15d720 2023-03-27T10:10:22.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.587+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb54c074300 con 0x7fb54c15d720 2023-03-27T10:10:22.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.588+0000 7fb548ff9700 1 -- 172.21.15.172:0/2813227742 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5440170a0 con 0x7fb54c15d720 2023-03-27T10:10:22.588 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:22.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb538066e30 msgr2=0x7fb5380692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb538066e30 0x7fb5380692e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb53c014040 tx=0x7fb53c008030 comp rx=0 tx=0).stop 2023-03-27T10:10:22.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 msgr2=0x7fb54c0b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 0x7fb54c0b4190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb544001560 tx=0x7fb54400cb50 comp rx=0 tx=0).stop 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 shutdown_connections 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb54c15d720 0x7fb54c0b4190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb538066e30 0x7fb5380692e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb54c159a00 0x7fb54c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 --2- 172.21.15.172:0/2813227742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb54c15b0f0 0x7fb54c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 >> 172.21.15.172:0/2813227742 conn(0x7fb54c06a1a0 msgr2=0x7fb54c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:22.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 shutdown_connections 2023-03-27T10:10:22.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.590+0000 7fb5525ff700 1 -- 172.21.15.172:0/2813227742 wait complete. 2023-03-27T10:10:22.607 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:22.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.793+0000 7f86e6dff700 1 Processor -- start 2023-03-27T10:10:22.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.793+0000 7f86e6dff700 1 -- start start 2023-03-27T10:10:22.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.794+0000 7f86e6dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f86e015a240 0x7f86e00d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.794+0000 7f86e6dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86e0160bc0 0x7f86e00d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.794+0000 7f86e6dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e00d29d0 con 0x7f86e00d3a30 2023-03-27T10:10:22.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.794+0000 7f86e6dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0161200 con 0x7f86e0160bc0 2023-03-27T10:10:22.794 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.794+0000 7f86e6dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0161000 con 0x7f86e015a240 2023-03-27T10:10:22.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86e0160bc0 0x7f86e00d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86dffff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f86e00d3a30 0x7f86e01604b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37366/0 (socket says 172.21.15.172:37366) 2023-03-27T10:10:22.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86dffff700 1 -- 172.21.15.172:0/1858189097 learned_addr learned my addr 172.21.15.172:0/1858189097 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:22.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86e0160bc0 0x7f86e00d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49634/0 (socket says 172.21.15.172:49634) 2023-03-27T10:10:22.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e4b9b700 1 --2- 172.21.15.172:0/1858189097 >> v2:172.21.15.191:3300/0 conn(0x7f86e015a240 0x7f86e00d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 -- 172.21.15.172:0/1858189097 >> v2:172.21.15.191:3300/0 conn(0x7f86e015a240 msgr2=0x7f86e00d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 --2- 172.21.15.172:0/1858189097 >> v2:172.21.15.191:3300/0 conn(0x7f86e015a240 0x7f86e00d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 -- 172.21.15.172:0/1858189097 >> v1:172.21.15.172:6789/0 conn(0x7f86e00d3a30 legacy=0x7f86e01604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 -- 172.21.15.172:0/1858189097 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e015a610 con 0x7f86e0160bc0 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86df7fe700 1 -- 172.21.15.172:0/1858189097 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854300582 0 0) 0x7f86e00d29d0 con 0x7f86e00d3a30 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.795+0000 7f86e539c700 1 --2- 172.21.15.172:0/1858189097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e0160bc0 0x7f86e00d1000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f86e00d09b0 tx=0x7f86d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1829dfa7698db75b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86df7fe700 1 -- 172.21.15.172:0/1858189097 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800e070 con 0x7f86e0160bc0 2023-03-27T10:10:22.797 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86df7fe700 1 -- 172.21.15.172:0/1858189097 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800bbd0 con 0x7f86e0160bc0 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86df7fe700 1 -- 172.21.15.172:0/1858189097 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8012430 con 0x7f86e0160bc0 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 -- 172.21.15.172:0/1858189097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e0160bc0 msgr2=0x7f86e00d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 --2- 172.21.15.172:0/1858189097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e0160bc0 0x7f86e00d1000 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f86e00d09b0 tx=0x7f86d800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 -- 172.21.15.172:0/1858189097 shutdown_connections 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 --2- 172.21.15.172:0/1858189097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e0160bc0 0x7f86e00d1000 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 --2- 172.21.15.172:0/1858189097 >> v2:172.21.15.191:3300/0 conn(0x7f86e015a240 0x7f86e00d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 -- 172.21.15.172:0/1858189097 >> 172.21.15.172:0/1858189097 conn(0x7f86e00721f0 msgr2=0x7f86e009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:22.798 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 -- 172.21.15.172:0/1858189097 shutdown_connections 2023-03-27T10:10:22.799 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.796+0000 7f86e6dff700 1 -- 172.21.15.172:0/1858189097 wait complete. 2023-03-27T10:10:22.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.798+0000 7f86e6dff700 1 Processor -- start 2023-03-27T10:10:22.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.798+0000 7f86e6dff700 1 -- start start 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e6dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 0x7f86e00c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e6dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86e015a240 0x7f86e006aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e6dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86e0160bc0 0x7f86e006b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e6dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b5d20 con 0x7f86e00d3a30 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e6dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00b6000 con 0x7f86e0160bc0 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e6dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e0148410 con 0x7f86e015a240 2023-03-27T10:10:22.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e4b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 0x7f86e00c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e4b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 0x7f86e00c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49636/0 (socket says 172.21.15.172:49636) 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.799+0000 7f86e4b9b700 1 -- 172.21.15.172:0/8381676 learned_addr learned my addr 172.21.15.172:0/8381676 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86dffff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86e015a240 0x7f86e006aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e539c700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86e0160bc0 0x7f86e006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e4b9b700 1 -- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86e015a240 msgr2=0x7f86e006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e4b9b700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86e015a240 0x7f86e006aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e4b9b700 1 -- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86e0160bc0 msgr2=0x7f86e006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e4b9b700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86e0160bc0 0x7f86e006b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e4b9b700 1 -- 172.21.15.172:0/8381676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8009a70 con 0x7f86e00d3a30 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e539c700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86e0160bc0 0x7f86e006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86dffff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86e015a240 0x7f86e006aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e4b9b700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 0x7f86e00c5d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86d400e810 tx=0x7f86d400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4013610 con 0x7f86e00d3a30 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d4013770 con 0x7f86e00d3a30 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4013b20 con 0x7f86e00d3a30 2023-03-27T10:10:22.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00d2f50 con 0x7f86e00d3a30 2023-03-27T10:10:22.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.800+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e00d2c70 con 0x7f86e00d3a30 2023-03-27T10:10:22.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.802+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e00d3230 con 0x7f86e00d3a30 2023-03-27T10:10:22.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.802+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f86d4023070 con 0x7f86e00d3a30 2023-03-27T10:10:22.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.803+0000 7f86dd7fa700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f86c4066e30 0x7f86c40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:22.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.804+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f86d4083ff0 con 0x7f86e00d3a30 2023-03-27T10:10:22.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.804+0000 7f86dffff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f86c4066e30 0x7f86c40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:22.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.804+0000 7f86dffff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f86c4066e30 0x7f86c40692e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86e0157ac0 tx=0x7f86cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:22.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.807+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f86d40511b0 con 0x7f86e00d3a30 2023-03-27T10:10:22.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.996+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86e00b62e0 con 0x7f86e00d3a30 2023-03-27T10:10:22.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.997+0000 7f86dd7fa700 1 -- 172.21.15.172:0/8381676 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86d40547d0 con 0x7f86e00d3a30 2023-03-27T10:10:22.997 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:22.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f86c4066e30 msgr2=0x7f86c40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f86c4066e30 0x7f86c40692e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86e0157ac0 tx=0x7f86cc009040 comp rx=0 tx=0).stop 2023-03-27T10:10:22.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 msgr2=0x7f86e00c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:22.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 0x7f86e00c5d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f86d400e810 tx=0x7f86d400ebd0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 shutdown_connections 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f86c4066e30 0x7f86c40692e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86e0160bc0 0x7f86e006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86e00d3a30 0x7f86e00c5d50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 --2- 172.21.15.172:0/8381676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86e015a240 0x7f86e006aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:22.999+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 >> 172.21.15.172:0/8381676 conn(0x7f86e00721f0 msgr2=0x7f86e01594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.000+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 shutdown_connections 2023-03-27T10:10:23.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.000+0000 7f86e6dff700 1 -- 172.21.15.172:0/8381676 wait complete. 2023-03-27T10:10:23.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:23.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.201+0000 7fbfc65ff700 1 Processor -- start 2023-03-27T10:10:23.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.201+0000 7fbfc65ff700 1 -- start start 2023-03-27T10:10:23.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.202+0000 7fbfc65ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfc00d0b90 0x7fbfc00ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.202+0000 7fbfc65ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc015ca20 0x7fbfc00d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.202+0000 7fbfc65ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbfc00cd610 0x7fbfc00cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.202+0000 7fbfc65ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00d14a0 con 0x7fbfc00d0b90 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.202+0000 7fbfc65ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00cebc0 con 0x7fbfc00cd610 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.202+0000 7fbfc65ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00ceea0 con 0x7fbfc015ca20 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfc00d0b90 0x7fbfc00ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfc00d0b90 0x7fbfc00ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49638/0 (socket says 172.21.15.172:49638) 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 -- 172.21.15.172:0/3902847706 learned_addr learned my addr 172.21.15.172:0/3902847706 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfc4b9c700 1 --2- 172.21.15.172:0/3902847706 >> v2:172.21.15.191:3300/0 conn(0x7fbfc00cd610 0x7fbfc00cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbf7fe700 1 --2- 172.21.15.172:0/3902847706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc015ca20 0x7fbfc00d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 -- 172.21.15.172:0/3902847706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc015ca20 msgr2=0x7fbfc00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 --2- 172.21.15.172:0/3902847706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc015ca20 0x7fbfc00d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 -- 172.21.15.172:0/3902847706 >> v2:172.21.15.191:3300/0 conn(0x7fbfc00cd610 msgr2=0x7fbfc00cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 --2- 172.21.15.172:0/3902847706 >> v2:172.21.15.191:3300/0 conn(0x7fbfc00cd610 0x7fbfc00cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 -- 172.21.15.172:0/3902847706 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00cf180 con 0x7fbfc00d0b90 2023-03-27T10:10:23.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbffff700 1 --2- 172.21.15.172:0/3902847706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00d0b90 0x7fbfc00ce500 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbfc008bec0 tx=0x7fbfb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcbd325c9f8d17 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:23.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.203+0000 7fbfbeffd700 1 -- 172.21.15.172:0/3902847706 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0005e30 con 0x7fbfc00d0b90 2023-03-27T10:10:23.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfbeffd700 1 -- 172.21.15.172:0/3902847706 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0004030 con 0x7fbfc00d0b90 2023-03-27T10:10:23.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfbeffd700 1 -- 172.21.15.172:0/3902847706 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00043e0 con 0x7fbfc00d0b90 2023-03-27T10:10:23.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 -- 172.21.15.172:0/3902847706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00d0b90 msgr2=0x7fbfc00ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/3902847706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00d0b90 0x7fbfc00ce500 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbfc008bec0 tx=0x7fbfb0009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 -- 172.21.15.172:0/3902847706 shutdown_connections 2023-03-27T10:10:23.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/3902847706 >> v2:172.21.15.191:3300/0 conn(0x7fbfc00cd610 0x7fbfc00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/3902847706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00d0b90 0x7fbfc00ce500 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/3902847706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc015ca20 0x7fbfc00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 -- 172.21.15.172:0/3902847706 >> 172.21.15.172:0/3902847706 conn(0x7fbfc00721f0 msgr2=0x7fbfc009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:23.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 -- 172.21.15.172:0/3902847706 shutdown_connections 2023-03-27T10:10:23.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.204+0000 7fbfc65ff700 1 -- 172.21.15.172:0/3902847706 wait complete. 2023-03-27T10:10:23.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.206+0000 7fbfc65ff700 1 Processor -- start 2023-03-27T10:10:23.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.206+0000 7fbfc65ff700 1 -- start start 2023-03-27T10:10:23.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfc65ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 0x7fbfc00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfc65ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc00d0b90 0x7fbfc015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfc65ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfc015ca20 0x7fbfc009e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfc65ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc015ab60 con 0x7fbfc00cd610 2023-03-27T10:10:23.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfc65ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc015ae40 con 0x7fbfc015ca20 2023-03-27T10:10:23.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfc65ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc015b120 con 0x7fbfc00d0b90 2023-03-27T10:10:23.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 0x7fbfc00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 0x7fbfc00b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49650/0 (socket says 172.21.15.172:49650) 2023-03-27T10:10:23.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.207+0000 7fbfbffff700 1 -- 172.21.15.172:0/1948413413 learned_addr learned my addr 172.21.15.172:0/1948413413 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:23.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbf7fe700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc00d0b90 0x7fbfc015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbffff700 1 -- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc00d0b90 msgr2=0x7fbfc015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfc4b9c700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfc015ca20 0x7fbfc009e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbffff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc00d0b90 0x7fbfc015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbffff700 1 -- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfc015ca20 msgr2=0x7fbfc009e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbffff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfc015ca20 0x7fbfc009e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbffff700 1 -- 172.21.15.172:0/1948413413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009500 con 0x7fbfc00cd610 2023-03-27T10:10:23.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbf7fe700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc00d0b90 0x7fbfc015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:23.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfc4b9c700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfc015ca20 0x7fbfc009e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:23.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbffff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 0x7fbfc00b4e80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009130 tx=0x7fbfb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:23.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0003dd0 con 0x7fbfc00cd610 2023-03-27T10:10:23.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0011420 con 0x7fbfc00cd610 2023-03-27T10:10:23.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00117d0 con 0x7fbfc00cd610 2023-03-27T10:10:23.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc00afc50 con 0x7fbfc00cd610 2023-03-27T10:10:23.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.208+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc00cf460 con 0x7fbfc00cd610 2023-03-27T10:10:23.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.209+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc00d2d30 con 0x7fbfc00cd610 2023-03-27T10:10:23.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.210+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fbfb002c070 con 0x7fbfc00cd610 2023-03-27T10:10:23.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.211+0000 7fbfbcff9700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbfac066e30 0x7fbfac0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.211+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfb0085410 con 0x7fbfc00cd610 2023-03-27T10:10:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.212+0000 7fbfbf7fe700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbfac066e30 0x7fbfac0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.212+0000 7fbfbf7fe700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbfac066e30 0x7fbfac0692e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbfc006bbc0 tx=0x7fbfb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.215+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fbfb0052650 con 0x7fbfc00cd610 2023-03-27T10:10:23.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.407+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfc0074290 con 0x7fbfc00cd610 2023-03-27T10:10:23.407 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.408+0000 7fbfbcff9700 1 -- 172.21.15.172:0/1948413413 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7fbfb0055c70 con 0x7fbfc00cd610 2023-03-27T10:10:23.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:23.408 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:23.410 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbfac066e30 msgr2=0x7fbfac0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.410 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbfac066e30 0x7fbfac0692e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbfc006bbc0 tx=0x7fbfb4008040 comp rx=0 tx=0).stop 2023-03-27T10:10:23.410 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 msgr2=0x7fbfc00b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.410 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 0x7fbfc00b4e80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009130 tx=0x7fbfb0004750 comp rx=0 tx=0).stop 2023-03-27T10:10:23.410 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 shutdown_connections 2023-03-27T10:10:23.410 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbfac066e30 0x7fbfac0692e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfc015ca20 0x7fbfc009e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfc00cd610 0x7fbfc00b4e80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 --2- 172.21.15.172:0/1948413413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfc00d0b90 0x7fbfc015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.410+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 >> 172.21.15.172:0/1948413413 conn(0x7fbfc00721f0 msgr2=0x7fbfc00cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:23.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.411+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 shutdown_connections 2023-03-27T10:10:23.411 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.411+0000 7fbfc65ff700 1 -- 172.21.15.172:0/1948413413 wait complete. 2023-03-27T10:10:23.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:23.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:23.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.615+0000 7f0c915ff700 1 Processor -- start 2023-03-27T10:10:23.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.616+0000 7f0c915ff700 1 -- start start 2023-03-27T10:10:23.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c915ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0b1700 0x7f0c8c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c915ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 0x7f0c8c0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c915ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c8c0b2020 0x7f0c8c160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c915ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0d0880 con 0x7f0c8c0d02c0 2023-03-27T10:10:23.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c915ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cd680 con 0x7f0c8c0b2020 2023-03-27T10:10:23.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c915ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0cd960 con 0x7f0c8c0b1700 2023-03-27T10:10:23.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.617+0000 7f0c8a7fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 0x7f0c8c0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0b1700 0x7f0c8c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8a7fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 0x7f0c8c0d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49662/0 (socket says 172.21.15.172:49662) 2023-03-27T10:10:23.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8a7fc700 1 -- 172.21.15.172:0/3289361612 learned_addr learned my addr 172.21.15.172:0/3289361612 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:23.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8b7fe700 1 --2- 172.21.15.172:0/3289361612 >> v2:172.21.15.191:3300/0 conn(0x7f0c8c0b2020 0x7f0c8c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 -- 172.21.15.172:0/3289361612 >> v2:172.21.15.191:3300/0 conn(0x7f0c8c0b2020 msgr2=0x7f0c8c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 --2- 172.21.15.172:0/3289361612 >> v2:172.21.15.191:3300/0 conn(0x7f0c8c0b2020 0x7f0c8c160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 -- 172.21.15.172:0/3289361612 >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 msgr2=0x7f0c8c0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 --2- 172.21.15.172:0/3289361612 >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 0x7f0c8c0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 -- 172.21.15.172:0/3289361612 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0cdc40 con 0x7f0c8c0b1700 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8a7fc700 1 --2- 172.21.15.172:0/3289361612 >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 0x7f0c8c0d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.618+0000 7f0c8affd700 1 --2- 172.21.15.172:0/3289361612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0b1700 0x7f0c8c0d0af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c1615b0 tx=0x7f0c7c009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f96143225b7be169 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c89ffb700 1 -- 172.21.15.172:0/3289361612 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c005e30 con 0x7f0c8c0b1700 2023-03-27T10:10:23.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c89ffb700 1 -- 172.21.15.172:0/3289361612 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c006030 con 0x7f0c8c0b1700 2023-03-27T10:10:23.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c89ffb700 1 -- 172.21.15.172:0/3289361612 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0063c0 con 0x7f0c8c0b1700 2023-03-27T10:10:23.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 -- 172.21.15.172:0/3289361612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0b1700 msgr2=0x7f0c8c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 --2- 172.21.15.172:0/3289361612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0b1700 0x7f0c8c0d0af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c1615b0 tx=0x7f0c7c009b00 comp rx=0 tx=0).stop 2023-03-27T10:10:23.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 -- 172.21.15.172:0/3289361612 shutdown_connections 2023-03-27T10:10:23.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 --2- 172.21.15.172:0/3289361612 >> v2:172.21.15.191:3300/0 conn(0x7f0c8c0b2020 0x7f0c8c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 --2- 172.21.15.172:0/3289361612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0b1700 0x7f0c8c0d0af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 --2- 172.21.15.172:0/3289361612 >> v2:172.21.15.172:3300/0 conn(0x7f0c8c0d02c0 0x7f0c8c0d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.619+0000 7f0c915ff700 1 -- 172.21.15.172:0/3289361612 >> 172.21.15.172:0/3289361612 conn(0x7f0c8c09c260 msgr2=0x7f0c8c0d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:23.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.620+0000 7f0c915ff700 1 -- 172.21.15.172:0/3289361612 shutdown_connections 2023-03-27T10:10:23.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.620+0000 7f0c915ff700 1 -- 172.21.15.172:0/3289361612 wait complete. 2023-03-27T10:10:23.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.622+0000 7f0c915ff700 1 Processor -- start 2023-03-27T10:10:23.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.622+0000 7f0c915ff700 1 -- start start 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.623+0000 7f0c915ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 0x7f0c8c1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.623+0000 7f0c915ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c8c0b2020 0x7f0c8c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.623+0000 7f0c915ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0d02c0 0x7f0c8c0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.623+0000 7f0c915ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c159620 con 0x7f0c8c0b1700 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.623+0000 7f0c915ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c158a10 con 0x7f0c8c0b2020 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.623+0000 7f0c915ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c158cf0 con 0x7f0c8c0d02c0 2023-03-27T10:10:23.624 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 0x7f0c8c1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 0x7f0c8c1f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49670/0 (socket says 172.21.15.172:49670) 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 -- 172.21.15.172:0/1456587117 learned_addr learned my addr 172.21.15.172:0/1456587117 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8a7fc700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c8c0b2020 0x7f0c8c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8b7fe700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0d02c0 0x7f0c8c0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 -- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0d02c0 msgr2=0x7f0c8c0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0d02c0 0x7f0c8c0b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.625 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 -- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c8c0b2020 msgr2=0x7f0c8c0b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c8c0b2020 0x7f0c8c0b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 -- 172.21.15.172:0/1456587117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009550 con 0x7f0c8c0b1700 2023-03-27T10:10:23.626 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c8affd700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 0x7f0c8c1f5b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009b40 tx=0x7f0c7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:23.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0069c0 con 0x7f0c8c0b1700 2023-03-27T10:10:23.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c004040 con 0x7f0c8c0b1700 2023-03-27T10:10:23.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.624+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c009430 con 0x7f0c8c0b1700 2023-03-27T10:10:23.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.625+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0043f0 con 0x7f0c8c0b1700 2023-03-27T10:10:23.627 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.625+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c0afb50 con 0x7f0c8c0b1700 2023-03-27T10:10:23.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.626+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c0cdf20 con 0x7f0c8c0b1700 2023-03-27T10:10:23.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.626+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0c7c02c070 con 0x7f0c8c0b1700 2023-03-27T10:10:23.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.627+0000 7f0c737fe700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0c78066e30 0x7f0c780692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:23.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.627+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c7c085720 con 0x7f0c8c0b1700 2023-03-27T10:10:23.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.628+0000 7f0c8a7fc700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0c78066e30 0x7f0c780692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:23.628 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.628+0000 7f0c8a7fc700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0c78066e30 0x7f0c780692e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c155010 tx=0x7f0c800092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:23.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.631+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f0c7c0528e0 con 0x7f0c8c0b1700 2023-03-27T10:10:23.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.818+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c8c0d2c50 con 0x7f0c8c0b1700 2023-03-27T10:10:23.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.819+0000 7f0c737fe700 1 -- 172.21.15.172:0/1456587117 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c7c055f00 con 0x7f0c8c0b1700 2023-03-27T10:10:23.819 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:23.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0c78066e30 msgr2=0x7f0c780692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0c78066e30 0x7f0c780692e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c155010 tx=0x7f0c800092c0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 msgr2=0x7f0c8c1f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:23.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 0x7f0c8c1f5b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009b40 tx=0x7f0c7c004750 comp rx=0 tx=0).stop 2023-03-27T10:10:23.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 shutdown_connections 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c8c0d02c0 0x7f0c8c0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c8c0b1700 0x7f0c8c1f5b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0c78066e30 0x7f0c780692e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 --2- 172.21.15.172:0/1456587117 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c8c0b2020 0x7f0c8c0b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 >> 172.21.15.172:0/1456587117 conn(0x7f0c8c09c260 msgr2=0x7f0c8c0ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.821+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 shutdown_connections 2023-03-27T10:10:23.822 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:23.822+0000 7f0c915ff700 1 -- 172.21.15.172:0/1456587117 wait complete. 2023-03-27T10:10:23.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:24.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.023+0000 7ff4b89ff700 1 Processor -- start 2023-03-27T10:10:24.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.024+0000 7ff4b89ff700 1 -- start start 2023-03-27T10:10:24.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b89ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff4b415c680 0x7ff4b41601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b89ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4b40d3970 0x7ff4b41606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.024 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b89ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40d3e10 con 0x7ff4b4160c20 2023-03-27T10:10:24.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b89ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b4160ff0 con 0x7ff4b40d3970 2023-03-27T10:10:24.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b89ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b415dea0 con 0x7ff4b415c680 2023-03-27T10:10:24.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4b40d3970 0x7ff4b41606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4b40d3970 0x7ff4b41606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49684/0 (socket says 172.21.15.172:49684) 2023-03-27T10:10:24.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b2d9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff4b4160c20 0x7ff4b415ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37382/0 (socket says 172.21.15.172:37382) 2023-03-27T10:10:24.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 -- 172.21.15.172:0/802023761 learned_addr learned my addr 172.21.15.172:0/802023761 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:24.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b259c700 1 --2- 172.21.15.172:0/802023761 >> v2:172.21.15.191:3300/0 conn(0x7ff4b415c680 0x7ff4b41601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 -- 172.21.15.172:0/802023761 >> v2:172.21.15.191:3300/0 conn(0x7ff4b415c680 msgr2=0x7ff4b41601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:24.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 --2- 172.21.15.172:0/802023761 >> v2:172.21.15.191:3300/0 conn(0x7ff4b415c680 0x7ff4b41601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 -- 172.21.15.172:0/802023761 >> v1:172.21.15.172:6789/0 conn(0x7ff4b4160c20 legacy=0x7ff4b415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4abfff700 1 -- 172.21.15.172:0/802023761 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b415e180 con 0x7ff4b40d3970 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.025+0000 7ff4b259c700 1 --2- 172.21.15.172:0/802023761 >> v2:172.21.15.191:3300/0 conn(0x7ff4b415c680 0x7ff4b41601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.026+0000 7ff4abfff700 1 --2- 172.21.15.172:0/802023761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b40d3970 0x7ff4b41606e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff4b408b240 tx=0x7ff49c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33787ffd8a546fdf server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.026+0000 7ff4b1d9b700 1 -- 172.21.15.172:0/802023761 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00b870 con 0x7ff4b40d3970 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.026+0000 7ff4b1d9b700 1 -- 172.21.15.172:0/802023761 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c00b9d0 con 0x7ff4b40d3970 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.026+0000 7ff4b1d9b700 1 -- 172.21.15.172:0/802023761 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00bd60 con 0x7ff4b40d3970 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.026+0000 7ff4b89ff700 1 -- 172.21.15.172:0/802023761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b40d3970 msgr2=0x7ff4b41606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.026+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/802023761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b40d3970 0x7ff4b41606e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff4b408b240 tx=0x7ff49c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.027+0000 7ff4b89ff700 1 -- 172.21.15.172:0/802023761 shutdown_connections 2023-03-27T10:10:24.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.027+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/802023761 >> v2:172.21.15.191:3300/0 conn(0x7ff4b415c680 0x7ff4b41601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.027+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/802023761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b40d3970 0x7ff4b41606e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.027+0000 7ff4b89ff700 1 -- 172.21.15.172:0/802023761 >> 172.21.15.172:0/802023761 conn(0x7ff4b409c210 msgr2=0x7ff4b40d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:24.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.027+0000 7ff4b89ff700 1 -- 172.21.15.172:0/802023761 shutdown_connections 2023-03-27T10:10:24.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.027+0000 7ff4b89ff700 1 -- 172.21.15.172:0/802023761 wait complete. 2023-03-27T10:10:24.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.028+0000 7ff4b89ff700 1 Processor -- start 2023-03-27T10:10:24.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 -- start start 2023-03-27T10:10:24.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4b40d3970 0x7ff4b41f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4b415c680 0x7ff4b40c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 0x7ff4b40c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4155cc0 con 0x7ff4b4160c20 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40cbf30 con 0x7ff4b415c680 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.029+0000 7ff4b89ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40cb320 con 0x7ff4b40d3970 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 0x7ff4b40c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 0x7ff4b40c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49698/0 (socket says 172.21.15.172:49698) 2023-03-27T10:10:24.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 -- 172.21.15.172:0/1709226625 learned_addr learned my addr 172.21.15.172:0/1709226625 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b259c700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4b40d3970 0x7ff4b41f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4abfff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4b415c680 0x7ff4b40c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 -- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4b40d3970 msgr2=0x7ff4b41f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4b40d3970 0x7ff4b41f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 -- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4b415c680 msgr2=0x7ff4b40c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4b415c680 0x7ff4b40c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 -- 172.21.15.172:0/1709226625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009550 con 0x7ff4b4160c20 2023-03-27T10:10:24.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4b2d9d700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 0x7ff4b40c9250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00cbc0 tx=0x7ff4ac00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.030+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00a9e0 con 0x7ff4b4160c20 2023-03-27T10:10:24.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.031+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00ab40 con 0x7ff4b4160c20 2023-03-27T10:10:24.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.031+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b415e740 con 0x7ff4b4160c20 2023-03-27T10:10:24.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.031+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac007070 con 0x7ff4b4160c20 2023-03-27T10:10:24.034 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.031+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b415e460 con 0x7ff4b4160c20 2023-03-27T10:10:24.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.032+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b40d2be0 con 0x7ff4b4160c20 2023-03-27T10:10:24.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.033+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff4ac019030 con 0x7ff4b4160c20 2023-03-27T10:10:24.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.034+0000 7ff4aaffd700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff494066e30 0x7ff4940692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.034+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4ac083cd0 con 0x7ff4b4160c20 2023-03-27T10:10:24.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.034+0000 7ff4b259c700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff494066e30 0x7ff4940692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.035+0000 7ff4b259c700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff494066e30 0x7ff4940692e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40cfdf0 tx=0x7ff4a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.037+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff4ac04b4f0 con 0x7ff4b4160c20 2023-03-27T10:10:24.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.230+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff4b40d1960 con 0x7ff4b4160c20 2023-03-27T10:10:24.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.231+0000 7ff4aaffd700 1 -- 172.21.15.172:0/1709226625 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff4ac017020 con 0x7ff4b4160c20 2023-03-27T10:10:24.231 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:24.233 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff494066e30 msgr2=0x7ff4940692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff494066e30 0x7ff4940692e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40cfdf0 tx=0x7ff4a4008040 comp rx=0 tx=0).stop 2023-03-27T10:10:24.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 msgr2=0x7ff4b40c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 0x7ff4b40c9250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00cbc0 tx=0x7ff4ac00ced0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 shutdown_connections 2023-03-27T10:10:24.234 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b4160c20 0x7ff4b40c9250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4b40d3970 0x7ff4b41f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff494066e30 0x7ff4940692e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 --2- 172.21.15.172:0/1709226625 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4b415c680 0x7ff4b40c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 >> 172.21.15.172:0/1709226625 conn(0x7ff4b409c210 msgr2=0x7ff4b40b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:24.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 shutdown_connections 2023-03-27T10:10:24.235 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.233+0000 7ff4b89ff700 1 -- 172.21.15.172:0/1709226625 wait complete. 2023-03-27T10:10:24.250 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:24.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.437+0000 7f7b6c3ff700 1 Processor -- start 2023-03-27T10:10:24.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.437+0000 7f7b6c3ff700 1 -- start start 2023-03-27T10:10:24.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6c3ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7b640d11d0 0x7f7b641604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b640d3a30 0x7f7b641609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6c3ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b640d29d0 con 0x7f7b6415a240 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6c3ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b64161200 con 0x7f7b640d11d0 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6415a610 con 0x7f7b640d3a30 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6999a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7b640d11d0 0x7f7b641604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6999a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7b640d11d0 0x7f7b641604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49700/0 (socket says 172.21.15.172:49700) 2023-03-27T10:10:24.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6999a700 1 -- 172.21.15.172:0/2017062047 learned_addr learned my addr 172.21.15.172:0/2017062047 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:24.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.438+0000 7f7b6a99c700 1 --2- 172.21.15.172:0/2017062047 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b640d3a30 0x7f7b641609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b6999a700 1 -- 172.21.15.172:0/2017062047 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b640d3a30 msgr2=0x7f7b641609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:24.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b6999a700 1 --2- 172.21.15.172:0/2017062047 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b640d3a30 0x7f7b641609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b6999a700 1 -- 172.21.15.172:0/2017062047 >> v1:172.21.15.191:6789/0 conn(0x7f7b6415a240 legacy=0x7f7b640d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b6999a700 1 -- 172.21.15.172:0/2017062047 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64160f30 con 0x7f7b640d11d0 2023-03-27T10:10:24.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b6999a700 1 --2- 172.21.15.172:0/2017062047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d11d0 0x7f7b641604b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b540098f0 tx=0x7f7b54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2696d540d6ba5106 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b69199700 1 -- 172.21.15.172:0/2017062047 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400b8a0 con 0x7f7b640d11d0 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b69199700 1 -- 172.21.15.172:0/2017062047 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400ba00 con 0x7f7b640d11d0 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.439+0000 7f7b69199700 1 -- 172.21.15.172:0/2017062047 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400bd90 con 0x7f7b640d11d0 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/2017062047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d11d0 msgr2=0x7f7b641604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/2017062047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d11d0 0x7f7b641604b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7b540098f0 tx=0x7f7b54009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/2017062047 shutdown_connections 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/2017062047 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b640d3a30 0x7f7b641609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/2017062047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d11d0 0x7f7b641604b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/2017062047 >> 172.21.15.172:0/2017062047 conn(0x7f7b640721f0 msgr2=0x7f7b6409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:24.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/2017062047 shutdown_connections 2023-03-27T10:10:24.442 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.440+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/2017062047 wait complete. 2023-03-27T10:10:24.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.442+0000 7f7b6c3ff700 1 Processor -- start 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.442+0000 7f7b6c3ff700 1 -- start start 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.442+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b640d11d0 0x7f7b641f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.442+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 0x7f7b640c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6c3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b6415a240 0x7f7b640c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640b3020 con 0x7f7b640d3a30 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641f1f90 con 0x7f7b640d11d0 2023-03-27T10:10:24.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6c3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640b4030 con 0x7f7b6415a240 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 0x7f7b640c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 0x7f7b640c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49702/0 (socket says 172.21.15.172:49702) 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 -- 172.21.15.172:0/3434147859 learned_addr learned my addr 172.21.15.172:0/3434147859 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6a19b700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b640d11d0 0x7f7b641f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6a99c700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b6415a240 0x7f7b640c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 -- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b6415a240 msgr2=0x7f7b640c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b6415a240 0x7f7b640c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 -- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b640d11d0 msgr2=0x7f7b641f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b640d11d0 0x7f7b641f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 -- 172.21.15.172:0/3434147859 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54009550 con 0x7f7b640d3a30 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6a19b700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b640d11d0 0x7f7b641f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.443+0000 7f7b6999a700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 0x7f7b640c6a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b54000c00 tx=0x7f7b54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.444+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54004380 con 0x7f7b640d3a30 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.444+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5401f070 con 0x7f7b640d3a30 2023-03-27T10:10:24.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.444+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b640d2f50 con 0x7f7b640d3a30 2023-03-27T10:10:24.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.444+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540036a0 con 0x7f7b640d3a30 2023-03-27T10:10:24.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.444+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b640d2c70 con 0x7f7b640d3a30 2023-03-27T10:10:24.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.445+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b640d3230 con 0x7f7b640d3a30 2023-03-27T10:10:24.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.446+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7b5402a020 con 0x7f7b640d3a30 2023-03-27T10:10:24.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.447+0000 7f7b5affd700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7b48066e30 0x7f7b480692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.447+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b54085680 con 0x7f7b640d3a30 2023-03-27T10:10:24.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.447+0000 7f7b6a19b700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7b48066e30 0x7f7b480692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.448+0000 7f7b6a19b700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7b48066e30 0x7f7b480692e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000f60 tx=0x7f7b60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.450 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.451+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f7b54052950 con 0x7f7b640d3a30 2023-03-27T10:10:24.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.638+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b64074300 con 0x7f7b640d3a30 2023-03-27T10:10:24.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.639+0000 7f7b5affd700 1 -- 172.21.15.172:0/3434147859 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b54055f70 con 0x7f7b640d3a30 2023-03-27T10:10:24.639 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:24.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7b48066e30 msgr2=0x7f7b480692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7b48066e30 0x7f7b480692e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000f60 tx=0x7f7b60009040 comp rx=0 tx=0).stop 2023-03-27T10:10:24.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 msgr2=0x7f7b640c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 0x7f7b640c6a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b54000c00 tx=0x7f7b54004750 comp rx=0 tx=0).stop 2023-03-27T10:10:24.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 shutdown_connections 2023-03-27T10:10:24.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b6415a240 0x7f7b640c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.641+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7b48066e30 0x7f7b480692e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.642+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b640d11d0 0x7f7b641f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.642+0000 7f7b6c3ff700 1 --2- 172.21.15.172:0/3434147859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b640d3a30 0x7f7b640c6a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.642+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 >> 172.21.15.172:0/3434147859 conn(0x7f7b640721f0 msgr2=0x7f7b640afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:24.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.642+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 shutdown_connections 2023-03-27T10:10:24.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.642+0000 7f7b6c3ff700 1 -- 172.21.15.172:0/3434147859 wait complete. 2023-03-27T10:10:24.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:24.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.844+0000 7effa8fff700 1 Processor -- start 2023-03-27T10:10:24.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.845+0000 7effa8fff700 1 -- start start 2023-03-27T10:10:24.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa8fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa40c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa8fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa415b0f0 0x7effa40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa8fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7effa415d720 0x7effa415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa8fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa415d3d0 con 0x7effa415b0f0 2023-03-27T10:10:24.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa8fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa415e450 con 0x7effa415d720 2023-03-27T10:10:24.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa8fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa4070050 con 0x7effa4159a00 2023-03-27T10:10:24.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7eff9bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa415b0f0 0x7effa40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7eff9bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa415b0f0 0x7effa40ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49712/0 (socket says 172.21.15.172:49712) 2023-03-27T10:10:24.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7eff9bfff700 1 -- 172.21.15.172:0/947710717 learned_addr learned my addr 172.21.15.172:0/947710717 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:24.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa259c700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa40c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7eff9bfff700 1 -- 172.21.15.172:0/947710717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 msgr2=0x7effa40c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:24.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7effa2d9d700 1 --2- 172.21.15.172:0/947710717 >> v2:172.21.15.191:3300/0 conn(0x7effa415d720 0x7effa415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7eff9bfff700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa40c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.846+0000 7eff9bfff700 1 -- 172.21.15.172:0/947710717 >> v2:172.21.15.191:3300/0 conn(0x7effa415d720 msgr2=0x7effa415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:24.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7eff9bfff700 1 --2- 172.21.15.172:0/947710717 >> v2:172.21.15.191:3300/0 conn(0x7effa415d720 0x7effa415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7eff9bfff700 1 -- 172.21.15.172:0/947710717 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4070330 con 0x7effa415b0f0 2023-03-27T10:10:24.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7effa259c700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa40c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:24.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7effa2d9d700 1 --2- 172.21.15.172:0/947710717 >> v2:172.21.15.191:3300/0 conn(0x7effa415d720 0x7effa415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:24.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7eff9bfff700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40ca0b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7effa40c2600 tx=0x7eff8c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9be7846089e5822 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7effa1d9b700 1 -- 172.21.15.172:0/947710717 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00dd30 con 0x7effa415b0f0 2023-03-27T10:10:24.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7effa1d9b700 1 -- 172.21.15.172:0/947710717 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00de90 con 0x7effa415b0f0 2023-03-27T10:10:24.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7effa1d9b700 1 -- 172.21.15.172:0/947710717 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c010690 con 0x7effa415b0f0 2023-03-27T10:10:24.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.847+0000 7effa8fff700 1 -- 172.21.15.172:0/947710717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 msgr2=0x7effa40ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40ca0b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7effa40c2600 tx=0x7eff8c00be70 comp rx=0 tx=0).stop 2023-03-27T10:10:24.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 -- 172.21.15.172:0/947710717 shutdown_connections 2023-03-27T10:10:24.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 --2- 172.21.15.172:0/947710717 >> v2:172.21.15.191:3300/0 conn(0x7effa415d720 0x7effa415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa40c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 --2- 172.21.15.172:0/947710717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40ca0b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 -- 172.21.15.172:0/947710717 >> 172.21.15.172:0/947710717 conn(0x7effa406a1a0 msgr2=0x7effa406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:24.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 -- 172.21.15.172:0/947710717 shutdown_connections 2023-03-27T10:10:24.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.848+0000 7effa8fff700 1 -- 172.21.15.172:0/947710717 wait complete. 2023-03-27T10:10:24.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.849+0000 7effa8fff700 1 Processor -- start 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 -- start start 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa406bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa415d720 0x7effa4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40b2b50 con 0x7effa415b0f0 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40b4a30 con 0x7effa415d720 2023-03-27T10:10:24.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.850+0000 7effa8fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa41f6940 con 0x7effa4159a00 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49724/0 (socket says 172.21.15.172:49724) 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 -- 172.21.15.172:0/858252556 learned_addr learned my addr 172.21.15.172:0/858252556 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7effa259c700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa406bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7effa2d9d700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa415d720 0x7effa4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 -- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 msgr2=0x7effa406bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa406bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 -- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa415d720 msgr2=0x7effa4151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:24.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa415d720 0x7effa4151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:24.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 -- 172.21.15.172:0/858252556 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c00b7f0 con 0x7effa415b0f0 2023-03-27T10:10:24.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9bfff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40b4090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00beb0 tx=0x7eff8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.851+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c003e50 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.852+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c010470 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.852+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c010820 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.852+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa40708f0 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.852+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa4070610 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.853+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa4159dd0 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.853+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7eff8c019400 con 0x7effa415b0f0 2023-03-27T10:10:24.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.854+0000 7eff9affd700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:24.860 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.854+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff8c0859c0 con 0x7effa415b0f0 2023-03-27T10:10:24.860 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.855+0000 7effa259c700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:24.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.856+0000 7effa259c700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff94006fd0 tx=0x7eff94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:24.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:24.859+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7eff8c052ba0 con 0x7effa415b0f0 2023-03-27T10:10:25.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.048+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effa4074330 con 0x7effa415b0f0 2023-03-27T10:10:25.048 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.048+0000 7eff9affd700 1 -- 172.21.15.172:0/858252556 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff8c0561c0 con 0x7effa415b0f0 2023-03-27T10:10:25.048 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:25.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.050+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 msgr2=0x7eff840692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.050+0000 7effa8fff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7eff94006fd0 tx=0x7eff94008040 comp rx=0 tx=0).stop 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.050+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 msgr2=0x7effa40b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.050+0000 7effa8fff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40b4090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00beb0 tx=0x7eff8c004750 comp rx=0 tx=0).stop 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 shutdown_connections 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa415d720 0x7effa4151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa4159a00 0x7effa406bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 --2- 172.21.15.172:0/858252556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa415b0f0 0x7effa40b4090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 >> 172.21.15.172:0/858252556 conn(0x7effa406a1a0 msgr2=0x7effa406a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:25.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 shutdown_connections 2023-03-27T10:10:25.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.051+0000 7effa8fff700 1 -- 172.21.15.172:0/858252556 wait complete. 2023-03-27T10:10:25.067 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:25.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.252+0000 7f3a74fff700 1 Processor -- start 2023-03-27T10:10:25.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.252+0000 7f3a74fff700 1 -- start start 2023-03-27T10:10:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.253+0000 7f3a74fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a700d0b90 0x7f3a700ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.253+0000 7f3a74fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a700cebc0 con 0x7f3a700cd610 2023-03-27T10:10:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.253+0000 7f3a74fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a700ceea0 con 0x7f3a7015ca20 2023-03-27T10:10:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.253+0000 7f3a74fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700cf180 con 0x7f3a700d0b90 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6ed9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3a700cd610 0x7f3a700b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37388/0 (socket says 172.21.15.172:37388) 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6ed9d700 1 -- 172.21.15.172:0/3549805966 learned_addr learned my addr 172.21.15.172:0/3549805966 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6e59c700 1 --2- 172.21.15.172:0/3549805966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a700d0b90 0x7f3a700ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111466802 0 0) 0x7f3a700cebc0 con 0x7f3a700cd610 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c0035b0 con 0x7f3a700cd610 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880744857 0 0) 0x7f3a700ceea0 con 0x7f3a7015ca20 2023-03-27T10:10:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a700cebc0 con 0x7f3a7015ca20 2023-03-27T10:10:25.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6e59c700 1 -- 172.21.15.172:0/3549805966 >> v1:172.21.15.191:6789/0 conn(0x7f3a7015ca20 legacy=0x7f3a700d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6e59c700 1 -- 172.21.15.172:0/3549805966 >> v1:172.21.15.172:6789/0 conn(0x7f3a700cd610 legacy=0x7f3a700b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.254+0000 7f3a6e59c700 1 -- 172.21.15.172:0/3549805966 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700cf460 con 0x7f3a700d0b90 2023-03-27T10:10:25.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a6e59c700 1 --2- 172.21.15.172:0/3549805966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a700d0b90 0x7f3a700ce500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009850 tx=0x7f3a60009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9806b2c95fa2ff4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:25.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60005e30 con 0x7f3a700d0b90 2023-03-27T10:10:25.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60006030 con 0x7f3a700d0b90 2023-03-27T10:10:25.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a6dd9b700 1 -- 172.21.15.172:0/3549805966 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600063e0 con 0x7f3a700d0b90 2023-03-27T10:10:25.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a74fff700 1 -- 172.21.15.172:0/3549805966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a700d0b90 msgr2=0x7f3a700ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a74fff700 1 --2- 172.21.15.172:0/3549805966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a700d0b90 0x7f3a700ce500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009850 tx=0x7f3a60009b60 comp rx=0 tx=0).stop 2023-03-27T10:10:25.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a74fff700 1 -- 172.21.15.172:0/3549805966 shutdown_connections 2023-03-27T10:10:25.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.255+0000 7f3a74fff700 1 --2- 172.21.15.172:0/3549805966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a700d0b90 0x7f3a700ce500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.256+0000 7f3a74fff700 1 -- 172.21.15.172:0/3549805966 >> 172.21.15.172:0/3549805966 conn(0x7f3a700721f0 msgr2=0x7f3a7009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.256+0000 7f3a74fff700 1 -- 172.21.15.172:0/3549805966 shutdown_connections 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.256+0000 7f3a74fff700 1 -- 172.21.15.172:0/3549805966 wait complete. 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.257+0000 7f3a74fff700 1 Processor -- start 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.257+0000 7f3a74fff700 1 -- start start 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a74fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 0x7f3a70156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a74fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a700d0b90 0x7f3a701e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a74fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a7015ca20 0x7f3a701e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a74fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70157f80 con 0x7f3a700cd610 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a74fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70158260 con 0x7f3a700d0b90 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a74fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a701560f0 con 0x7f3a7015ca20 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.258+0000 7f3a6e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 0x7f3a70156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 0x7f3a70156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49740/0 (socket says 172.21.15.172:49740) 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 -- 172.21.15.172:0/1292822312 learned_addr learned my addr 172.21.15.172:0/1292822312 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6ed9d700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a7015ca20 0x7f3a701e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a67fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a700d0b90 0x7f3a701e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 -- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a7015ca20 msgr2=0x7f3a701e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a7015ca20 0x7f3a701e4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 -- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a700d0b90 msgr2=0x7f3a701e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a700d0b90 0x7f3a701e3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 -- 172.21.15.172:0/1292822312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60009430 con 0x7f3a700cd610 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a6e59c700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 0x7f3a70156bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a60013040 tx=0x7f3a60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60006910 con 0x7f3a700cd610 2023-03-27T10:10:25.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60020070 con 0x7f3a700cd610 2023-03-27T10:10:25.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.259+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a700d2d30 con 0x7f3a700cd610 2023-03-27T10:10:25.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.260+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60025650 con 0x7f3a700cd610 2023-03-27T10:10:25.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.260+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a700afc50 con 0x7f3a700cd610 2023-03-27T10:10:25.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.261+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a700b0880 con 0x7f3a700cd610 2023-03-27T10:10:25.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.261+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f3a6002b020 con 0x7f3a700cd610 2023-03-27T10:10:25.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.262+0000 7f3a66ffd700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3a50066e30 0x7f3a500692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.262+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a60085a70 con 0x7f3a700cd610 2023-03-27T10:10:25.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.263+0000 7f3a67fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3a50066e30 0x7f3a500692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.263+0000 7f3a67fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3a50066e30 0x7f3a500692e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a58007fd0 tx=0x7f3a58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:25.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.267+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f3a60052c50 con 0x7f3a700cd610 2023-03-27T10:10:25.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.456+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a700c9960 con 0x7f3a700cd610 2023-03-27T10:10:25.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.457+0000 7f3a66ffd700 1 -- 172.21.15.172:0/1292822312 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f3a60056270 con 0x7f3a700cd610 2023-03-27T10:10:25.457 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:25.457 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:25.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3a50066e30 msgr2=0x7f3a500692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3a50066e30 0x7f3a500692e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3a58007fd0 tx=0x7f3a58009040 comp rx=0 tx=0).stop 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 msgr2=0x7f3a70156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 0x7f3a70156bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a60013040 tx=0x7f3a60004750 comp rx=0 tx=0).stop 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 shutdown_connections 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a7015ca20 0x7f3a701e4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a700cd610 0x7f3a70156bd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f3a50066e30 0x7f3a500692e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 --2- 172.21.15.172:0/1292822312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a700d0b90 0x7f3a701e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.461 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 >> 172.21.15.172:0/1292822312 conn(0x7f3a700721f0 msgr2=0x7f3a700b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:25.461 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 shutdown_connections 2023-03-27T10:10:25.461 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.460+0000 7f3a74fff700 1 -- 172.21.15.172:0/1292822312 wait complete. 2023-03-27T10:10:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:25.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:25.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.669+0000 7fc6a59ff700 1 Processor -- start 2023-03-27T10:10:25.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.669+0000 7fc6a59ff700 1 -- start start 2023-03-27T10:10:25.671 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.670+0000 7fc6a59ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc6a00cff20 0x7fc6a01675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.671 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.670+0000 7fc6a59ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a00cdbf0 con 0x7fc6a00d11d0 2023-03-27T10:10:25.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.670+0000 7fc6a59ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a00cd5e0 con 0x7fc6a015c520 2023-03-27T10:10:25.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.670+0000 7fc6a59ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a00d2e80 con 0x7fc6a00cff20 2023-03-27T10:10:25.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc697fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc6a00d11d0 0x7fc6a00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37392/0 (socket says 172.21.15.172:37392) 2023-03-27T10:10:25.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc697fff700 1 -- 172.21.15.172:0/241422006 learned_addr learned my addr 172.21.15.172:0/241422006 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:25.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69f7fe700 1 --2- 172.21.15.172:0/241422006 >> v2:172.21.15.191:3300/0 conn(0x7fc6a00cff20 0x7fc6a01675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69e7fc700 1 -- 172.21.15.172:0/241422006 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510227402 0 0) 0x7fc6a00cdbf0 con 0x7fc6a00d11d0 2023-03-27T10:10:25.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69e7fc700 1 -- 172.21.15.172:0/241422006 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc68c0035b0 con 0x7fc6a00d11d0 2023-03-27T10:10:25.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69f7fe700 1 -- 172.21.15.172:0/241422006 >> v1:172.21.15.191:6789/0 conn(0x7fc6a015c520 legacy=0x7fc6a00d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69e7fc700 1 -- 172.21.15.172:0/241422006 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204238962 0 0) 0x7fc68c0035b0 con 0x7fc6a00d11d0 2023-03-27T10:10:25.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69f7fe700 1 -- 172.21.15.172:0/241422006 >> v1:172.21.15.172:6789/0 conn(0x7fc6a00d11d0 legacy=0x7fc6a00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.671+0000 7fc69f7fe700 1 -- 172.21.15.172:0/241422006 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a00d0420 con 0x7fc6a00cff20 2023-03-27T10:10:25.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.672+0000 7fc69f7fe700 1 --2- 172.21.15.172:0/241422006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a01675a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc698009d90 tx=0x7fc69800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa2c9e0d25ca6b28 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:25.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.672+0000 7fc69e7fc700 1 -- 172.21.15.172:0/241422006 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800e070 con 0x7fc6a00cff20 2023-03-27T10:10:25.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.672+0000 7fc69e7fc700 1 -- 172.21.15.172:0/241422006 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698003a20 con 0x7fc6a00cff20 2023-03-27T10:10:25.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.672+0000 7fc69e7fc700 1 -- 172.21.15.172:0/241422006 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688001670 con 0x7fc6a00cff20 2023-03-27T10:10:25.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.672+0000 7fc6a59ff700 1 -- 172.21.15.172:0/241422006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 msgr2=0x7fc6a01675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.672+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/241422006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a01675a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc698009d90 tx=0x7fc69800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.673+0000 7fc6a59ff700 1 -- 172.21.15.172:0/241422006 shutdown_connections 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.673+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/241422006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a01675a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.673+0000 7fc6a59ff700 1 -- 172.21.15.172:0/241422006 >> 172.21.15.172:0/241422006 conn(0x7fc6a00721f0 msgr2=0x7fc6a009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.673+0000 7fc6a59ff700 1 -- 172.21.15.172:0/241422006 shutdown_connections 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.673+0000 7fc6a59ff700 1 -- 172.21.15.172:0/241422006 wait complete. 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.674+0000 7fc6a59ff700 1 Processor -- start 2023-03-27T10:10:25.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.674+0000 7fc6a59ff700 1 -- start start 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.675+0000 7fc6a59ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a00b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.675+0000 7fc6a59ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6a00d11d0 0x7fc6a01f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.675+0000 7fc6a59ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 0x7fc6a00cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.675+0000 7fc6a59ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a01f55d0 con 0x7fc6a015c520 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.675+0000 7fc6a59ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a0150a30 con 0x7fc6a00cff20 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.675+0000 7fc6a59ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00b2350 con 0x7fc6a00d11d0 2023-03-27T10:10:25.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 0x7fc6a00cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 0x7fc6a00cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49748/0 (socket says 172.21.15.172:49748) 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 -- 172.21.15.172:0/2876262276 learned_addr learned my addr 172.21.15.172:0/2876262276 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc697fff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6a00d11d0 0x7fc6a01f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69effd700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a00b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 -- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6a00d11d0 msgr2=0x7fc6a01f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6a00d11d0 0x7fc6a01f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 -- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 msgr2=0x7fc6a00b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a00b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 -- 172.21.15.172:0/2876262276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009a70 con 0x7fc6a015c520 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69effd700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69f7fe700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 0x7fc6a00cb520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6a008c070 tx=0x7fc698004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6980045c0 con 0x7fc6a015c520 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.676+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698004720 con 0x7fc6a015c520 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.677+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a00d0700 con 0x7fc6a015c520 2023-03-27T10:10:25.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.677+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698012450 con 0x7fc6a015c520 2023-03-27T10:10:25.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.677+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a00cd880 con 0x7fc6a015c520 2023-03-27T10:10:25.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.678+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a015c8f0 con 0x7fc6a015c520 2023-03-27T10:10:25.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.679+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc6980125b0 con 0x7fc6a015c520 2023-03-27T10:10:25.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.679+0000 7fc69cff9700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc680066e30 0x7fc6800692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:25.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.679+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6980863c0 con 0x7fc6a015c520 2023-03-27T10:10:25.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.680+0000 7fc69effd700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc680066e30 0x7fc6800692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:25.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.680+0000 7fc69effd700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc680066e30 0x7fc6800692e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6900018c0 tx=0x7fc690009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:25.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.683+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc698053690 con 0x7fc6a015c520 2023-03-27T10:10:25.870 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.870+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6a0074300 con 0x7fc6a015c520 2023-03-27T10:10:25.870 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.871+0000 7fc69cff9700 1 -- 172.21.15.172:0/2876262276 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc698056cb0 con 0x7fc6a015c520 2023-03-27T10:10:25.871 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:25.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc680066e30 msgr2=0x7fc6800692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc680066e30 0x7fc6800692e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6900018c0 tx=0x7fc690009040 comp rx=0 tx=0).stop 2023-03-27T10:10:25.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 msgr2=0x7fc6a00cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:25.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 0x7fc6a00cb520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6a008c070 tx=0x7fc698004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 shutdown_connections 2023-03-27T10:10:25.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6a015c520 0x7fc6a00cb520 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc680066e30 0x7fc6800692e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6a00cff20 0x7fc6a00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 --2- 172.21.15.172:0/2876262276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6a00d11d0 0x7fc6a01f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:25.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 >> 172.21.15.172:0/2876262276 conn(0x7fc6a00721f0 msgr2=0x7fc6a00afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:25.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 shutdown_connections 2023-03-27T10:10:25.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:25.873+0000 7fc6a59ff700 1 -- 172.21.15.172:0/2876262276 wait complete. 2023-03-27T10:10:25.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:26.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.077+0000 7fdd863ff700 1 Processor -- start 2023-03-27T10:10:26.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.077+0000 7fdd863ff700 1 -- start start 2023-03-27T10:10:26.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.078+0000 7fdd863ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdd800d3a30 0x7fdd80160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.078+0000 7fdd863ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800d29d0 con 0x7fdd800d11d0 2023-03-27T10:10:26.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd863ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8015a610 con 0x7fdd8015a240 2023-03-27T10:10:26.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd863ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd80161200 con 0x7fdd800d3a30 2023-03-27T10:10:26.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd7f7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdd800d11d0 0x7fdd801604b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37402/0 (socket says 172.21.15.172:37402) 2023-03-27T10:10:26.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd7f7fe700 1 -- 172.21.15.172:0/550639657 learned_addr learned my addr 172.21.15.172:0/550639657 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:26.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd8499c700 1 --2- 172.21.15.172:0/550639657 >> v2:172.21.15.172:3300/0 conn(0x7fdd800d3a30 0x7fdd80160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd8499c700 1 -- 172.21.15.172:0/550639657 >> v1:172.21.15.191:6789/0 conn(0x7fdd8015a240 legacy=0x7fdd800d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd8499c700 1 -- 172.21.15.172:0/550639657 >> v1:172.21.15.172:6789/0 conn(0x7fdd800d11d0 legacy=0x7fdd801604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd8499c700 1 -- 172.21.15.172:0/550639657 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd800d2c70 con 0x7fdd800d3a30 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd7effd700 1 -- 172.21.15.172:0/550639657 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628587626 0 0) 0x7fdd800d29d0 con 0x7fdd800d11d0 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.079+0000 7fdd8499c700 1 --2- 172.21.15.172:0/550639657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd800d3a30 0x7fdd80160bc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009d90 tx=0x7fdd7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d67ef502f83cbc6 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd7effd700 1 -- 172.21.15.172:0/550639657 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800e070 con 0x7fdd800d3a30 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd7effd700 1 -- 172.21.15.172:0/550639657 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800bbd0 con 0x7fdd800d3a30 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd7effd700 1 -- 172.21.15.172:0/550639657 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78012430 con 0x7fdd800d3a30 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 -- 172.21.15.172:0/550639657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd800d3a30 msgr2=0x7fdd80160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 --2- 172.21.15.172:0/550639657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd800d3a30 0x7fdd80160bc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009d90 tx=0x7fdd7800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:26.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 -- 172.21.15.172:0/550639657 shutdown_connections 2023-03-27T10:10:26.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 --2- 172.21.15.172:0/550639657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd800d3a30 0x7fdd80160bc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 -- 172.21.15.172:0/550639657 >> 172.21.15.172:0/550639657 conn(0x7fdd800721f0 msgr2=0x7fdd8009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:26.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 -- 172.21.15.172:0/550639657 shutdown_connections 2023-03-27T10:10:26.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.080+0000 7fdd863ff700 1 -- 172.21.15.172:0/550639657 wait complete. 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.082+0000 7fdd863ff700 1 Processor -- start 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.082+0000 7fdd863ff700 1 -- start start 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd800d11d0 0x7fdd800b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd800d3a30 0x7fdd800b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 0x7fdd80157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd863ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800b3740 con 0x7fdd8015a240 2023-03-27T10:10:26.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd863ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8015fd70 con 0x7fdd800d11d0 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd863ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800b2ac0 con 0x7fdd800d3a30 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd8499c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 0x7fdd80157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd8499c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 0x7fdd80157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49758/0 (socket says 172.21.15.172:49758) 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.083+0000 7fdd8499c700 1 -- 172.21.15.172:0/1948230774 learned_addr learned my addr 172.21.15.172:0/1948230774 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd7ffff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd800d11d0 0x7fdd800b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd7f7fe700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd800d3a30 0x7fdd800b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd8499c700 1 -- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd800d3a30 msgr2=0x7fdd800b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd8499c700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd800d3a30 0x7fdd800b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd8499c700 1 -- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd800d11d0 msgr2=0x7fdd800b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd8499c700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd800d11d0 0x7fdd800b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd8499c700 1 -- 172.21.15.172:0/1948230774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78009a70 con 0x7fdd8015a240 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd8499c700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 0x7fdd80157160 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdd78014040 tx=0x7fdd78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78012430 con 0x7fdd8015a240 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78020070 con 0x7fdd8015a240 2023-03-27T10:10:26.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007000 con 0x7fdd8015a240 2023-03-27T10:10:26.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd800d3230 con 0x7fdd8015a240 2023-03-27T10:10:26.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.084+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd800d2f50 con 0x7fdd8015a240 2023-03-27T10:10:26.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.085+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd800d3510 con 0x7fdd8015a240 2023-03-27T10:10:26.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.086+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fdd7802e070 con 0x7fdd8015a240 2023-03-27T10:10:26.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.087+0000 7fdd7cff9700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdd6c066e30 0x7fdd6c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.087+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd78022070 con 0x7fdd8015a240 2023-03-27T10:10:26.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.088+0000 7fdd7ffff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdd6c066e30 0x7fdd6c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.088+0000 7fdd7ffff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdd6c066e30 0x7fdd6c0692e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd8006c180 tx=0x7fdd70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.091+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fdd78053400 con 0x7fdd8015a240 2023-03-27T10:10:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.278+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd800b3880 con 0x7fdd8015a240 2023-03-27T10:10:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.278+0000 7fdd7cff9700 1 -- 172.21.15.172:0/1948230774 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd78056a20 con 0x7fdd8015a240 2023-03-27T10:10:26.279 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdd6c066e30 msgr2=0x7fdd6c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdd6c066e30 0x7fdd6c0692e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd8006c180 tx=0x7fdd70009040 comp rx=0 tx=0).stop 2023-03-27T10:10:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 msgr2=0x7fdd80157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 0x7fdd80157160 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdd78014040 tx=0x7fdd78004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 shutdown_connections 2023-03-27T10:10:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd8015a240 0x7fdd80157160 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdd6c066e30 0x7fdd6c0692e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd800d11d0 0x7fdd800b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 --2- 172.21.15.172:0/1948230774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd800d3a30 0x7fdd800b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 >> 172.21.15.172:0/1948230774 conn(0x7fdd800721f0 msgr2=0x7fdd800d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 shutdown_connections 2023-03-27T10:10:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.281+0000 7fdd863ff700 1 -- 172.21.15.172:0/1948230774 wait complete. 2023-03-27T10:10:26.297 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:26.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.486+0000 7f9309bff700 1 Processor -- start 2023-03-27T10:10:26.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.486+0000 7f9309bff700 1 -- start start 2023-03-27T10:10:26.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.487+0000 7f9309bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f930415a240 0x7f93040d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.487+0000 7f9309bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93040d29d0 con 0x7f9304160bc0 2023-03-27T10:10:26.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.487+0000 7f9309bff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930415a610 con 0x7f93040d3a30 2023-03-27T10:10:26.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.487+0000 7f9309bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9304161020 con 0x7f930415a240 2023-03-27T10:10:26.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.487+0000 7f9303fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9304160bc0 0x7f93040cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50014/0 (socket says 172.21.15.172:50014) 2023-03-27T10:10:26.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.487+0000 7f9303fff700 1 -- 172.21.15.172:0/716870215 learned_addr learned my addr 172.21.15.172:0/716870215 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:26.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93037fe700 1 --2- 172.21.15.172:0/716870215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f930415a240 0x7f93040d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93027fc700 1 -- 172.21.15.172:0/716870215 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16203631 0 0) 0x7f93040d29d0 con 0x7f9304160bc0 2023-03-27T10:10:26.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93027fc700 1 -- 172.21.15.172:0/716870215 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ec0035b0 con 0x7f9304160bc0 2023-03-27T10:10:26.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93027fc700 1 -- 172.21.15.172:0/716870215 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861892065 0 0) 0x7f930415a610 con 0x7f93040d3a30 2023-03-27T10:10:26.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93037fe700 1 -- 172.21.15.172:0/716870215 >> v1:172.21.15.191:6789/0 conn(0x7f93040d3a30 legacy=0x7f93041604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93037fe700 1 -- 172.21.15.172:0/716870215 >> v1:172.21.15.172:6789/0 conn(0x7f9304160bc0 legacy=0x7f93040cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93037fe700 1 -- 172.21.15.172:0/716870215 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040d2c70 con 0x7f930415a240 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.488+0000 7f93037fe700 1 --2- 172.21.15.172:0/716870215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f930415a240 0x7f93040d0ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edbc7f5c2dabe5b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f93027fc700 1 -- 172.21.15.172:0/716870215 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4011830 con 0x7f930415a240 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f93027fc700 1 -- 172.21.15.172:0/716870215 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4011990 con 0x7f930415a240 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f93027fc700 1 -- 172.21.15.172:0/716870215 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4011d20 con 0x7f930415a240 2023-03-27T10:10:26.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 -- 172.21.15.172:0/716870215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f930415a240 msgr2=0x7f93040d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 --2- 172.21.15.172:0/716870215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f930415a240 0x7f93040d0ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f4009b80 comp rx=0 tx=0).stop 2023-03-27T10:10:26.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 -- 172.21.15.172:0/716870215 shutdown_connections 2023-03-27T10:10:26.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 --2- 172.21.15.172:0/716870215 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f930415a240 0x7f93040d0ac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 -- 172.21.15.172:0/716870215 >> 172.21.15.172:0/716870215 conn(0x7f93040721f0 msgr2=0x7f930409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:26.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 -- 172.21.15.172:0/716870215 shutdown_connections 2023-03-27T10:10:26.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.489+0000 7f9309bff700 1 -- 172.21.15.172:0/716870215 wait complete. 2023-03-27T10:10:26.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.491+0000 7f9309bff700 1 Processor -- start 2023-03-27T10:10:26.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.491+0000 7f9309bff700 1 -- start start 2023-03-27T10:10:26.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9309bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93040d3a30 0x7f930415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9309bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f930415a240 0x7f93040c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9309bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 0x7f93041f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9309bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040b5d20 con 0x7f9304160bc0 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9309bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93041f5500 con 0x7f930415a240 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9309bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040c8440 con 0x7f93040d3a30 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9303fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 0x7f93041f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9303fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 0x7f93041f13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48036/0 (socket says 172.21.15.172:48036) 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9303fff700 1 -- 172.21.15.172:0/2049190227 learned_addr learned my addr 172.21.15.172:0/2049190227 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f93037fe700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93040d3a30 0x7f930415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.492+0000 7f9302ffd700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f930415a240 0x7f93040c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9303fff700 1 -- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93040d3a30 msgr2=0x7f930415c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9303fff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93040d3a30 0x7f930415c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9303fff700 1 -- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f930415a240 msgr2=0x7f93040c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9303fff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f930415a240 0x7f93040c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9303fff700 1 -- 172.21.15.172:0/2049190227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40094a0 con 0x7f9304160bc0 2023-03-27T10:10:26.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9303fff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 0x7f93041f13a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00caa0 tx=0x7f92fc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00a9e0 con 0x7f9304160bc0 2023-03-27T10:10:26.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc00ab40 con 0x7f9304160bc0 2023-03-27T10:10:26.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93040d3230 con 0x7f9304160bc0 2023-03-27T10:10:26.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc012400 con 0x7f9304160bc0 2023-03-27T10:10:26.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.493+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93040d2f50 con 0x7f9304160bc0 2023-03-27T10:10:26.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.494+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93040d3510 con 0x7f9304160bc0 2023-03-27T10:10:26.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.495+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f92fc019030 con 0x7f9304160bc0 2023-03-27T10:10:26.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.496+0000 7f92ebfff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f92f0066e30 0x7f92f00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.496+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92fc083d90 con 0x7f9304160bc0 2023-03-27T10:10:26.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.496+0000 7f93037fe700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f92f0066e30 0x7f92f00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.497+0000 7f93037fe700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f92f0066e30 0x7f92f00692e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92f40097c0 tx=0x7f92f401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.500+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f92fc051090 con 0x7f9304160bc0 2023-03-27T10:10:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.694+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9304074300 con 0x7f9304160bc0 2023-03-27T10:10:26.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.694+0000 7f92ebfff700 1 -- 172.21.15.172:0/2049190227 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92fc0546b0 con 0x7f9304160bc0 2023-03-27T10:10:26.694 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:26.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f92f0066e30 msgr2=0x7f92f00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f92f0066e30 0x7f92f00692e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92f40097c0 tx=0x7f92f401c040 comp rx=0 tx=0).stop 2023-03-27T10:10:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 msgr2=0x7f93041f13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 0x7f93041f13a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00caa0 tx=0x7f92fc00cdb0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 shutdown_connections 2023-03-27T10:10:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9304160bc0 0x7f93041f13a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93040d3a30 0x7f930415c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f92f0066e30 0x7f92f00692e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 --2- 172.21.15.172:0/2049190227 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f930415a240 0x7f93040c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 >> 172.21.15.172:0/2049190227 conn(0x7f93040721f0 msgr2=0x7f93040afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 shutdown_connections 2023-03-27T10:10:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.697+0000 7f9309bff700 1 -- 172.21.15.172:0/2049190227 wait complete. 2023-03-27T10:10:26.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:26.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.901+0000 7f32f49ff700 1 Processor -- start 2023-03-27T10:10:26.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.901+0000 7f32f49ff700 1 -- start start 2023-03-27T10:10:26.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.902+0000 7f32f49ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f32f006b9c0 0x7f32f00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.902+0000 7f32f49ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f00cb940 con 0x7f32f015c620 2023-03-27T10:10:26.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.902+0000 7f32f49ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f00cc780 con 0x7f32f00ce270 2023-03-27T10:10:26.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.902+0000 7f32f49ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f00ce6e0 con 0x7f32f006b9c0 2023-03-27T10:10:26.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.902+0000 7f32ee59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f32f015c620 0x7f32f00ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50024/0 (socket says 172.21.15.172:50024) 2023-03-27T10:10:26.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32ee59c700 1 -- 172.21.15.172:0/631435656 learned_addr learned my addr 172.21.15.172:0/631435656 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:26.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32eed9d700 1 --2- 172.21.15.172:0/631435656 >> v2:172.21.15.191:3300/0 conn(0x7f32f006b9c0 0x7f32f00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32ed59a700 1 -- 172.21.15.172:0/631435656 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751246297 0 0) 0x7f32f00cb940 con 0x7f32f015c620 2023-03-27T10:10:26.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32ed59a700 1 -- 172.21.15.172:0/631435656 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d80035b0 con 0x7f32f015c620 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32eed9d700 1 -- 172.21.15.172:0/631435656 >> v1:172.21.15.191:6789/0 conn(0x7f32f00ce270 legacy=0x7f32f006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32ed59a700 1 -- 172.21.15.172:0/631435656 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006592677 0 0) 0x7f32f00cc780 con 0x7f32f00ce270 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32eed9d700 1 -- 172.21.15.172:0/631435656 >> v1:172.21.15.172:6789/0 conn(0x7f32f015c620 legacy=0x7f32f00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32eed9d700 1 -- 172.21.15.172:0/631435656 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f015c9f0 con 0x7f32f006b9c0 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.903+0000 7f32eed9d700 1 --2- 172.21.15.172:0/631435656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f00cb400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc7795124c094e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32ed59a700 1 -- 172.21.15.172:0/631435656 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800e070 con 0x7f32f006b9c0 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32ed59a700 1 -- 172.21.15.172:0/631435656 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800bb20 con 0x7f32f006b9c0 2023-03-27T10:10:26.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32ed59a700 1 -- 172.21.15.172:0/631435656 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800bed0 con 0x7f32f006b9c0 2023-03-27T10:10:26.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 -- 172.21.15.172:0/631435656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 msgr2=0x7f32f00cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 --2- 172.21.15.172:0/631435656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f00cb400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 -- 172.21.15.172:0/631435656 shutdown_connections 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 --2- 172.21.15.172:0/631435656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f00cb400 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 -- 172.21.15.172:0/631435656 >> 172.21.15.172:0/631435656 conn(0x7f32f0072230 msgr2=0x7f32f006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 -- 172.21.15.172:0/631435656 shutdown_connections 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.904+0000 7f32f49ff700 1 -- 172.21.15.172:0/631435656 wait complete. 2023-03-27T10:10:26.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.906+0000 7f32f49ff700 1 Processor -- start 2023-03-27T10:10:26.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.906+0000 7f32f49ff700 1 -- start start 2023-03-27T10:10:26.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32f49ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f0158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32f49ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32f00ce270 0x7f32f01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32f49ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 0x7f32f015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32f49ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f01555f0 con 0x7f32f015c620 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32f49ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c4810 con 0x7f32f006b9c0 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32f49ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c4dd0 con 0x7f32f00ce270 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32eed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 0x7f32f015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32eed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 0x7f32f015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48044/0 (socket says 172.21.15.172:48044) 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.907+0000 7f32eed9d700 1 -- 172.21.15.172:0/1543692115 learned_addr learned my addr 172.21.15.172:0/1543692115 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32ee59c700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f0158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32edd9b700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32f00ce270 0x7f32f01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32eed9d700 1 -- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32f00ce270 msgr2=0x7f32f01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32eed9d700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32f00ce270 0x7f32f01550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32eed9d700 1 -- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 msgr2=0x7f32f0158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32eed9d700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f0158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32eed9d700 1 -- 172.21.15.172:0/1543692115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8009a70 con 0x7f32f015c620 2023-03-27T10:10:26.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32ee59c700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f0158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32edd9b700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32f00ce270 0x7f32f01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32eed9d700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 0x7f32f015a5e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32e8014040 tx=0x7f32e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e801b810 con 0x7f32f015c620 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e8020070 con 0x7f32f015c620 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f00cbe50 con 0x7f32f015c620 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e801bbb0 con 0x7f32f015c620 2023-03-27T10:10:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.908+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f00cbb70 con 0x7f32f015c620 2023-03-27T10:10:26.912 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.909+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f00cc130 con 0x7f32f015c620 2023-03-27T10:10:26.912 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.910+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f32e801bd10 con 0x7f32f015c620 2023-03-27T10:10:26.912 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.911+0000 7f32deffd700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f32d0066e30 0x7f32d00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:26.913 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.911+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32e8022070 con 0x7f32f015c620 2023-03-27T10:10:26.913 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.912+0000 7f32ee59c700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f32d0066e30 0x7f32d00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:26.913 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.912+0000 7f32ee59c700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f32d0066e30 0x7f32d00692e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32e0001360 tx=0x7f32e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:26.914 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:26.915+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f32e8053a50 con 0x7f32f015c620 2023-03-27T10:10:27.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.101+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32f0074300 con 0x7f32f015c620 2023-03-27T10:10:27.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.102+0000 7f32deffd700 1 -- 172.21.15.172:0/1543692115 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32e8057070 con 0x7f32f015c620 2023-03-27T10:10:27.101 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:27.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f32d0066e30 msgr2=0x7f32d00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f32d0066e30 0x7f32d00692e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32e0001360 tx=0x7f32e0009040 comp rx=0 tx=0).stop 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 msgr2=0x7f32f015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 0x7f32f015a5e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32e8014040 tx=0x7f32e8004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 shutdown_connections 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32f015c620 0x7f32f015a5e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f32d0066e30 0x7f32d00692e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f32f006b9c0 0x7f32f0158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 --2- 172.21.15.172:0/1543692115 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f32f00ce270 0x7f32f01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 >> 172.21.15.172:0/1543692115 conn(0x7f32f0072230 msgr2=0x7f32f00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:27.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 shutdown_connections 2023-03-27T10:10:27.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.104+0000 7f32f49ff700 1 -- 172.21.15.172:0/1543692115 wait complete. 2023-03-27T10:10:27.200 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-03-27T10:10:27.201 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-03-27T10:10:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.385+0000 7f4e3cbff700 1 Processor -- start 2023-03-27T10:10:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.385+0000 7f4e3cbff700 1 -- start start 2023-03-27T10:10:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e3cbff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4e380cbfc0 0x7f4e380af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e3cbff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380c4290 con 0x7f4e380afd10 2023-03-27T10:10:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e3cbff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380c3cd0 con 0x7f4e38142680 2023-03-27T10:10:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e3cbff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e380c9a10 con 0x7f4e380cbfc0 2023-03-27T10:10:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e36d9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4e380afd10 0x7f4e3815ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50032/0 (socket says 172.21.15.172:50032) 2023-03-27T10:10:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e36d9d700 1 -- 172.21.15.172:0/918526724 learned_addr learned my addr 172.21.15.172:0/918526724 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e35d9b700 1 --2- 172.21.15.172:0/918526724 >> v2:172.21.15.191:3300/0 conn(0x7f4e380cbfc0 0x7f4e380af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.387+0000 7f4e3559a700 1 -- 172.21.15.172:0/918526724 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495853798 0 0) 0x7f4e380c4290 con 0x7f4e380afd10 2023-03-27T10:10:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e3559a700 1 -- 172.21.15.172:0/918526724 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e200035b0 con 0x7f4e380afd10 2023-03-27T10:10:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e3559a700 1 -- 172.21.15.172:0/918526724 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 133424062 0 0) 0x7f4e200035b0 con 0x7f4e380afd10 2023-03-27T10:10:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e35d9b700 1 -- 172.21.15.172:0/918526724 >> v1:172.21.15.191:6789/0 conn(0x7f4e38142680 legacy=0x7f4e380c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e35d9b700 1 -- 172.21.15.172:0/918526724 >> v1:172.21.15.172:6789/0 conn(0x7f4e380afd10 legacy=0x7f4e3815ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e35d9b700 1 -- 172.21.15.172:0/918526724 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380c3fb0 con 0x7f4e380cbfc0 2023-03-27T10:10:27.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e35d9b700 1 --2- 172.21.15.172:0/918526724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380af7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00a9e0 tx=0x7f4e2c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e78f933f67f6f01 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e3559a700 1 -- 172.21.15.172:0/918526724 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300019f0 con 0x7f4e380cbfc0 2023-03-27T10:10:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e3559a700 1 -- 172.21.15.172:0/918526724 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00ae80 con 0x7f4e380cbfc0 2023-03-27T10:10:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.388+0000 7f4e3559a700 1 -- 172.21.15.172:0/918526724 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c004250 con 0x7f4e380cbfc0 2023-03-27T10:10:27.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 -- 172.21.15.172:0/918526724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 msgr2=0x7f4e380af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/918526724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380af7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00a9e0 tx=0x7f4e2c00acf0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 -- 172.21.15.172:0/918526724 shutdown_connections 2023-03-27T10:10:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/918526724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380af7d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 -- 172.21.15.172:0/918526724 >> 172.21.15.172:0/918526724 conn(0x7f4e3806a1a0 msgr2=0x7f4e3806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 -- 172.21.15.172:0/918526724 shutdown_connections 2023-03-27T10:10:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.389+0000 7f4e3cbff700 1 -- 172.21.15.172:0/918526724 wait complete. 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.391+0000 7f4e3cbff700 1 Processor -- start 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.391+0000 7f4e3cbff700 1 -- start start 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3cbff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 0x7f4e381efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3cbff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3cbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e38142680 0x7f4e380ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3cbff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38136e90 con 0x7f4e380afd10 2023-03-27T10:10:27.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3cbff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381f0200 con 0x7f4e380cbfc0 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3cbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380b1e60 con 0x7f4e38142680 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 0x7f4e381efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 0x7f4e381efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48052/0 (socket says 172.21.15.172:48052) 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 -- 172.21.15.172:0/3092000431 learned_addr learned my addr 172.21.15.172:0/3092000431 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e35d9b700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e36d9d700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e38142680 0x7f4e380ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 -- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e38142680 msgr2=0x7f4e380ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e38142680 0x7f4e380ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 -- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 msgr2=0x7f4e380c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e3659c700 1 -- 172.21.15.172:0/3092000431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c00a640 con 0x7f4e380afd10 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.392+0000 7f4e36d9d700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e38142680 0x7f4e380ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.393+0000 7f4e3659c700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 0x7f4e381efcc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800c450 tx=0x7f4e2800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.393+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280052d0 con 0x7f4e380afd10 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.393+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28005430 con 0x7f4e380afd10 2023-03-27T10:10:27.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.393+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e380c5a30 con 0x7f4e380afd10 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.393+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e280038c0 con 0x7f4e380afd10 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.393+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e380af2b0 con 0x7f4e380afd10 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.394+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e380b0110 con 0x7f4e380afd10 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.395+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f4e28019030 con 0x7f4e380afd10 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.396+0000 7f4e26ffd700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4e18066e60 0x7f4e18069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.396+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e28083590 con 0x7f4e380afd10 2023-03-27T10:10:27.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.397+0000 7f4e35d9b700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4e18066e60 0x7f4e18069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:27.402 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.397+0000 7f4e35d9b700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4e18066e60 0x7f4e18069310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c000c00 tx=0x7f4e2c012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:27.402 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.400+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f4e280507d0 con 0x7f4e380afd10 2023-03-27T10:10:27.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:27.667+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f4e380b04b0 con 0x7f4e380afd10 2023-03-27T10:10:28.661 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.662+0000 7f4e26ffd700 1 -- 172.21.15.172:0/3092000431 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v60) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4e28053df0 con 0x7f4e380afd10 2023-03-27T10:10:28.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4e18066e60 msgr2=0x7f4e18069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:28.664 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4e18066e60 0x7f4e18069310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c000c00 tx=0x7f4e2c012000 comp rx=0 tx=0).stop 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 msgr2=0x7f4e381efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 0x7f4e381efcc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800c450 tx=0x7f4e2800c810 comp rx=0 tx=0).stop 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 shutdown_connections 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e38142680 0x7f4e380ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e380afd10 0x7f4e381efcc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4e18066e60 0x7f4e18069310 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.665 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 --2- 172.21.15.172:0/3092000431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e380cbfc0 0x7f4e380c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 >> 172.21.15.172:0/3092000431 conn(0x7f4e3806a1a0 msgr2=0x7f4e3806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:28.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 shutdown_connections 2023-03-27T10:10:28.666 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.665+0000 7f4e3cbff700 1 -- 172.21.15.172:0/3092000431 wait complete. 2023-03-27T10:10:28.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-27T10:10:28.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.874+0000 7effa75ff700 1 Processor -- start 2023-03-27T10:10:28.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.875+0000 7effa75ff700 1 -- start start 2023-03-27T10:10:28.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa75ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa00cfdf0 0x7effa01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:28.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa75ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa0160a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:28.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa75ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00b0b80 con 0x7effa00d3ba0 2023-03-27T10:10:28.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa75ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa00b3f10 con 0x7effa00cfdf0 2023-03-27T10:10:28.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa75ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00b39c0 con 0x7effa00b4460 2023-03-27T10:10:28.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa539b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa00cfdf0 0x7effa01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:28.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa4b9a700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7effa00d3ba0 0x7effa00b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50038/0 (socket says 172.21.15.172:50038) 2023-03-27T10:10:28.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa4b9a700 1 -- 172.21.15.172:0/179464106 learned_addr learned my addr 172.21.15.172:0/179464106 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:28.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa539b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa00cfdf0 0x7effa01604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48054/0 (socket says 172.21.15.172:48054) 2023-03-27T10:10:28.877 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa5b9c700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa0160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa539b700 1 -- 172.21.15.172:0/179464106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 msgr2=0x7effa0160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa539b700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa0160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa539b700 1 -- 172.21.15.172:0/179464106 >> v1:172.21.15.172:6789/0 conn(0x7effa00d3ba0 legacy=0x7effa00b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa539b700 1 -- 172.21.15.172:0/179464106 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00d2ca0 con 0x7effa00cfdf0 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7effa5b9c700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa0160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.876+0000 7eff97fff700 1 -- 172.21.15.172:0/179464106 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733138314 0 0) 0x7effa00b0b80 con 0x7effa00d3ba0 2023-03-27T10:10:28.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.877+0000 7effa539b700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00cfdf0 0x7effa01604e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009840 tx=0x7eff9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932896254e92f9d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.877+0000 7eff97fff700 1 -- 172.21.15.172:0/179464106 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c011830 con 0x7effa00cfdf0 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.877+0000 7eff97fff700 1 -- 172.21.15.172:0/179464106 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c011990 con 0x7effa00cfdf0 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.877+0000 7eff97fff700 1 -- 172.21.15.172:0/179464106 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c011d20 con 0x7effa00cfdf0 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.877+0000 7effa75ff700 1 -- 172.21.15.172:0/179464106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00cfdf0 msgr2=0x7effa01604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.877+0000 7effa75ff700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00cfdf0 0x7effa01604e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009840 tx=0x7eff9c009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.878+0000 7effa75ff700 1 -- 172.21.15.172:0/179464106 shutdown_connections 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.878+0000 7effa75ff700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00cfdf0 0x7effa01604e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.878+0000 7effa75ff700 1 --2- 172.21.15.172:0/179464106 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa0160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.878+0000 7effa75ff700 1 -- 172.21.15.172:0/179464106 >> 172.21.15.172:0/179464106 conn(0x7effa009c210 msgr2=0x7effa00d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:28.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.878+0000 7effa75ff700 1 -- 172.21.15.172:0/179464106 shutdown_connections 2023-03-27T10:10:28.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.878+0000 7effa75ff700 1 -- 172.21.15.172:0/179464106 wait complete. 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.879+0000 7effa75ff700 1 Processor -- start 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.879+0000 7effa75ff700 1 -- start start 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa75ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa00b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa75ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa00cfdf0 0x7effa015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa75ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 0x7effa00c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa75ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00b6dc0 con 0x7effa00d3ba0 2023-03-27T10:10:28.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa75ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0151820 con 0x7effa00cfdf0 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa75ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00b61b0 con 0x7effa00b4460 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa5b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 0x7effa00c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.880+0000 7effa5b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 0x7effa00c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48060/0 (socket says 172.21.15.172:48060) 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 -- 172.21.15.172:0/1747416922 learned_addr learned my addr 172.21.15.172:0/1747416922 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa4b9a700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa00cfdf0 0x7effa015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa539b700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa00b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 -- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 msgr2=0x7effa00b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:28.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa00b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 -- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa00cfdf0 msgr2=0x7effa015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa00cfdf0 0x7effa015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 -- 172.21.15.172:0/1747416922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0094a0 con 0x7effa00d3ba0 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa539b700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa00b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa4b9a700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa00cfdf0 0x7effa015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa5b9c700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 0x7effa00c7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff98007ef0 tx=0x7eff9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:28.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800de60 con 0x7effa00d3ba0 2023-03-27T10:10:28.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800f040 con 0x7effa00d3ba0 2023-03-27T10:10:28.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98003c60 con 0x7effa00d3ba0 2023-03-27T10:10:28.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.881+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa00b3c80 con 0x7effa00d3ba0 2023-03-27T10:10:28.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.882+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00b4120 con 0x7effa00d3ba0 2023-03-27T10:10:28.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.883+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa00d29c0 con 0x7effa00d3ba0 2023-03-27T10:10:28.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.883+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7eff9801c030 con 0x7effa00d3ba0 2023-03-27T10:10:28.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.884+0000 7eff95ffb700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:28.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.884+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff98084320 con 0x7effa00d3ba0 2023-03-27T10:10:28.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.885+0000 7effa539b700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:28.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.885+0000 7effa539b700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0090b0 tx=0x7eff9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:28.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:28.888+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7eff98051560 con 0x7effa00d3ba0 2023-03-27T10:10:29.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.078+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7effa0066880 con 0x7effa00d3ba0 2023-03-27T10:10:29.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.083+0000 7eff95ffb700 1 -- 172.21.15.172:0/1747416922 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff98054b80 con 0x7effa00d3ba0 2023-03-27T10:10:29.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 msgr2=0x7eff840692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0090b0 tx=0x7eff9c008030 comp rx=0 tx=0).stop 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 msgr2=0x7effa00c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 0x7effa00c7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff98007ef0 tx=0x7eff9800d3b0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 shutdown_connections 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa00d3ba0 0x7effa00c7830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa00b4460 0x7effa00b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff84066e30 0x7eff840692e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 --2- 172.21.15.172:0/1747416922 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effa00cfdf0 0x7effa015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 >> 172.21.15.172:0/1747416922 conn(0x7effa009c210 msgr2=0x7effa00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:29.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 shutdown_connections 2023-03-27T10:10:29.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.085+0000 7effa75ff700 1 -- 172.21.15.172:0/1747416922 wait complete. 2023-03-27T10:10:29.102 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-27T10:10:29.102 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-27T10:10:29.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-27T10:10:29.295 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-27T10:10:29.424 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:29.425 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:29.467 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:29.468 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:29.548 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:29.549 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:29.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:29.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.853+0000 7f98eb7ff700 1 Processor -- start 2023-03-27T10:10:29.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.853+0000 7f98eb7ff700 1 -- start start 2023-03-27T10:10:29.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.854+0000 7f98eb7ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f98e415ca20 0x7f98e40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.854+0000 7f98eb7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f98e40cd610 0x7f98e40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.854+0000 7f98eb7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40cebc0 con 0x7f98e40d0b90 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.854+0000 7f98eb7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40ceea0 con 0x7f98e40cd610 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.854+0000 7f98eb7ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40cf180 con 0x7f98e415ca20 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e959b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f98e40d0b90 0x7f98e40d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50054/0 (socket says 172.21.15.172:50054) 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e959b700 1 -- 172.21.15.172:0/3172686653 learned_addr learned my addr 172.21.15.172:0/3172686653 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:29.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e9d9c700 1 --2- 172.21.15.172:0/3172686653 >> v2:172.21.15.172:3300/0 conn(0x7f98e40cd610 0x7f98e40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e8d9a700 1 --2- 172.21.15.172:0/3172686653 >> v2:172.21.15.191:3300/0 conn(0x7f98e415ca20 0x7f98e40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98dbfff700 1 -- 172.21.15.172:0/3172686653 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674920108 0 0) 0x7f98e40cebc0 con 0x7f98e40d0b90 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98dbfff700 1 -- 172.21.15.172:0/3172686653 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d00035b0 con 0x7f98e40d0b90 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e9d9c700 1 -- 172.21.15.172:0/3172686653 >> v2:172.21.15.191:3300/0 conn(0x7f98e415ca20 msgr2=0x7f98e40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e9d9c700 1 --2- 172.21.15.172:0/3172686653 >> v2:172.21.15.191:3300/0 conn(0x7f98e415ca20 0x7f98e40ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e9d9c700 1 -- 172.21.15.172:0/3172686653 >> v1:172.21.15.172:6789/0 conn(0x7f98e40d0b90 legacy=0x7f98e40d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e9d9c700 1 -- 172.21.15.172:0/3172686653 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40cf460 con 0x7f98e40cd610 2023-03-27T10:10:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e8d9a700 1 --2- 172.21.15.172:0/3172686653 >> v2:172.21.15.191:3300/0 conn(0x7f98e415ca20 0x7f98e40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:29.857 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.855+0000 7f98e9d9c700 1 --2- 172.21.15.172:0/3172686653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b0170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f98e4067930 tx=0x7f98dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00022bcb1d3e5d5 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:29.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98dbfff700 1 -- 172.21.15.172:0/3172686653 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00e070 con 0x7f98e40cd610 2023-03-27T10:10:29.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98dbfff700 1 -- 172.21.15.172:0/3172686653 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00bb20 con 0x7f98e40cd610 2023-03-27T10:10:29.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98dbfff700 1 -- 172.21.15.172:0/3172686653 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00be90 con 0x7f98e40cd610 2023-03-27T10:10:29.858 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 -- 172.21.15.172:0/3172686653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 msgr2=0x7f98e40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/3172686653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b0170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f98e4067930 tx=0x7f98dc00b330 comp rx=0 tx=0).stop 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 -- 172.21.15.172:0/3172686653 shutdown_connections 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/3172686653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b0170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/3172686653 >> v2:172.21.15.191:3300/0 conn(0x7f98e415ca20 0x7f98e40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 -- 172.21.15.172:0/3172686653 >> 172.21.15.172:0/3172686653 conn(0x7f98e40721f0 msgr2=0x7f98e409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 -- 172.21.15.172:0/3172686653 shutdown_connections 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.856+0000 7f98eb7ff700 1 -- 172.21.15.172:0/3172686653 wait complete. 2023-03-27T10:10:29.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.859+0000 7f98eb7ff700 1 Processor -- start 2023-03-27T10:10:29.860 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.859+0000 7f98eb7ff700 1 -- start start 2023-03-27T10:10:29.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98eb7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:29.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98eb7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98e40d0b90 0x7f98e4155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:29.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98eb7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98e415ca20 0x7f98e40b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98eb7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4155b50 con 0x7f98e40cd610 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98eb7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40b4cf0 con 0x7f98e415ca20 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98eb7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40b28b0 con 0x7f98e40d0b90 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98e959b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98e959b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48072/0 (socket says 172.21.15.172:48072) 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98e959b700 1 -- 172.21.15.172:0/1233217028 learned_addr learned my addr 172.21.15.172:0/1233217028 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98e8d9a700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98e40d0b90 0x7f98e4155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.860+0000 7f98e9d9c700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98e415ca20 0x7f98e40b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98e959b700 1 -- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98e40d0b90 msgr2=0x7f98e4155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98e959b700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98e40d0b90 0x7f98e4155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98e959b700 1 -- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98e415ca20 msgr2=0x7f98e40b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98e959b700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98e415ca20 0x7f98e40b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98e959b700 1 -- 172.21.15.172:0/1233217028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009a70 con 0x7f98e40cd610 2023-03-27T10:10:29.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98e959b700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b21b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f98e000c700 tx=0x7f98e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00074e0 con 0x7f98e40cd610 2023-03-27T10:10:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0007660 con 0x7f98e40cd610 2023-03-27T10:10:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e40d2d30 con 0x7f98e40cd610 2023-03-27T10:10:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0005a70 con 0x7f98e40cd610 2023-03-27T10:10:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.861+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e40afc50 con 0x7f98e40cd610 2023-03-27T10:10:29.865 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.862+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e40b06b0 con 0x7f98e40cd610 2023-03-27T10:10:29.865 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.863+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f98e0019030 con 0x7f98e40cd610 2023-03-27T10:10:29.865 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.864+0000 7f98d9ffb700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f98c8066e30 0x7f98c80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:29.865 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.864+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98e0083520 con 0x7f98e40cd610 2023-03-27T10:10:29.865 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.865+0000 7f98e8d9a700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f98c8066e30 0x7f98c80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:29.866 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.865+0000 7f98e8d9a700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f98c8066e30 0x7f98c80692e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98e406bbb0 tx=0x7f98d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:29.867 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:29.868+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f98e0050760 con 0x7f98e40cd610 2023-03-27T10:10:30.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.058+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e40c7d70 con 0x7f98e40cd610 2023-03-27T10:10:30.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.059+0000 7f98d9ffb700 1 -- 172.21.15.172:0/1233217028 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17955 (secure 0 0 0) 0x7f98e0017090 con 0x7f98e40cd610 2023-03-27T10:10:30.059 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:30.060 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:09:53.072071+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:30.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f98c8066e30 msgr2=0x7f98c80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f98c8066e30 0x7f98c80692e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98e406bbb0 tx=0x7f98d4008040 comp rx=0 tx=0).stop 2023-03-27T10:10:30.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 msgr2=0x7f98e40b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b21b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f98e000c700 tx=0x7f98e000ca10 comp rx=0 tx=0).stop 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 shutdown_connections 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f98c8066e30 0x7f98c80692e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f98e415ca20 0x7f98e40b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98e40cd610 0x7f98e40b21b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 --2- 172.21.15.172:0/1233217028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f98e40d0b90 0x7f98e4155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 >> 172.21.15.172:0/1233217028 conn(0x7f98e40721f0 msgr2=0x7f98e409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:30.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 shutdown_connections 2023-03-27T10:10:30.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.062+0000 7f98eb7ff700 1 -- 172.21.15.172:0/1233217028 wait complete. 2023-03-27T10:10:30.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:30.080 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:30.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.267+0000 7fe055fff700 1 Processor -- start 2023-03-27T10:10:30.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.267+0000 7fe055fff700 1 -- start start 2023-03-27T10:10:30.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.268+0000 7fe055fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe05006da00 0x7fe05006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.268+0000 7fe055fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe050160980 con 0x7fe050072400 2023-03-27T10:10:30.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.268+0000 7fe055fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0501463e0 con 0x7fe05006ab40 2023-03-27T10:10:30.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.268+0000 7fe055fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0501611a0 con 0x7fe05006da00 2023-03-27T10:10:30.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04effd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe050072400 0x7fe050160270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50070/0 (socket says 172.21.15.172:50070) 2023-03-27T10:10:30.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04effd700 1 -- 172.21.15.172:0/2694794162 learned_addr learned my addr 172.21.15.172:0/2694794162 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:30.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04f7fe700 1 --2- 172.21.15.172:0/2694794162 >> v2:172.21.15.191:3300/0 conn(0x7fe05006da00 0x7fe05006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827717636 0 0) 0x7fe050160980 con 0x7fe050072400 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0380035b0 con 0x7fe050072400 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3868333109 0 0) 0x7fe0380035b0 con 0x7fe050072400 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 >> v2:172.21.15.191:3300/0 conn(0x7fe05006da00 msgr2=0x7fe05006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 --2- 172.21.15.172:0/2694794162 >> v2:172.21.15.191:3300/0 conn(0x7fe05006da00 0x7fe05006ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 >> v1:172.21.15.191:6789/0 conn(0x7fe05006ab40 legacy=0x7fe05015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05006e310 con 0x7fe050072400 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.269+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7fe044001670 con 0x7fe050072400 2023-03-27T10:10:30.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 >> v1:172.21.15.172:6789/0 conn(0x7fe050072400 legacy=0x7fe050160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe038003a00 0x7fe038003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380043f0 0x7fe0380048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0380050b0 0x7fe03800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0501611a0 con 0x7fe0380050b0 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03800c000 con 0x7fe038003a00 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03800c1c0 con 0x7fe0380043f0 2023-03-27T10:10:30.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0380050b0 0x7fe03800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04f7fe700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe038003a00 0x7fe038003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04effd700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380043f0 0x7fe0380048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 -- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380043f0 msgr2=0x7fe0380048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:30.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380043f0 0x7fe0380048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 -- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe038003a00 msgr2=0x7fe038003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe038003a00 0x7fe038003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 -- 172.21.15.172:0/2694794162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380035b0 con 0x7fe0380050b0 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.270+0000 7fe04ffff700 1 -- 172.21.15.172:0/2694794162 reap_dead start 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe04ffff700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0380050b0 0x7fe03800ba10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c290 tx=0x7fe038005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4505b2565de8dc41 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048001e70 con 0x7fe0380050b0 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800ce70 con 0x7fe0380050b0 2023-03-27T10:10:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe04e7fc700 1 -- 172.21.15.172:0/2694794162 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048003c20 con 0x7fe0380050b0 2023-03-27T10:10:30.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe055fff700 1 -- 172.21.15.172:0/2694794162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0380050b0 msgr2=0x7fe03800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe055fff700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0380050b0 0x7fe03800ba10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c290 tx=0x7fe038005880 comp rx=0 tx=0).stop 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe055fff700 1 -- 172.21.15.172:0/2694794162 shutdown_connections 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe055fff700 1 --2- 172.21.15.172:0/2694794162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0380050b0 0x7fe03800ba10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe055fff700 1 -- 172.21.15.172:0/2694794162 >> 172.21.15.172:0/2694794162 conn(0x7fe0500b1010 msgr2=0x7fe0500b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.271+0000 7fe055fff700 1 -- 172.21.15.172:0/2694794162 shutdown_connections 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.272+0000 7fe055fff700 1 -- 172.21.15.172:0/2694794162 wait complete. 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.273+0000 7fe055fff700 1 Processor -- start 2023-03-27T10:10:30.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.273+0000 7fe055fff700 1 -- start start 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe055fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380050b0 0x7fe0500b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe055fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 0x7fe0500ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe055fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0500cc8c0 0x7fe0500ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe055fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500ade20 con 0x7fe0500cbf30 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe055fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500cd270 con 0x7fe0500cc8c0 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe055fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500ad1a0 con 0x7fe0380050b0 2023-03-27T10:10:30.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe04effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 0x7fe0500ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe04effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 0x7fe0500ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48092/0 (socket says 172.21.15.172:48092) 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.274+0000 7fe04effd700 1 -- 172.21.15.172:0/3780620489 learned_addr learned my addr 172.21.15.172:0/3780620489 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04ffff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0500cc8c0 0x7fe0500ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04f7fe700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380050b0 0x7fe0500b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04effd700 1 -- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380050b0 msgr2=0x7fe0500b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04effd700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380050b0 0x7fe0500b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04effd700 1 -- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0500cc8c0 msgr2=0x7fe0500ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04effd700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0500cc8c0 0x7fe0500ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04effd700 1 -- 172.21.15.172:0/3780620489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050160ec0 con 0x7fe0500cbf30 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04f7fe700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380050b0 0x7fe0500b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04ffff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0500cc8c0 0x7fe0500ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe04effd700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 0x7fe0500ac8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe044007290 tx=0x7fe044007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400f6c0 con 0x7fe0500cbf30 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400f860 con 0x7fe0500cbf30 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe050160be0 con 0x7fe0500cbf30 2023-03-27T10:10:30.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400fc10 con 0x7fe0500cbf30 2023-03-27T10:10:30.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.275+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05006a340 con 0x7fe0500cbf30 2023-03-27T10:10:30.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.276+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe050074300 con 0x7fe0500cbf30 2023-03-27T10:10:30.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.277+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe04400fd70 con 0x7fe0500cbf30 2023-03-27T10:10:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.278+0000 7fe037fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe03c066e30 0x7fe03c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.278+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe044084490 con 0x7fe0500cbf30 2023-03-27T10:10:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.279+0000 7fe04f7fe700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe03c066e30 0x7fe03c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.279+0000 7fe04f7fe700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe03c066e30 0x7fe03c0692e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe040009ae0 tx=0x7fe040008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.282+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe044051640 con 0x7fe0500cbf30 2023-03-27T10:10:30.468 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.469+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe05006eb40 con 0x7fe0500cbf30 2023-03-27T10:10:30.469 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.469+0000 7fe037fff700 1 -- 172.21.15.172:0/3780620489 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe044054c60 con 0x7fe0500cbf30 2023-03-27T10:10:30.469 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe03c066e30 msgr2=0x7fe03c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe03c066e30 0x7fe03c0692e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe040009ae0 tx=0x7fe040008040 comp rx=0 tx=0).stop 2023-03-27T10:10:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 msgr2=0x7fe0500ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 0x7fe0500ac8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe044007290 tx=0x7fe044007650 comp rx=0 tx=0).stop 2023-03-27T10:10:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 shutdown_connections 2023-03-27T10:10:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe03c066e30 0x7fe03c0692e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0500cc8c0 0x7fe0500ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0380050b0 0x7fe0500b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 --2- 172.21.15.172:0/3780620489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500cbf30 0x7fe0500ac8a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.471+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 >> 172.21.15.172:0/3780620489 conn(0x7fe0500b1010 msgr2=0x7fe050144f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.472+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 shutdown_connections 2023-03-27T10:10:30.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.472+0000 7fe055fff700 1 -- 172.21.15.172:0/3780620489 wait complete. 2023-03-27T10:10:30.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:30.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.677+0000 7f2c175ff700 1 Processor -- start 2023-03-27T10:10:30.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.677+0000 7f2c175ff700 1 -- start start 2023-03-27T10:10:30.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.678+0000 7f2c175ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2c100ce270 0x7f2c100cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.678+0000 7f2c175ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2c1006b2b0 0x7f2c1006b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.678+0000 7f2c175ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100cb940 con 0x7f2c1015c620 2023-03-27T10:10:30.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.678+0000 7f2c175ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100ce6e0 con 0x7f2c100ce270 2023-03-27T10:10:30.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.678+0000 7f2c175ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1006bc70 con 0x7f2c1006b2b0 2023-03-27T10:10:30.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2c100ce270 0x7f2c100cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2c100ce270 0x7f2c100cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48096/0 (socket says 172.21.15.172:48096) 2023-03-27T10:10:30.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c1539b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2c1015c620 0x7f2c100ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50080/0 (socket says 172.21.15.172:50080) 2023-03-27T10:10:30.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 -- 172.21.15.172:0/3724562678 learned_addr learned my addr 172.21.15.172:0/3724562678 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:30.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c15b9c700 1 --2- 172.21.15.172:0/3724562678 >> v2:172.21.15.191:3300/0 conn(0x7f2c1006b2b0 0x7f2c1006b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 -- 172.21.15.172:0/3724562678 >> v2:172.21.15.191:3300/0 conn(0x7f2c1006b2b0 msgr2=0x7f2c1006b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:30.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 --2- 172.21.15.172:0/3724562678 >> v2:172.21.15.191:3300/0 conn(0x7f2c1006b2b0 0x7f2c1006b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 -- 172.21.15.172:0/3724562678 >> v1:172.21.15.172:6789/0 conn(0x7f2c1015c620 legacy=0x7f2c100ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 -- 172.21.15.172:0/3724562678 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100cc780 con 0x7f2c100ce270 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c07fff700 1 -- 172.21.15.172:0/3724562678 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235188383 0 0) 0x7f2c100cb940 con 0x7f2c1015c620 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.679+0000 7f2c14b9a700 1 --2- 172.21.15.172:0/3724562678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c100ce270 0x7f2c100cb400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c100716a0 tx=0x7f2c00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9658633cb139bc server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c07fff700 1 -- 172.21.15.172:0/3724562678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00011830 con 0x7f2c100ce270 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c07fff700 1 -- 172.21.15.172:0/3724562678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c00011990 con 0x7f2c100ce270 2023-03-27T10:10:30.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c07fff700 1 -- 172.21.15.172:0/3724562678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00011d20 con 0x7f2c100ce270 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 -- 172.21.15.172:0/3724562678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c100ce270 msgr2=0x7f2c100cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 --2- 172.21.15.172:0/3724562678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c100ce270 0x7f2c100cb400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2c100716a0 tx=0x7f2c00009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 -- 172.21.15.172:0/3724562678 shutdown_connections 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 --2- 172.21.15.172:0/3724562678 >> v2:172.21.15.191:3300/0 conn(0x7f2c1006b2b0 0x7f2c1006b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 --2- 172.21.15.172:0/3724562678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c100ce270 0x7f2c100cb400 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 -- 172.21.15.172:0/3724562678 >> 172.21.15.172:0/3724562678 conn(0x7f2c10072230 msgr2=0x7f2c1006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:30.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 -- 172.21.15.172:0/3724562678 shutdown_connections 2023-03-27T10:10:30.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.680+0000 7f2c175ff700 1 -- 172.21.15.172:0/3724562678 wait complete. 2023-03-27T10:10:30.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.682+0000 7f2c175ff700 1 Processor -- start 2023-03-27T10:10:30.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.682+0000 7f2c175ff700 1 -- start start 2023-03-27T10:10:30.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c175ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 0x7f2c101f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c175ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c100ce270 0x7f2c1006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c175ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c1015c620 0x7f2c101e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c175ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100cb7c0 con 0x7f2c1006b2b0 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c175ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c101f2dc0 con 0x7f2c1015c620 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c175ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b5650 con 0x7f2c100ce270 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c1539b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 0x7f2c101f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c1539b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 0x7f2c101f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48102/0 (socket says 172.21.15.172:48102) 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c1539b700 1 -- 172.21.15.172:0/549971938 learned_addr learned my addr 172.21.15.172:0/549971938 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.683+0000 7f2c15b9c700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c1015c620 0x7f2c101e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c14b9a700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c100ce270 0x7f2c1006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c1539b700 1 -- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c100ce270 msgr2=0x7f2c1006f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c1539b700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c100ce270 0x7f2c1006f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c1539b700 1 -- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c1015c620 msgr2=0x7f2c101e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c1539b700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c1015c620 0x7f2c101e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c1539b700 1 -- 172.21.15.172:0/549971938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00009550 con 0x7f2c1006b2b0 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c15b9c700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c1015c620 0x7f2c101e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c14b9a700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c100ce270 0x7f2c1006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c1539b700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 0x7f2c101f2880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c4a0 tx=0x7f2c0c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0074e0 con 0x7f2c1006b2b0 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c007640 con 0x7f2c1006b2b0 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c100cbb70 con 0x7f2c1006b2b0 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005a50 con 0x7f2c1006b2b0 2023-03-27T10:10:30.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.684+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1015c9f0 con 0x7f2c1006b2b0 2023-03-27T10:10:30.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.685+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c100cbe50 con 0x7f2c1006b2b0 2023-03-27T10:10:30.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.686+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f2c0c019030 con 0x7f2c1006b2b0 2023-03-27T10:10:30.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.687+0000 7f2c05ffb700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bf4066e30 0x7f2bf40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:30.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.687+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c0c0836d0 con 0x7f2c1006b2b0 2023-03-27T10:10:30.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.687+0000 7f2c14b9a700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bf4066e30 0x7f2bf40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:30.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.688+0000 7f2c14b9a700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bf4066e30 0x7f2bf40692e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2c1015c010 tx=0x7f2c00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:30.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.691+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f2c0c050910 con 0x7f2c1006b2b0 2023-03-27T10:10:30.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.877+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c10074300 con 0x7f2c1006b2b0 2023-03-27T10:10:30.877 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.877+0000 7f2c05ffb700 1 -- 172.21.15.172:0/549971938 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c0c0170a0 con 0x7f2c1006b2b0 2023-03-27T10:10:30.877 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bf4066e30 msgr2=0x7f2bf40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bf4066e30 0x7f2bf40692e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2c1015c010 tx=0x7f2c00008030 comp rx=0 tx=0).stop 2023-03-27T10:10:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 msgr2=0x7f2c101f2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 0x7f2c101f2880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c4a0 tx=0x7f2c0c00c860 comp rx=0 tx=0).stop 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 shutdown_connections 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2bf4066e30 0x7f2bf40692e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.879+0000 7f2c175ff700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c1015c620 0x7f2c101e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.880+0000 7f2c175ff700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c1006b2b0 0x7f2c101f2880 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.880+0000 7f2c175ff700 1 --2- 172.21.15.172:0/549971938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2c100ce270 0x7f2c1006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.880+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 >> 172.21.15.172:0/549971938 conn(0x7f2c10072230 msgr2=0x7f2c100c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:30.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.880+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 shutdown_connections 2023-03-27T10:10:30.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:30.880+0000 7f2c175ff700 1 -- 172.21.15.172:0/549971938 wait complete. 2023-03-27T10:10:30.896 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:31.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.083+0000 7f5fe3bff700 1 Processor -- start 2023-03-27T10:10:31.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.084+0000 7f5fe3bff700 1 -- start start 2023-03-27T10:10:31.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe3bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc0d11d0 0x7f5fdc1604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe3bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5fdc0d3a30 0x7f5fdc1609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe3bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0d29d0 con 0x7f5fdc15a240 2023-03-27T10:10:31.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe3bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc161200 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe3bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15a610 con 0x7f5fdc0d11d0 2023-03-27T10:10:31.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe199b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5fdc15a240 0x7f5fdc0d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50084/0 (socket says 172.21.15.172:50084) 2023-03-27T10:10:31.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe199b700 1 -- 172.21.15.172:0/1417449779 learned_addr learned my addr 172.21.15.172:0/1417449779 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:31.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe119a700 1 --2- 172.21.15.172:0/1417449779 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc0d11d0 0x7f5fdc1604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe219c700 1 --2- 172.21.15.172:0/1417449779 >> v2:172.21.15.191:3300/0 conn(0x7f5fdc0d3a30 0x7f5fdc1609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe0999700 1 -- 172.21.15.172:0/1417449779 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612279689 0 0) 0x7f5fdc0d29d0 con 0x7f5fdc15a240 2023-03-27T10:10:31.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.085+0000 7f5fe0999700 1 -- 172.21.15.172:0/1417449779 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc80035b0 con 0x7f5fdc15a240 2023-03-27T10:10:31.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe119a700 1 -- 172.21.15.172:0/1417449779 >> v2:172.21.15.191:3300/0 conn(0x7f5fdc0d3a30 msgr2=0x7f5fdc1609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:31.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe119a700 1 --2- 172.21.15.172:0/1417449779 >> v2:172.21.15.191:3300/0 conn(0x7f5fdc0d3a30 0x7f5fdc1609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe119a700 1 -- 172.21.15.172:0/1417449779 >> v1:172.21.15.172:6789/0 conn(0x7f5fdc15a240 legacy=0x7f5fdc0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe119a700 1 -- 172.21.15.172:0/1417449779 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc160f30 con 0x7f5fdc0d11d0 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe219c700 1 --2- 172.21.15.172:0/1417449779 >> v2:172.21.15.191:3300/0 conn(0x7f5fdc0d3a30 0x7f5fdc1609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe119a700 1 --2- 172.21.15.172:0/1417449779 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc0d11d0 0x7f5fdc1604b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009840 tx=0x7f5fcc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe4fa4944479d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe0999700 1 -- 172.21.15.172:0/1417449779 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc011830 con 0x7f5fdc0d11d0 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe0999700 1 -- 172.21.15.172:0/1417449779 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc011990 con 0x7f5fdc0d11d0 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.086+0000 7f5fe0999700 1 -- 172.21.15.172:0/1417449779 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc011d00 con 0x7f5fdc0d11d0 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 -- 172.21.15.172:0/1417449779 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc0d11d0 msgr2=0x7f5fdc1604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/1417449779 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc0d11d0 0x7f5fdc1604b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009840 tx=0x7f5fcc009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 -- 172.21.15.172:0/1417449779 shutdown_connections 2023-03-27T10:10:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/1417449779 >> v2:172.21.15.191:3300/0 conn(0x7f5fdc0d3a30 0x7f5fdc1609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/1417449779 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc0d11d0 0x7f5fdc1604b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 -- 172.21.15.172:0/1417449779 >> 172.21.15.172:0/1417449779 conn(0x7f5fdc0721f0 msgr2=0x7f5fdc09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 -- 172.21.15.172:0/1417449779 shutdown_connections 2023-03-27T10:10:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.087+0000 7f5fe3bff700 1 -- 172.21.15.172:0/1417449779 wait complete. 2023-03-27T10:10:31.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.088+0000 7f5fe3bff700 1 Processor -- start 2023-03-27T10:10:31.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 -- start start 2023-03-27T10:10:31.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fdc0d11d0 0x7f5fdc15f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 0x7f5fdc0b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc15a240 0x7f5fdc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15e590 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15e7e0 con 0x7f5fdc0d11d0 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.089+0000 7f5fe3bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15eac0 con 0x7f5fdc15a240 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 0x7f5fdc0b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 0x7f5fdc0b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48112/0 (socket says 172.21.15.172:48112) 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 -- 172.21.15.172:0/2482761130 learned_addr learned my addr 172.21.15.172:0/2482761130 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe199b700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fdc0d11d0 0x7f5fdc15f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe219c700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc15a240 0x7f5fdc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 -- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc15a240 msgr2=0x7f5fdc0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc15a240 0x7f5fdc0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 -- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fdc0d11d0 msgr2=0x7f5fdc15f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fdc0d11d0 0x7f5fdc15f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 -- 172.21.15.172:0/2482761130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009a70 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.090+0000 7f5fe119a700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 0x7f5fdc0b6ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0090b0 tx=0x7f5fcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.091+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc004550 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.091+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc01f070 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.091+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc0094a0 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.091+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0038e0 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.091+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc0d2f50 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.092+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc0d2c70 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.093+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f5fcc00f050 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.093+0000 7f5fd27fc700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5fc0066e30 0x7f5fc00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.094+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fcc021070 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.094+0000 7f5fe199b700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5fc0066e30 0x7f5fc00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.095+0000 7f5fe199b700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5fc0066e30 0x7f5fc00692e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007fd0 tx=0x7f5fd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.098+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f5fcc052c20 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.285 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.285+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fdc0d3230 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.285 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.285+0000 7f5fd27fc700 1 -- 172.21.15.172:0/2482761130 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fcc015020 con 0x7f5fdc0d3a30 2023-03-27T10:10:31.285 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:31.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5fc0066e30 msgr2=0x7f5fc00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5fc0066e30 0x7f5fc00692e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8007fd0 tx=0x7f5fd8009040 comp rx=0 tx=0).stop 2023-03-27T10:10:31.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 msgr2=0x7f5fdc0b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 0x7f5fdc0b6ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0090b0 tx=0x7f5fcc004750 comp rx=0 tx=0).stop 2023-03-27T10:10:31.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 shutdown_connections 2023-03-27T10:10:31.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fdc15a240 0x7f5fdc0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5fc0066e30 0x7f5fc00692e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fdc0d11d0 0x7f5fdc15f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 --2- 172.21.15.172:0/2482761130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fdc0d3a30 0x7f5fdc0b6ec0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 >> 172.21.15.172:0/2482761130 conn(0x7f5fdc0721f0 msgr2=0x7f5fdc0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:31.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 shutdown_connections 2023-03-27T10:10:31.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.288+0000 7f5fe3bff700 1 -- 172.21.15.172:0/2482761130 wait complete. 2023-03-27T10:10:31.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:31.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.492+0000 7f18ed5ff700 1 Processor -- start 2023-03-27T10:10:31.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.492+0000 7f18ed5ff700 1 -- start start 2023-03-27T10:10:31.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18ed5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e80d04f0 0x7f18e80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18ed5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f18e80cf910 0x7f18e80cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18ed5ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e80cdc60 con 0x7f18e815c750 2023-03-27T10:10:31.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18ed5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e80d02c0 con 0x7f18e80cf910 2023-03-27T10:10:31.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18ed5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80cdec0 con 0x7f18e80d04f0 2023-03-27T10:10:31.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18e77fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f18e80cf910 0x7f18e80cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18e6ffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f18e815c750 0x7f18e80cd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50090/0 (socket says 172.21.15.172:50090) 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.493+0000 7f18e6ffd700 1 -- 172.21.15.172:0/2095186576 learned_addr learned my addr 172.21.15.172:0/2095186576 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e67fc700 1 --2- 172.21.15.172:0/2095186576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e80d04f0 0x7f18e80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e5ffb700 1 -- 172.21.15.172:0/2095186576 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741780756 0 0) 0x7f18e80cdc60 con 0x7f18e815c750 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e5ffb700 1 -- 172.21.15.172:0/2095186576 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d00035b0 con 0x7f18e815c750 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e77fe700 1 -- 172.21.15.172:0/2095186576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e80d04f0 msgr2=0x7f18e80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:31.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e77fe700 1 --2- 172.21.15.172:0/2095186576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e80d04f0 0x7f18e80cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e77fe700 1 -- 172.21.15.172:0/2095186576 >> v1:172.21.15.172:6789/0 conn(0x7f18e815c750 legacy=0x7f18e80cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e77fe700 1 -- 172.21.15.172:0/2095186576 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e80ce1a0 con 0x7f18e80cf910 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e77fe700 1 --2- 172.21.15.172:0/2095186576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80cf910 0x7f18e80cfd80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009d90 tx=0x7f18e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc399fa88587050 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e5ffb700 1 -- 172.21.15.172:0/2095186576 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000e070 con 0x7f18e80cf910 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e5ffb700 1 -- 172.21.15.172:0/2095186576 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000bb20 con 0x7f18e80cf910 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.494+0000 7f18e5ffb700 1 -- 172.21.15.172:0/2095186576 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0012430 con 0x7f18e80cf910 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 -- 172.21.15.172:0/2095186576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80cf910 msgr2=0x7f18e80cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/2095186576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80cf910 0x7f18e80cfd80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009d90 tx=0x7f18e000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:31.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 -- 172.21.15.172:0/2095186576 shutdown_connections 2023-03-27T10:10:31.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/2095186576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80cf910 0x7f18e80cfd80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/2095186576 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e80d04f0 0x7f18e80cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 -- 172.21.15.172:0/2095186576 >> 172.21.15.172:0/2095186576 conn(0x7f18e80721f0 msgr2=0x7f18e809c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:31.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 -- 172.21.15.172:0/2095186576 shutdown_connections 2023-03-27T10:10:31.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.495+0000 7f18ed5ff700 1 -- 172.21.15.172:0/2095186576 wait complete. 2023-03-27T10:10:31.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.497+0000 7f18ed5ff700 1 Processor -- start 2023-03-27T10:10:31.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.497+0000 7f18ed5ff700 1 -- start start 2023-03-27T10:10:31.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18ed5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18e80cf910 0x7f18e80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18ed5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 0x7f18e8157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18ed5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e815c750 0x7f18e8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18ed5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81f2080 con 0x7f18e80d04f0 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18ed5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8141fd0 con 0x7f18e80cf910 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18ed5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80c9960 con 0x7f18e815c750 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 0x7f18e8157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 0x7f18e8157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48132/0 (socket says 172.21.15.172:48132) 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 -- 172.21.15.172:0/3281250265 learned_addr learned my addr 172.21.15.172:0/3281250265 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:31.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e6ffd700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18e80cf910 0x7f18e80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e77fe700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e815c750 0x7f18e8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 -- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e815c750 msgr2=0x7f18e8155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e815c750 0x7f18e8155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 -- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18e80cf910 msgr2=0x7f18e80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18e80cf910 0x7f18e80c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.498+0000 7f18e67fc700 1 -- 172.21.15.172:0/3281250265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0009a70 con 0x7f18e80d04f0 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.499+0000 7f18e67fc700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 0x7f18e8157a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00e980 tx=0x7f18dc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.499+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00c7f0 con 0x7f18e80d04f0 2023-03-27T10:10:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.499+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc00c950 con 0x7f18e80d04f0 2023-03-27T10:10:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.499+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00ccc0 con 0x7f18e80d04f0 2023-03-27T10:10:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.499+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e80ce760 con 0x7f18e80d04f0 2023-03-27T10:10:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.499+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e80ce480 con 0x7f18e80d04f0 2023-03-27T10:10:31.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.500+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e80cea40 con 0x7f18e80d04f0 2023-03-27T10:10:31.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.501+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f18dc019030 con 0x7f18e80d04f0 2023-03-27T10:10:31.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.502+0000 7f18cf7fe700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f18d4066e30 0x7f18d40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.502+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18dc0841d0 con 0x7f18e80d04f0 2023-03-27T10:10:31.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.502+0000 7f18e6ffd700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f18d4066e30 0x7f18d40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.503 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.503+0000 7f18e6ffd700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f18d4066e30 0x7f18d40692e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f18d80011e0 tx=0x7f18d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.506+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f18dc0514d0 con 0x7f18e80d04f0 2023-03-27T10:10:31.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.705+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18e8074300 con 0x7f18e80d04f0 2023-03-27T10:10:31.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.705+0000 7f18cf7fe700 1 -- 172.21.15.172:0/3281250265 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18dc054af0 con 0x7f18e80d04f0 2023-03-27T10:10:31.705 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:31.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f18d4066e30 msgr2=0x7f18d40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f18d4066e30 0x7f18d40692e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f18d80011e0 tx=0x7f18d8009040 comp rx=0 tx=0).stop 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 msgr2=0x7f18e8157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 0x7f18e8157a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00e980 tx=0x7f18dc00ed40 comp rx=0 tx=0).stop 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 shutdown_connections 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18e815c750 0x7f18e8155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f18d4066e30 0x7f18d40692e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18e80cf910 0x7f18e80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 --2- 172.21.15.172:0/3281250265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18e80d04f0 0x7f18e8157a60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 >> 172.21.15.172:0/3281250265 conn(0x7f18e80721f0 msgr2=0x7f18e80b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:31.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 shutdown_connections 2023-03-27T10:10:31.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.708+0000 7f18ed5ff700 1 -- 172.21.15.172:0/3281250265 wait complete. 2023-03-27T10:10:31.724 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blocklist ls' 2023-03-27T10:10:31.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.907+0000 7f63545ff700 1 Processor -- start 2023-03-27T10:10:31.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.908+0000 7f63545ff700 1 -- start start 2023-03-27T10:10:31.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f63545ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f634c0cd760 0x7f634c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.908 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f63545ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f634c15c8f0 0x7f634c06f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f63545ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0cb3a0 con 0x7f634c0b27d0 2023-03-27T10:10:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f63545ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c06b9a0 con 0x7f634c0cd760 2023-03-27T10:10:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f63545ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c070220 con 0x7f634c15c8f0 2023-03-27T10:10:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f634c0cd760 0x7f634c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f634c0cd760 0x7f634c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48148/0 (socket says 172.21.15.172:48148) 2023-03-27T10:10:31.910 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 -- 172.21.15.172:0/832856678 learned_addr learned my addr 172.21.15.172:0/832856678 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:31.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f6351b9a700 1 --2- 172.21.15.172:0/832856678 >> v2:172.21.15.191:3300/0 conn(0x7f634c15c8f0 0x7f634c06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 -- 172.21.15.172:0/832856678 >> v2:172.21.15.191:3300/0 conn(0x7f634c15c8f0 msgr2=0x7f634c06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:31.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 --2- 172.21.15.172:0/832856678 >> v2:172.21.15.191:3300/0 conn(0x7f634c15c8f0 0x7f634c06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 -- 172.21.15.172:0/832856678 >> v1:172.21.15.191:6789/0 conn(0x7f634c0b27d0 legacy=0x7f634c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f635239b700 1 -- 172.21.15.172:0/832856678 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0ce070 con 0x7f634c0cd760 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.909+0000 7f6351b9a700 1 --2- 172.21.15.172:0/832856678 >> v2:172.21.15.191:3300/0 conn(0x7f634c15c8f0 0x7f634c06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f635239b700 1 --2- 172.21.15.172:0/832856678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0cdb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f634c0ce420 tx=0x7f6348009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d36a715694cac55 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f6351399700 1 -- 172.21.15.172:0/832856678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348004230 con 0x7f634c0cd760 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f6351399700 1 -- 172.21.15.172:0/832856678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6348004390 con 0x7f634c0cd760 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f6351399700 1 -- 172.21.15.172:0/832856678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63480036a0 con 0x7f634c0cd760 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f63545ff700 1 -- 172.21.15.172:0/832856678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 msgr2=0x7f634c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f63545ff700 1 --2- 172.21.15.172:0/832856678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0cdb30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f634c0ce420 tx=0x7f6348009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f63545ff700 1 -- 172.21.15.172:0/832856678 shutdown_connections 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f63545ff700 1 --2- 172.21.15.172:0/832856678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0cdb30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f63545ff700 1 --2- 172.21.15.172:0/832856678 >> v2:172.21.15.191:3300/0 conn(0x7f634c15c8f0 0x7f634c06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.910+0000 7f63545ff700 1 -- 172.21.15.172:0/832856678 >> 172.21.15.172:0/832856678 conn(0x7f634c06dd60 msgr2=0x7f634c06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.911+0000 7f63545ff700 1 -- 172.21.15.172:0/832856678 shutdown_connections 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.911+0000 7f63545ff700 1 -- 172.21.15.172:0/832856678 wait complete. 2023-03-27T10:10:31.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.912+0000 7f63545ff700 1 Processor -- start 2023-03-27T10:10:31.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.912+0000 7f63545ff700 1 -- start start 2023-03-27T10:10:31.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f63545ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0b27d0 0x7f634c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f63545ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f63545ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c15c8f0 0x7f634c15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f63545ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c153fa0 con 0x7f634c0cd760 2023-03-27T10:10:31.918 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f63545ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c151ba0 con 0x7f634c0b27d0 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f63545ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c15dc50 con 0x7f634c15c8f0 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.913+0000 7f6351b9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48160/0 (socket says 172.21.15.172:48160) 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 -- 172.21.15.172:0/4174709366 learned_addr learned my addr 172.21.15.172:0/4174709366 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f635239b700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0b27d0 0x7f634c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6352b9c700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c15c8f0 0x7f634c15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 -- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c15c8f0 msgr2=0x7f634c15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c15c8f0 0x7f634c15f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 -- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0b27d0 msgr2=0x7f634c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0b27d0 0x7f634c153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 -- 172.21.15.172:0/4174709366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348009550 con 0x7f634c0cd760 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6351b9a700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f634c0cd760 0x7f634c0c9e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c7f0 tx=0x7f633c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6342ffd700 1 -- 172.21.15.172:0/4174709366 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011800 con 0x7f634c0cd760 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6342ffd700 1 -- 172.21.15.172:0/4174709366 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c011960 con 0x7f634c0cd760 2023-03-27T10:10:31.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f6342ffd700 1 -- 172.21.15.172:0/4174709366 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011cf0 con 0x7f634c0cd760 2023-03-27T10:10:31.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.914+0000 7f63545ff700 1 -- 172.21.15.172:0/4174709366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c0d0a90 con 0x7f634c0cd760 2023-03-27T10:10:31.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.915+0000 7f63545ff700 1 -- 172.21.15.172:0/4174709366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0d07b0 con 0x7f634c0cd760 2023-03-27T10:10:31.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.916+0000 7f63545ff700 1 -- 172.21.15.172:0/4174709366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c06b350 con 0x7f634c0cd760 2023-03-27T10:10:31.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.916+0000 7f6342ffd700 1 -- 172.21.15.172:0/4174709366 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f633c021070 con 0x7f634c0cd760 2023-03-27T10:10:31.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.917+0000 7f6342ffd700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6330066e30 0x7f63300692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:31.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.917+0000 7f6342ffd700 1 -- 172.21.15.172:0/4174709366 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f633c0841e0 con 0x7f634c0cd760 2023-03-27T10:10:31.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.918+0000 7f635239b700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6330066e30 0x7f63300692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:31.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.918+0000 7f635239b700 1 --2- 172.21.15.172:0/4174709366 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6330066e30 0x7f63300692e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6348009130 tx=0x7f6348008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:31.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:31.921+0000 7f6342ffd700 1 -- 172.21.15.172:0/4174709366 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f633c051360 con 0x7f634c0cd760 2023-03-27T10:10:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:32.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:32.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blacklist ls' 2023-03-27T10:10:32.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.531+0000 7f77cabff700 1 Processor -- start 2023-03-27T10:10:32.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.531+0000 7f77cabff700 1 -- start start 2023-03-27T10:10:32.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.532+0000 7f77cabff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c406b9c0 0x7f77c40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:32.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77cabff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77c415d670 0x7f77c40cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:32.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77cabff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c4157000 con 0x7f77c4156c30 2023-03-27T10:10:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77cabff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40cdd30 con 0x7f77c415d670 2023-03-27T10:10:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77cabff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40ce010 con 0x7f77c406b9c0 2023-03-27T10:10:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77c415d670 0x7f77c40cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77c415d670 0x7f77c40cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48174/0 (socket says 172.21.15.172:48174) 2023-03-27T10:10:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 -- 172.21.15.172:0/2839409429 learned_addr learned my addr 172.21.15.172:0/2839409429 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c3fff700 1 --2- 172.21.15.172:0/2839409429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c406b9c0 0x7f77c40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:32.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 -- 172.21.15.172:0/2839409429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c406b9c0 msgr2=0x7f77c40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:32.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 --2- 172.21.15.172:0/2839409429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c406b9c0 0x7f77c40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:32.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 -- 172.21.15.172:0/2839409429 >> v1:172.21.15.191:6789/0 conn(0x7f77c4156c30 legacy=0x7f77c406b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:32.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.533+0000 7f77c919c700 1 -- 172.21.15.172:0/2839409429 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40ce2f0 con 0x7f77c415d670 2023-03-27T10:10:32.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77c919c700 1 --2- 172.21.15.172:0/2839409429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c415d670 0x7f77c40cb9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009e50 tx=0x7f77bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21972c6c116ec0f9 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:32.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77c37fe700 1 -- 172.21.15.172:0/2839409429 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00e070 con 0x7f77c415d670 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77c37fe700 1 -- 172.21.15.172:0/2839409429 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc00b9c0 con 0x7f77c415d670 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77c37fe700 1 -- 172.21.15.172:0/2839409429 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00bd70 con 0x7f77c415d670 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 -- 172.21.15.172:0/2839409429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c415d670 msgr2=0x7f77c40cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 --2- 172.21.15.172:0/2839409429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c415d670 0x7f77c40cb9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009e50 tx=0x7f77bc00b330 comp rx=0 tx=0).stop 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 -- 172.21.15.172:0/2839409429 shutdown_connections 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 --2- 172.21.15.172:0/2839409429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c415d670 0x7f77c40cb9c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 --2- 172.21.15.172:0/2839409429 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c406b9c0 0x7f77c40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:32.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 -- 172.21.15.172:0/2839409429 >> 172.21.15.172:0/2839409429 conn(0x7f77c4072230 msgr2=0x7f77c406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:32.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.534+0000 7f77cabff700 1 -- 172.21.15.172:0/2839409429 shutdown_connections 2023-03-27T10:10:32.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.535+0000 7f77cabff700 1 -- 172.21.15.172:0/2839409429 wait complete. 2023-03-27T10:10:32.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.536+0000 7f77cabff700 1 Processor -- start 2023-03-27T10:10:32.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.536+0000 7f77cabff700 1 -- start start 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.537+0000 7f77cabff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c406b9c0 0x7f77c4155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.537+0000 7f77cabff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77c4156c30 0x7f77c40b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.537+0000 7f77cabff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c415d670 0x7f77c415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.537+0000 7f77cabff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c41f28f0 con 0x7f77c406b9c0 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.537+0000 7f77cabff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4156300 con 0x7f77c4156c30 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.537+0000 7f77cabff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40b6760 con 0x7f77c415d670 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c406b9c0 0x7f77c4155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:32.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c406b9c0 0x7f77c4155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48176/0 (socket says 172.21.15.172:48176) 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 -- 172.21.15.172:0/282397927 learned_addr learned my addr 172.21.15.172:0/282397927 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c3fff700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77c4156c30 0x7f77c40b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c919c700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c415d670 0x7f77c415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 -- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c415d670 msgr2=0x7f77c415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77c415d670 0x7f77c415fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 -- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77c4156c30 msgr2=0x7f77c40b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77c4156c30 0x7f77c40b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 -- 172.21.15.172:0/282397927 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc009b30 con 0x7f77c406b9c0 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c3fff700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77c4156c30 0x7f77c40b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c899b700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c406b9c0 0x7f77c4155dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c4d0 tx=0x7f77b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c17fa700 1 -- 172.21.15.172:0/282397927 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80052d0 con 0x7f77c406b9c0 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c17fa700 1 -- 172.21.15.172:0/282397927 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8005430 con 0x7f77c406b9c0 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77c17fa700 1 -- 172.21.15.172:0/282397927 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80038f0 con 0x7f77c406b9c0 2023-03-27T10:10:32.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.538+0000 7f77cabff700 1 -- 172.21.15.172:0/282397927 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c40cb4a0 con 0x7f77c406b9c0 2023-03-27T10:10:32.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.539+0000 7f77cabff700 1 -- 172.21.15.172:0/282397927 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40ce5d0 con 0x7f77c406b9c0 2023-03-27T10:10:32.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.539+0000 7f77cabff700 1 -- 172.21.15.172:0/282397927 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c415da90 con 0x7f77c406b9c0 2023-03-27T10:10:32.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.540+0000 7f77c17fa700 1 -- 172.21.15.172:0/282397927 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f77b8019030 con 0x7f77c406b9c0 2023-03-27T10:10:32.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.541+0000 7f77c17fa700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f77a8066e30 0x7f77a80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:32.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.541+0000 7f77c17fa700 1 -- 172.21.15.172:0/282397927 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f77b80836c0 con 0x7f77c406b9c0 2023-03-27T10:10:32.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.542+0000 7f77c3fff700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f77a8066e30 0x7f77a80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:32.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.543+0000 7f77c3fff700 1 --2- 172.21.15.172:0/282397927 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f77a8066e30 0x7f77a80692e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f77c40b5c70 tx=0x7f77b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:32.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:32.545+0000 7f77c17fa700 1 -- 172.21.15.172:0/282397927 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f77b8050860 con 0x7f77c406b9c0 2023-03-27T10:10:32.963 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:32.963 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:32.963 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:32.963 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:32.963 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:32.970 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:32.972 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-03-27T10:10:32.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:32.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-03-27T10:10:33.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:10:33.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:33.062 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-27T10:10:33.113 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:33.113 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:33.160 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:33.161 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:33.243 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:33.244 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:33.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:33.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.512+0000 7f7631bff700 1 Processor -- start 2023-03-27T10:10:33.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.513+0000 7f7631bff700 1 -- start start 2023-03-27T10:10:33.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f7631bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0d0b90 0x7f762c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f7631bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f762c15ca20 0x7f762c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f7631bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c0d14a0 con 0x7f762c0cd610 2023-03-27T10:10:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f7631bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c0cebc0 con 0x7f762c15ca20 2023-03-27T10:10:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f7631bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ceea0 con 0x7f762c0d0b90 2023-03-27T10:10:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f762affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f762c15ca20 0x7f762c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f762affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f762c15ca20 0x7f762c0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48180/0 (socket says 172.21.15.172:48180) 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f762affd700 1 -- 172.21.15.172:0/914234738 learned_addr learned my addr 172.21.15.172:0/914234738 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f762bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f762c0cd610 0x7f762c0cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50102/0 (socket says 172.21.15.172:50102) 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.514+0000 7f762b7fe700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0d0b90 0x7f762c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762affd700 1 -- 172.21.15.172:0/914234738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0d0b90 msgr2=0x7f762c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762affd700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0d0b90 0x7f762c0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762affd700 1 -- 172.21.15.172:0/914234738 >> v1:172.21.15.172:6789/0 conn(0x7f762c0cd610 legacy=0x7f762c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762affd700 1 -- 172.21.15.172:0/914234738 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0cf180 con 0x7f762c15ca20 2023-03-27T10:10:33.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762b7fe700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0d0b90 0x7f762c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:33.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762a7fc700 1 -- 172.21.15.172:0/914234738 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146276024 0 0) 0x7f762c0d14a0 con 0x7f762c0cd610 2023-03-27T10:10:33.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762affd700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c0d0f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76200098f0 tx=0x7f7620009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9716fd3e72375 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:33.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762a7fc700 1 -- 172.21.15.172:0/914234738 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000b8a0 con 0x7f762c15ca20 2023-03-27T10:10:33.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762a7fc700 1 -- 172.21.15.172:0/914234738 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762000ba00 con 0x7f762c15ca20 2023-03-27T10:10:33.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.515+0000 7f762a7fc700 1 -- 172.21.15.172:0/914234738 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762000bd90 con 0x7f762c15ca20 2023-03-27T10:10:33.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 -- 172.21.15.172:0/914234738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 msgr2=0x7f762c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c0d0f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f76200098f0 tx=0x7f7620009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:33.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 -- 172.21.15.172:0/914234738 shutdown_connections 2023-03-27T10:10:33.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0d0b90 0x7f762c0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 --2- 172.21.15.172:0/914234738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c0d0f60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 -- 172.21.15.172:0/914234738 >> 172.21.15.172:0/914234738 conn(0x7f762c0721f0 msgr2=0x7f762c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:33.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 -- 172.21.15.172:0/914234738 shutdown_connections 2023-03-27T10:10:33.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.516+0000 7f7631bff700 1 -- 172.21.15.172:0/914234738 wait complete. 2023-03-27T10:10:33.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.518+0000 7f7631bff700 1 Processor -- start 2023-03-27T10:10:33.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.518+0000 7f7631bff700 1 -- start start 2023-03-27T10:10:33.523 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.519+0000 7f7631bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0cd610 0x7f762c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.523 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.519+0000 7f7631bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762c0d0b90 0x7f762c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.519+0000 7f7631bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f7631bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c157740 con 0x7f762c15ca20 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f7631bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0cb690 con 0x7f762c0d0b90 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f7631bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ccec0 con 0x7f762c0cd610 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762b7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0cd610 0x7f762c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.524 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c15b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48190/0 (socket says 172.21.15.172:48190) 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 -- 172.21.15.172:0/407822781 learned_addr learned my addr 172.21.15.172:0/407822781 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762affd700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762c0d0b90 0x7f762c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 -- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0cd610 msgr2=0x7f762c157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0cd610 0x7f762c157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 -- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762c0d0b90 msgr2=0x7f762c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762c0d0b90 0x7f762c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.525 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 -- 172.21.15.172:0/407822781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620009550 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.520+0000 7f762bfff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c15b3f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f762400cba0 tx=0x7f762400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.521+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400aaa0 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.521+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762400ac20 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.521+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0afc50 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.521+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240070d0 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.521+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0cf460 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.522+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c0d2d30 con 0x7f762c15ca20 2023-03-27T10:10:33.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.523+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7624010070 con 0x7f762c15ca20 2023-03-27T10:10:33.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.523+0000 7f7613fff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7618066e60 0x7f7618069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.524+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7624083c80 con 0x7f762c15ca20 2023-03-27T10:10:33.527 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.524+0000 7f762b7fe700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7618066e60 0x7f7618069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.525+0000 7f762b7fe700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7618066e60 0x7f7618069310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f761c0099c0 tx=0x7f761c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:33.528 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.527+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f7624050df0 con 0x7f762c15ca20 2023-03-27T10:10:33.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.721+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f762c074290 con 0x7f762c15ca20 2023-03-27T10:10:33.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.723+0000 7f7613fff700 1 -- 172.21.15.172:0/407822781 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f7624018020 con 0x7f762c15ca20 2023-03-27T10:10:33.722 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:33.723 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:32.667663+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:33.724 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7618066e60 msgr2=0x7f7618069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7618066e60 0x7f7618069310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f761c0099c0 tx=0x7f761c008040 comp rx=0 tx=0).stop 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 msgr2=0x7f762c15b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c15b3f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f762400cba0 tx=0x7f762400ceb0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 shutdown_connections 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f762c15ca20 0x7f762c15b3f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f762c0cd610 0x7f762c157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7618066e60 0x7f7618069310 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 --2- 172.21.15.172:0/407822781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f762c0d0b90 0x7f762c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 >> 172.21.15.172:0/407822781 conn(0x7f762c0721f0 msgr2=0x7f762c06ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:33.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 shutdown_connections 2023-03-27T10:10:33.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.725+0000 7f7631bff700 1 -- 172.21.15.172:0/407822781 wait complete. 2023-03-27T10:10:33.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:33.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:33.929 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.929+0000 7fd8effff700 1 Processor -- start 2023-03-27T10:10:33.929 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.930+0000 7fd8effff700 1 -- start start 2023-03-27T10:10:33.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8effff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd8e8072400 0x7fd8e8160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8effff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd8e806ab40 0x7fd8e815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8effff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e81463e0 con 0x7fd8e806da00 2023-03-27T10:10:33.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8effff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e81611a0 con 0x7fd8e806ab40 2023-03-27T10:10:33.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8effff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e8160be0 con 0x7fd8e8072400 2023-03-27T10:10:33.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd8e806ab40 0x7fd8e815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd8e806ab40 0x7fd8e815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48200/0 (socket says 172.21.15.172:48200) 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 -- 172.21.15.172:0/3193995037 learned_addr learned my addr 172.21.15.172:0/3193995037 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ed59a700 1 --2- 172.21.15.172:0/3193995037 >> v2:172.21.15.191:3300/0 conn(0x7fd8e8072400 0x7fd8e8160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 -- 172.21.15.172:0/3193995037 >> v2:172.21.15.191:3300/0 conn(0x7fd8e8072400 msgr2=0x7fd8e8160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 --2- 172.21.15.172:0/3193995037 >> v2:172.21.15.191:3300/0 conn(0x7fd8e8072400 0x7fd8e8160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 -- 172.21.15.172:0/3193995037 >> v1:172.21.15.191:6789/0 conn(0x7fd8e806da00 legacy=0x7fd8e806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.932+0000 7fd8ee59c700 1 -- 172.21.15.172:0/3193995037 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8160ec0 con 0x7fd8e806ab40 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8ee59c700 1 --2- 172.21.15.172:0/3193995037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e806ab40 0x7fd8e815e050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80b5350 tx=0x7fd8e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9c4075782a27e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8ecd99700 1 -- 172.21.15.172:0/3193995037 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000e070 con 0x7fd8e806ab40 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8ecd99700 1 -- 172.21.15.172:0/3193995037 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e000b910 con 0x7fd8e806ab40 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8ecd99700 1 -- 172.21.15.172:0/3193995037 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000bcc0 con 0x7fd8e806ab40 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 -- 172.21.15.172:0/3193995037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e806ab40 msgr2=0x7fd8e815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 --2- 172.21.15.172:0/3193995037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e806ab40 0x7fd8e815e050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80b5350 tx=0x7fd8e000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:33.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 -- 172.21.15.172:0/3193995037 shutdown_connections 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 --2- 172.21.15.172:0/3193995037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e806ab40 0x7fd8e815e050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 --2- 172.21.15.172:0/3193995037 >> v2:172.21.15.191:3300/0 conn(0x7fd8e8072400 0x7fd8e8160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 -- 172.21.15.172:0/3193995037 >> 172.21.15.172:0/3193995037 conn(0x7fd8e80b1010 msgr2=0x7fd8e80b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 -- 172.21.15.172:0/3193995037 shutdown_connections 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.933+0000 7fd8effff700 1 -- 172.21.15.172:0/3193995037 wait complete. 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.935+0000 7fd8effff700 1 Processor -- start 2023-03-27T10:10:33.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.935+0000 7fd8effff700 1 -- start start 2023-03-27T10:10:33.938 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8effff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8e806ab40 0x7fd8e80ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.938 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8effff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8e806da00 0x7fd8e81f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.938 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8effff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 0x7fd8e80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.938 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8effff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80cf350 con 0x7fd8e8072400 2023-03-27T10:10:33.938 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8effff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e8145410 con 0x7fd8e806ab40 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8effff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e81f2ea0 con 0x7fd8e806da00 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.936+0000 7fd8ee59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 0x7fd8e80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 0x7fd8e80cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48202/0 (socket says 172.21.15.172:48202) 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 -- 172.21.15.172:0/1476700472 learned_addr learned my addr 172.21.15.172:0/1476700472 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8edd9b700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8e806ab40 0x7fd8e80ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ed59a700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8e806da00 0x7fd8e81f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 -- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8e806da00 msgr2=0x7fd8e81f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8e806da00 0x7fd8e81f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 -- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8e806ab40 msgr2=0x7fd8e80ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8e806ab40 0x7fd8e80ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 -- 172.21.15.172:0/1476700472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0009b30 con 0x7fd8e8072400 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8ee59c700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 0x7fd8e80cc080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000b370 tx=0x7fd8e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0004880 con 0x7fd8e8072400 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e00099b0 con 0x7fd8e8072400 2023-03-27T10:10:33.940 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e806a620 con 0x7fd8e8072400 2023-03-27T10:10:33.941 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.937+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e001c680 con 0x7fd8e8072400 2023-03-27T10:10:33.941 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.938+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e806a340 con 0x7fd8e8072400 2023-03-27T10:10:33.941 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.939+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e81607b0 con 0x7fd8e8072400 2023-03-27T10:10:33.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.940+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd8e0022030 con 0x7fd8e8072400 2023-03-27T10:10:33.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.940+0000 7fd8de7fc700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd8cc066e30 0x7fd8cc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:33.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.940+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd8e0085a90 con 0x7fd8e8072400 2023-03-27T10:10:33.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.941+0000 7fd8edd9b700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd8cc066e30 0x7fd8cc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:33.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.942+0000 7fd8edd9b700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd8cc066e30 0x7fd8cc0692e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007fd0 tx=0x7fd8e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:33.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:33.944+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd8e0052c90 con 0x7fd8e8072400 2023-03-27T10:10:34.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.131+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8e806eb40 con 0x7fd8e8072400 2023-03-27T10:10:34.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.132+0000 7fd8de7fc700 1 -- 172.21.15.172:0/1476700472 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8e00562b0 con 0x7fd8e8072400 2023-03-27T10:10:34.132 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:34.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd8cc066e30 msgr2=0x7fd8cc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd8cc066e30 0x7fd8cc0692e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007fd0 tx=0x7fd8e4009040 comp rx=0 tx=0).stop 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 msgr2=0x7fd8e80cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 0x7fd8e80cc080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000b370 tx=0x7fd8e0004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 shutdown_connections 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e8072400 0x7fd8e80cc080 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd8cc066e30 0x7fd8cc0692e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8e806ab40 0x7fd8e80ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 --2- 172.21.15.172:0/1476700472 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd8e806da00 0x7fd8e81f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 >> 172.21.15.172:0/1476700472 conn(0x7fd8e80b1010 msgr2=0x7fd8e806ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:34.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 shutdown_connections 2023-03-27T10:10:34.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.135+0000 7fd8effff700 1 -- 172.21.15.172:0/1476700472 wait complete. 2023-03-27T10:10:34.151 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:34.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.339+0000 7fc2471ff700 1 Processor -- start 2023-03-27T10:10:34.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.339+0000 7fc2471ff700 1 -- start start 2023-03-27T10:10:34.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc2471ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc24015c620 0x7fc2400ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc2471ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2400cb400 0x7fc2400ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc2471ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2400cc780 con 0x7fc24006b2b0 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc2471ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24015c9f0 con 0x7fc24015c620 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc2471ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400cbb70 con 0x7fc2400cb400 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc244f9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc24015c620 0x7fc2400ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc244f9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc24015c620 0x7fc2400ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48208/0 (socket says 172.21.15.172:48208) 2023-03-27T10:10:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc244f9b700 1 -- 172.21.15.172:0/1452374465 learned_addr learned my addr 172.21.15.172:0/1452374465 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:34.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.340+0000 7fc23ffff700 1 --2- 172.21.15.172:0/1452374465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2400cb400 0x7fc2400ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc244f9b700 1 -- 172.21.15.172:0/1452374465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2400cb400 msgr2=0x7fc2400ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc244f9b700 1 --2- 172.21.15.172:0/1452374465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2400cb400 0x7fc2400ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc244f9b700 1 -- 172.21.15.172:0/1452374465 >> v1:172.21.15.191:6789/0 conn(0x7fc24006b2b0 legacy=0x7fc2400ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc244f9b700 1 -- 172.21.15.172:0/1452374465 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400cbe50 con 0x7fc24015c620 2023-03-27T10:10:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc244f9b700 1 --2- 172.21.15.172:0/1452374465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24015c620 0x7fc2400ce270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc234006fd0 tx=0x7fc234009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7931a3516f21fef server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc23f7fe700 1 -- 172.21.15.172:0/1452374465 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234005e30 con 0x7fc24015c620 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc23f7fe700 1 -- 172.21.15.172:0/1452374465 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234004030 con 0x7fc24015c620 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.341+0000 7fc23f7fe700 1 -- 172.21.15.172:0/1452374465 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340043e0 con 0x7fc24015c620 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 -- 172.21.15.172:0/1452374465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24015c620 msgr2=0x7fc2400ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 --2- 172.21.15.172:0/1452374465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24015c620 0x7fc2400ce270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc234006fd0 tx=0x7fc234009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 -- 172.21.15.172:0/1452374465 shutdown_connections 2023-03-27T10:10:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 --2- 172.21.15.172:0/1452374465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24015c620 0x7fc2400ce270 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 --2- 172.21.15.172:0/1452374465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2400cb400 0x7fc2400ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 -- 172.21.15.172:0/1452374465 >> 172.21.15.172:0/1452374465 conn(0x7fc240072230 msgr2=0x7fc24006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 -- 172.21.15.172:0/1452374465 shutdown_connections 2023-03-27T10:10:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.342+0000 7fc2471ff700 1 -- 172.21.15.172:0/1452374465 wait complete. 2023-03-27T10:10:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.344+0000 7fc2471ff700 1 Processor -- start 2023-03-27T10:10:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.344+0000 7fc2471ff700 1 -- start start 2023-03-27T10:10:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc2471ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 0x7fc2400ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc2471ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2400cb400 0x7fc2400c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc2471ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc24015c620 0x7fc2400c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc2471ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400b0920 con 0x7fc24006b2b0 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc2471ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400d10d0 con 0x7fc2400cb400 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc2471ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400b0b30 con 0x7fc24015c620 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 0x7fc2400ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 0x7fc2400ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48224/0 (socket says 172.21.15.172:48224) 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 -- 172.21.15.172:0/2282674974 learned_addr learned my addr 172.21.15.172:0/2282674974 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc23ffff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2400cb400 0x7fc2400c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc24579c700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc24015c620 0x7fc2400c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 -- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc24015c620 msgr2=0x7fc2400c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc24015c620 0x7fc2400c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 -- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2400cb400 msgr2=0x7fc2400c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.345+0000 7fc244f9b700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2400cb400 0x7fc2400c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc244f9b700 1 -- 172.21.15.172:0/2282674974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009500 con 0x7fc24006b2b0 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc244f9b700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 0x7fc2400ca540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc234000c00 tx=0x7fc234004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23401c420 con 0x7fc24006b2b0 2023-03-27T10:10:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23401c5a0 con 0x7fc24006b2b0 2023-03-27T10:10:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2400cc410 con 0x7fc24006b2b0 2023-03-27T10:10:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23401c950 con 0x7fc24006b2b0 2023-03-27T10:10:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.346+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2400cc130 con 0x7fc24006b2b0 2023-03-27T10:10:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.347+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2400cb870 con 0x7fc24006b2b0 2023-03-27T10:10:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.348+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc23402c070 con 0x7fc24006b2b0 2023-03-27T10:10:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.349+0000 7fc23d7fa700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc224066e30 0x7fc2240692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.349+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc2340852c0 con 0x7fc24006b2b0 2023-03-27T10:10:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.349+0000 7fc23ffff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc224066e30 0x7fc2240692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.350+0000 7fc23ffff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc224066e30 0x7fc2240692e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc24015bac0 tx=0x7fc22c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:34.351 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.353+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc2340524c0 con 0x7fc24006b2b0 2023-03-27T10:10:34.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.540+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc240074300 con 0x7fc24006b2b0 2023-03-27T10:10:34.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.540+0000 7fc23d7fa700 1 -- 172.21.15.172:0/2282674974 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc234055ae0 con 0x7fc24006b2b0 2023-03-27T10:10:34.539 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:34.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc224066e30 msgr2=0x7fc2240692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc224066e30 0x7fc2240692e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc24015bac0 tx=0x7fc22c009210 comp rx=0 tx=0).stop 2023-03-27T10:10:34.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 msgr2=0x7fc2400ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 0x7fc2400ca540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc234000c00 tx=0x7fc234004750 comp rx=0 tx=0).stop 2023-03-27T10:10:34.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 shutdown_connections 2023-03-27T10:10:34.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc24015c620 0x7fc2400c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc24006b2b0 0x7fc2400ca540 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc224066e30 0x7fc2240692e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 --2- 172.21.15.172:0/2282674974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2400cb400 0x7fc2400c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 >> 172.21.15.172:0/2282674974 conn(0x7fc240072230 msgr2=0x7fc2400cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:34.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 shutdown_connections 2023-03-27T10:10:34.545 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.543+0000 7fc2471ff700 1 -- 172.21.15.172:0/2282674974 wait complete. 2023-03-27T10:10:34.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:34.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.748+0000 7f4a77bff700 1 Processor -- start 2023-03-27T10:10:34.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.748+0000 7f4a77bff700 1 -- start start 2023-03-27T10:10:34.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a77bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a700d11d0 0x7f4a701604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a77bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4a700d3a30 0x7f4a701609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a77bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700d29d0 con 0x7f4a7015a240 2023-03-27T10:10:34.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a77bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a70161200 con 0x7f4a700d11d0 2023-03-27T10:10:34.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a77bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7015a610 con 0x7f4a700d3a30 2023-03-27T10:10:34.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a7519a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a700d11d0 0x7f4a701604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a7519a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a700d11d0 0x7f4a701604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48236/0 (socket says 172.21.15.172:48236) 2023-03-27T10:10:34.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a7519a700 1 -- 172.21.15.172:0/890155367 learned_addr learned my addr 172.21.15.172:0/890155367 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:34.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.749+0000 7f4a7619c700 1 --2- 172.21.15.172:0/890155367 >> v2:172.21.15.191:3300/0 conn(0x7f4a700d3a30 0x7f4a701609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a7519a700 1 -- 172.21.15.172:0/890155367 >> v2:172.21.15.191:3300/0 conn(0x7f4a700d3a30 msgr2=0x7f4a701609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:34.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a7519a700 1 --2- 172.21.15.172:0/890155367 >> v2:172.21.15.191:3300/0 conn(0x7f4a700d3a30 0x7f4a701609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a7519a700 1 -- 172.21.15.172:0/890155367 >> v1:172.21.15.172:6789/0 conn(0x7f4a7015a240 legacy=0x7f4a700d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a7519a700 1 -- 172.21.15.172:0/890155367 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70160f30 con 0x7f4a700d11d0 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a7519a700 1 --2- 172.21.15.172:0/890155367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a701604b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a700d15a0 tx=0x7f4a60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4872995415979f31 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a74999700 1 -- 172.21.15.172:0/890155367 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000b870 con 0x7f4a700d11d0 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a74999700 1 -- 172.21.15.172:0/890155367 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6000b9d0 con 0x7f4a700d11d0 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.750+0000 7f4a74999700 1 -- 172.21.15.172:0/890155367 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000bd60 con 0x7f4a700d11d0 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 -- 172.21.15.172:0/890155367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 msgr2=0x7f4a701604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 --2- 172.21.15.172:0/890155367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a701604b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4a700d15a0 tx=0x7f4a60009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 -- 172.21.15.172:0/890155367 shutdown_connections 2023-03-27T10:10:34.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 --2- 172.21.15.172:0/890155367 >> v2:172.21.15.191:3300/0 conn(0x7f4a700d3a30 0x7f4a701609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 --2- 172.21.15.172:0/890155367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a701604b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 -- 172.21.15.172:0/890155367 >> 172.21.15.172:0/890155367 conn(0x7f4a700721f0 msgr2=0x7f4a7009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:34.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 -- 172.21.15.172:0/890155367 shutdown_connections 2023-03-27T10:10:34.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.751+0000 7f4a77bff700 1 -- 172.21.15.172:0/890155367 wait complete. 2023-03-27T10:10:34.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.752+0000 7f4a77bff700 1 Processor -- start 2023-03-27T10:10:34.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.753+0000 7f4a77bff700 1 -- start start 2023-03-27T10:10:34.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.753+0000 7f4a77bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a700b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.753+0000 7f4a77bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a700d3a30 0x7f4a700c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.753+0000 7f4a77bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7015a240 0x7f4a70158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.753+0000 7f4a77bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700b21f0 con 0x7f4a700d11d0 2023-03-27T10:10:34.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.753+0000 7f4a77bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700b2490 con 0x7f4a7015a240 2023-03-27T10:10:34.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a77bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700b2770 con 0x7f4a700d3a30 2023-03-27T10:10:34.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a700b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a700b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48248/0 (socket says 172.21.15.172:48248) 2023-03-27T10:10:34.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 -- 172.21.15.172:0/183019617 learned_addr learned my addr 172.21.15.172:0/183019617 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7619c700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7015a240 0x7f4a70158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7519a700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a700d3a30 0x7f4a700c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 -- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a700d3a30 msgr2=0x7f4a700c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a700d3a30 0x7f4a700c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 -- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7015a240 msgr2=0x7f4a70158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7015a240 0x7f4a70158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 -- 172.21.15.172:0/183019617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009550 con 0x7f4a700d11d0 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7619c700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7015a240 0x7f4a70158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.754+0000 7f4a7599b700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a700b6730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c450 tx=0x7f4a6c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.755+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0052d0 con 0x7f4a700d11d0 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.755+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c005430 con 0x7f4a700d11d0 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.755+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a700d2f50 con 0x7f4a700d11d0 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.755+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0038c0 con 0x7f4a700d11d0 2023-03-27T10:10:34.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.755+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a700d2c70 con 0x7f4a700d11d0 2023-03-27T10:10:34.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.756+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a700d3230 con 0x7f4a700d11d0 2023-03-27T10:10:34.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.757+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f4a6c019030 con 0x7f4a700d11d0 2023-03-27T10:10:34.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.757+0000 7f4a667fc700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a54066e30 0x7f4a540692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:34.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.757+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4a6c083540 con 0x7f4a700d11d0 2023-03-27T10:10:34.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.758+0000 7f4a7519a700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a54066e30 0x7f4a540692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:34.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.759+0000 7f4a7519a700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a54066e30 0x7f4a540692e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a700d15a0 tx=0x7f4a60008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:34.760 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.762+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f4a6c050740 con 0x7f4a700d11d0 2023-03-27T10:10:34.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.946+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a7015dad0 con 0x7f4a700d11d0 2023-03-27T10:10:34.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.947+0000 7f4a667fc700 1 -- 172.21.15.172:0/183019617 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a6c053d60 con 0x7f4a700d11d0 2023-03-27T10:10:34.946 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:34.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a54066e30 msgr2=0x7f4a540692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a54066e30 0x7f4a540692e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a700d15a0 tx=0x7f4a60008030 comp rx=0 tx=0).stop 2023-03-27T10:10:34.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 msgr2=0x7f4a700b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:34.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a700b6730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c450 tx=0x7f4a6c00c810 comp rx=0 tx=0).stop 2023-03-27T10:10:34.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 shutdown_connections 2023-03-27T10:10:34.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a54066e30 0x7f4a540692e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7015a240 0x7f4a70158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a700d11d0 0x7f4a700b6730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 --2- 172.21.15.172:0/183019617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a700d3a30 0x7f4a700c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:34.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 >> 172.21.15.172:0/183019617 conn(0x7f4a700721f0 msgr2=0x7f4a700cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:34.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 shutdown_connections 2023-03-27T10:10:34.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:34.949+0000 7f4a77bff700 1 -- 172.21.15.172:0/183019617 wait complete. 2023-03-27T10:10:34.964 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:35.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.153+0000 7f16d57ff700 1 Processor -- start 2023-03-27T10:10:35.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.153+0000 7f16d57ff700 1 -- start start 2023-03-27T10:10:35.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.154+0000 7f16d57ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f16d00cd5e0 0x7f16d006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.154+0000 7f16d57ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f16d006fa10 0x7f16d00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.154+0000 7f16d57ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00ce8a0 con 0x7f16d0159070 2023-03-27T10:10:35.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.154+0000 7f16d57ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d006c9f0 con 0x7f16d006fa10 2023-03-27T10:10:35.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.154+0000 7f16d57ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00cda80 con 0x7f16d00cd5e0 2023-03-27T10:10:35.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f16d006fa10 0x7f16d00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f16d006fa10 0x7f16d00caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48250/0 (socket says 172.21.15.172:48250) 2023-03-27T10:10:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 -- 172.21.15.172:0/4010552118 learned_addr learned my addr 172.21.15.172:0/4010552118 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16ce7fc700 1 --2- 172.21.15.172:0/4010552118 >> v2:172.21.15.191:3300/0 conn(0x7f16d00cd5e0 0x7f16d006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 -- 172.21.15.172:0/4010552118 >> v2:172.21.15.191:3300/0 conn(0x7f16d00cd5e0 msgr2=0x7f16d006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 --2- 172.21.15.172:0/4010552118 >> v2:172.21.15.191:3300/0 conn(0x7f16d00cd5e0 0x7f16d006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 -- 172.21.15.172:0/4010552118 >> v1:172.21.15.191:6789/0 conn(0x7f16d0159070 legacy=0x7f16d00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 -- 172.21.15.172:0/4010552118 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00c9180 con 0x7f16d006fa10 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.155+0000 7f16cf7fe700 1 --2- 172.21.15.172:0/4010552118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d006fa10 0x7f16d00caf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f16d006dda0 tx=0x7f16c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6629ecd1003c98 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16cdffb700 1 -- 172.21.15.172:0/4010552118 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800e070 con 0x7f16d006fa10 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16cdffb700 1 -- 172.21.15.172:0/4010552118 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800b910 con 0x7f16d006fa10 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16cdffb700 1 -- 172.21.15.172:0/4010552118 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800bcc0 con 0x7f16d006fa10 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 -- 172.21.15.172:0/4010552118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d006fa10 msgr2=0x7f16d00caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 --2- 172.21.15.172:0/4010552118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d006fa10 0x7f16d00caf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f16d006dda0 tx=0x7f16c800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:35.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 -- 172.21.15.172:0/4010552118 shutdown_connections 2023-03-27T10:10:35.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 --2- 172.21.15.172:0/4010552118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d006fa10 0x7f16d00caf80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 --2- 172.21.15.172:0/4010552118 >> v2:172.21.15.191:3300/0 conn(0x7f16d00cd5e0 0x7f16d006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 -- 172.21.15.172:0/4010552118 >> 172.21.15.172:0/4010552118 conn(0x7f16d006a1a0 msgr2=0x7f16d006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:35.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 -- 172.21.15.172:0/4010552118 shutdown_connections 2023-03-27T10:10:35.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.156+0000 7f16d57ff700 1 -- 172.21.15.172:0/4010552118 wait complete. 2023-03-27T10:10:35.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.158+0000 7f16d57ff700 1 Processor -- start 2023-03-27T10:10:35.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.158+0000 7f16d57ff700 1 -- start start 2023-03-27T10:10:35.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16d57ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16d006fa10 0x7f16d014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16d57ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 0x7f16d00c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16d57ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0159070 0x7f16d00c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16d57ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d014e070 con 0x7f16d00cd5e0 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16d57ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d01525a0 con 0x7f16d0159070 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16d57ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00c5ca0 con 0x7f16d006fa10 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16ce7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 0x7f16d00c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16ce7fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 0x7f16d00c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48254/0 (socket says 172.21.15.172:48254) 2023-03-27T10:10:35.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.159+0000 7f16ce7fc700 1 -- 172.21.15.172:0/2602058186 learned_addr learned my addr 172.21.15.172:0/2602058186 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16cf7fe700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0159070 0x7f16d00c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ceffd700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16d006fa10 0x7f16d014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ce7fc700 1 -- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16d006fa10 msgr2=0x7f16d014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ce7fc700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16d006fa10 0x7f16d014db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ce7fc700 1 -- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0159070 msgr2=0x7f16d00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ce7fc700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0159070 0x7f16d00c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ce7fc700 1 -- 172.21.15.172:0/2602058186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8009b30 con 0x7f16d00cd5e0 2023-03-27T10:10:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ceffd700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16d006fa10 0x7f16d014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:35.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16ce7fc700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 0x7f16d00c4610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16c400e9b0 tx=0x7f16c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:35.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4009710 con 0x7f16d00cd5e0 2023-03-27T10:10:35.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400c850 con 0x7f16d00cd5e0 2023-03-27T10:10:35.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400cbc0 con 0x7f16d00cd5e0 2023-03-27T10:10:35.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d00c93d0 con 0x7f16d00cd5e0 2023-03-27T10:10:35.162 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.160+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d00cca40 con 0x7f16d00cd5e0 2023-03-27T10:10:35.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.161+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d00c96b0 con 0x7f16d00cd5e0 2023-03-27T10:10:35.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.162+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f16c4019030 con 0x7f16d00cd5e0 2023-03-27T10:10:35.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.164+0000 7f16b77fe700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16bc066e30 0x7f16bc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.163 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.164+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f16c40842e0 con 0x7f16d00cd5e0 2023-03-27T10:10:35.164 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.164+0000 7f16ceffd700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16bc066e30 0x7f16bc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.164 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.165+0000 7f16ceffd700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16bc066e30 0x7f16bc0692e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16c0000f60 tx=0x7f16c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:35.166 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.168+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f16c40514e0 con 0x7f16d00cd5e0 2023-03-27T10:10:35.355 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.357+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16d0074300 con 0x7f16d00cd5e0 2023-03-27T10:10:35.356 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.357+0000 7f16b77fe700 1 -- 172.21.15.172:0/2602058186 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16c4054b00 con 0x7f16d00cd5e0 2023-03-27T10:10:35.356 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:35.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16bc066e30 msgr2=0x7f16bc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16bc066e30 0x7f16bc0692e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16c0000f60 tx=0x7f16c0009040 comp rx=0 tx=0).stop 2023-03-27T10:10:35.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 msgr2=0x7f16d00c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 0x7f16d00c4610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16c400e9b0 tx=0x7f16c400ed70 comp rx=0 tx=0).stop 2023-03-27T10:10:35.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 shutdown_connections 2023-03-27T10:10:35.358 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f16bc066e30 0x7f16bc0692e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.359 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f16d0159070 0x7f16d00c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.359 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f16d006fa10 0x7f16d014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.359 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 --2- 172.21.15.172:0/2602058186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16d00cd5e0 0x7f16d00c4610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.359 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 >> 172.21.15.172:0/2602058186 conn(0x7f16d006a1a0 msgr2=0x7f16d00ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:35.359 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.359+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 shutdown_connections 2023-03-27T10:10:35.359 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.360+0000 7f16d57ff700 1 -- 172.21.15.172:0/2602058186 wait complete. 2023-03-27T10:10:35.375 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blocklist ls' 2023-03-27T10:10:35.559 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.561+0000 7fe6c47ff700 1 Processor -- start 2023-03-27T10:10:35.559 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.561+0000 7fe6c47ff700 1 -- start start 2023-03-27T10:10:35.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c47ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 0x7fe6bc06f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c47ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe6bc06be30 0x7fe6bc06c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.560 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c47ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6bc0cb3a0 con 0x7fe6bc0cd760 2023-03-27T10:10:35.561 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c47ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc06b9a0 con 0x7fe6bc06be30 2023-03-27T10:10:35.561 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c47ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc070220 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c1d9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 0x7fe6bc06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c2d9c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe6bc06be30 0x7fe6bc06c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c1d9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 0x7fe6bc06f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:57808/0 (socket says 172.21.15.172:57808) 2023-03-27T10:10:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.562+0000 7fe6c1d9a700 1 -- 172.21.15.172:0/733122612 learned_addr learned my addr 172.21.15.172:0/733122612 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.563+0000 7fe6c1d9a700 1 -- 172.21.15.172:0/733122612 >> v2:172.21.15.191:3300/0 conn(0x7fe6bc06be30 msgr2=0x7fe6bc06c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.563+0000 7fe6c1d9a700 1 --2- 172.21.15.172:0/733122612 >> v2:172.21.15.191:3300/0 conn(0x7fe6bc06be30 0x7fe6bc06c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.563+0000 7fe6c1d9a700 1 -- 172.21.15.172:0/733122612 >> v1:172.21.15.191:6789/0 conn(0x7fe6bc0cd760 legacy=0x7fe6bc0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.563+0000 7fe6c1d9a700 1 -- 172.21.15.172:0/733122612 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc0d07b0 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.563+0000 7fe6c1d9a700 1 --2- 172.21.15.172:0/733122612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 0x7fe6bc06f710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0098f0 tx=0x7fe6ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6883507fe8287873 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.563+0000 7fe6c1599700 1 -- 172.21.15.172:0/733122612 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac011830 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c1599700 1 -- 172.21.15.172:0/733122612 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac011990 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.563 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c1599700 1 -- 172.21.15.172:0/733122612 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac011d20 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 -- 172.21.15.172:0/733122612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 msgr2=0x7fe6bc06f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 --2- 172.21.15.172:0/733122612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 0x7fe6bc06f710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0098f0 tx=0x7fe6ac009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:35.564 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 -- 172.21.15.172:0/733122612 shutdown_connections 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 --2- 172.21.15.172:0/733122612 >> v2:172.21.15.191:3300/0 conn(0x7fe6bc06be30 0x7fe6bc06c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 --2- 172.21.15.172:0/733122612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc15c8f0 0x7fe6bc06f710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 -- 172.21.15.172:0/733122612 >> 172.21.15.172:0/733122612 conn(0x7fe6bc06dd60 msgr2=0x7fe6bc06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 -- 172.21.15.172:0/733122612 shutdown_connections 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.564+0000 7fe6c47ff700 1 -- 172.21.15.172:0/733122612 wait complete. 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.566+0000 7fe6c47ff700 1 Processor -- start 2023-03-27T10:10:35.565 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.566+0000 7fe6c47ff700 1 -- start start 2023-03-27T10:10:35.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c47ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6bc06be30 0x7fe6bc0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c47ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc0cd760 0x7fe6bc1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c47ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6bc15c8f0 0x7fe6bc159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.567 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c47ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1f64e0 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c47ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1f6970 con 0x7fe6bc06be30 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c47ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc1f5bb0 con 0x7fe6bc0cd760 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c2d9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6bc15c8f0 0x7fe6bc159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c2d9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6bc15c8f0 0x7fe6bc159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48258/0 (socket says 172.21.15.172:48258) 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c2d9c700 1 -- 172.21.15.172:0/1440312397 learned_addr learned my addr 172.21.15.172:0/1440312397 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c1d9a700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc0cd760 0x7fe6bc1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.567+0000 7fe6c259b700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6bc06be30 0x7fe6bc0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c2d9c700 1 -- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc0cd760 msgr2=0x7fe6bc1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c2d9c700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe6bc0cd760 0x7fe6bc1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c2d9c700 1 -- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6bc06be30 msgr2=0x7fe6bc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c2d9c700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe6bc06be30 0x7fe6bc0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c2d9c700 1 -- 172.21.15.172:0/1440312397 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac009550 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c2d9c700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6bc15c8f0 0x7fe6bc159d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400efc0 tx=0x7fe6b400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:35.569 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6b2ffd700 1 -- 172.21.15.172:0/1440312397 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400cad0 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6b2ffd700 1 -- 172.21.15.172:0/1440312397 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400f040 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c47ff700 1 -- 172.21.15.172:0/1440312397 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc06b350 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6b2ffd700 1 -- 172.21.15.172:0/1440312397 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400ce70 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.570 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.568+0000 7fe6c47ff700 1 -- 172.21.15.172:0/1440312397 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc0d0a90 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.569+0000 7fe6c47ff700 1 -- 172.21.15.172:0/1440312397 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc06b630 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.570+0000 7fe6b2ffd700 1 -- 172.21.15.172:0/1440312397 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe6b4014480 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.571+0000 7fe6b2ffd700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe6a0066e30 0x7fe6a00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.571+0000 7fe6b2ffd700 1 -- 172.21.15.172:0/1440312397 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe6b4084eb0 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.572+0000 7fe6c259b700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe6a0066e30 0x7fe6a00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:35.572 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.572+0000 7fe6c259b700 1 --2- 172.21.15.172:0/1440312397 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe6a0066e30 0x7fe6a00692e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8007fd0 tx=0x7fe6b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:35.573 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:35.575+0000 7fe6b2ffd700 1 -- 172.21.15.172:0/1440312397 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe6b4052050 con 0x7fe6bc15c8f0 2023-03-27T10:10:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:35.999 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:35.999 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:35.999 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:35.999 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:35.999 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:36.000 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:36.000 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:36.000 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:36.000 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:36.000 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:36.000 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:36.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:36.006 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blacklist ls' 2023-03-27T10:10:36.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.189+0000 7fc5181ff700 1 Processor -- start 2023-03-27T10:10:36.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.189+0000 7fc5181ff700 1 -- start start 2023-03-27T10:10:36.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.190+0000 7fc5181ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc51015ca20 0x7fc5100ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:36.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.190+0000 7fc5181ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc5100cd610 0x7fc5100b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:36.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.190+0000 7fc5181ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5100cebc0 con 0x7fc5100d0b90 2023-03-27T10:10:36.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.190+0000 7fc5181ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5100ceea0 con 0x7fc51015ca20 2023-03-27T10:10:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.190+0000 7fc5181ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5100cf180 con 0x7fc5100cd610 2023-03-27T10:10:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc51015ca20 0x7fc5100ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc51015ca20 0x7fc5100ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47010/0 (socket says 172.21.15.172:47010) 2023-03-27T10:10:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 -- 172.21.15.172:0/1920876991 learned_addr learned my addr 172.21.15.172:0/1920876991 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51679c700 1 --2- 172.21.15.172:0/1920876991 >> v2:172.21.15.191:3300/0 conn(0x7fc5100cd610 0x7fc5100b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 -- 172.21.15.172:0/1920876991 >> v2:172.21.15.191:3300/0 conn(0x7fc5100cd610 msgr2=0x7fc5100b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 --2- 172.21.15.172:0/1920876991 >> v2:172.21.15.191:3300/0 conn(0x7fc5100cd610 0x7fc5100b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 -- 172.21.15.172:0/1920876991 >> v1:172.21.15.191:6789/0 conn(0x7fc5100d0b90 legacy=0x7fc5100d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 -- 172.21.15.172:0/1920876991 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5100cf460 con 0x7fc51015ca20 2023-03-27T10:10:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.191+0000 7fc51579a700 1 --2- 172.21.15.172:0/1920876991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc51015ca20 0x7fc5100ce500 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc51008c720 tx=0x7fc500009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee4d7c2e8928c14 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc514f99700 1 -- 172.21.15.172:0/1920876991 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500011830 con 0x7fc51015ca20 2023-03-27T10:10:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc514f99700 1 -- 172.21.15.172:0/1920876991 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500011990 con 0x7fc51015ca20 2023-03-27T10:10:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc514f99700 1 -- 172.21.15.172:0/1920876991 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500011d20 con 0x7fc51015ca20 2023-03-27T10:10:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 -- 172.21.15.172:0/1920876991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc51015ca20 msgr2=0x7fc5100ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 --2- 172.21.15.172:0/1920876991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc51015ca20 0x7fc5100ce500 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc51008c720 tx=0x7fc500009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 -- 172.21.15.172:0/1920876991 shutdown_connections 2023-03-27T10:10:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 --2- 172.21.15.172:0/1920876991 >> v2:172.21.15.191:3300/0 conn(0x7fc5100cd610 0x7fc5100b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 --2- 172.21.15.172:0/1920876991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc51015ca20 0x7fc5100ce500 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 -- 172.21.15.172:0/1920876991 >> 172.21.15.172:0/1920876991 conn(0x7fc5100721f0 msgr2=0x7fc51009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 -- 172.21.15.172:0/1920876991 shutdown_connections 2023-03-27T10:10:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.192+0000 7fc5181ff700 1 -- 172.21.15.172:0/1920876991 wait complete. 2023-03-27T10:10:36.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.194+0000 7fc5181ff700 1 Processor -- start 2023-03-27T10:10:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.194+0000 7fc5181ff700 1 -- start start 2023-03-27T10:10:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc5181ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5100cd610 0x7fc5101f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc5181ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5100d0b90 0x7fc5100caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc5181ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc51015ca20 0x7fc5100b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc5181ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc510158df0 con 0x7fc5100cd610 2023-03-27T10:10:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc5181ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100cb380 con 0x7fc5100d0b90 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc5181ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5100cb660 con 0x7fc51015ca20 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc515f9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5100cd610 0x7fc5101f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc515f9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5100cd610 0x7fc5101f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47014/0 (socket says 172.21.15.172:47014) 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.195+0000 7fc515f9b700 1 -- 172.21.15.172:0/2368903025 learned_addr learned my addr 172.21.15.172:0/2368903025 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc51579a700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5100d0b90 0x7fc5100caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc51679c700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc51015ca20 0x7fc5100b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc515f9b700 1 -- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc51015ca20 msgr2=0x7fc5100b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc515f9b700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc51015ca20 0x7fc5100b7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc515f9b700 1 -- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5100d0b90 msgr2=0x7fc5100caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc515f9b700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5100d0b90 0x7fc5100caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc515f9b700 1 -- 172.21.15.172:0/2368903025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009550 con 0x7fc5100cd610 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc51579a700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc5100d0b90 0x7fc5100caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc515f9b700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5100cd610 0x7fc5101f1610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00c4d0 tx=0x7fc50c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc5067fc700 1 -- 172.21.15.172:0/2368903025 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0052d0 con 0x7fc5100cd610 2023-03-27T10:10:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc5067fc700 1 -- 172.21.15.172:0/2368903025 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c005430 con 0x7fc5100cd610 2023-03-27T10:10:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc5181ff700 1 -- 172.21.15.172:0/2368903025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5100d2d30 con 0x7fc5100cd610 2023-03-27T10:10:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc5067fc700 1 -- 172.21.15.172:0/2368903025 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c0038f0 con 0x7fc5100cd610 2023-03-27T10:10:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.196+0000 7fc5181ff700 1 -- 172.21.15.172:0/2368903025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5100afc50 con 0x7fc5100cd610 2023-03-27T10:10:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.197+0000 7fc5181ff700 1 -- 172.21.15.172:0/2368903025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5100b06b0 con 0x7fc5100cd610 2023-03-27T10:10:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.198+0000 7fc5067fc700 1 -- 172.21.15.172:0/2368903025 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc50c019030 con 0x7fc5100cd610 2023-03-27T10:10:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.199+0000 7fc5067fc700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc4f4066e30 0x7fc4f40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:36.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.199+0000 7fc5067fc700 1 -- 172.21.15.172:0/2368903025 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc50c083720 con 0x7fc5100cd610 2023-03-27T10:10:36.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.200+0000 7fc51579a700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc4f4066e30 0x7fc4f40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:36.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.200+0000 7fc51579a700 1 --2- 172.21.15.172:0/2368903025 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc4f4066e30 0x7fc4f40692e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5100b5040 tx=0x7fc500008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:36.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:36.203+0000 7fc5067fc700 1 -- 172.21.15.172:0/2368903025 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc50c0508c0 con 0x7fc5100cd610 2023-03-27T10:10:36.616 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:36.616 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:36.616 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:36.616 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:36.617 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:36.618 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:36.623 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:36.623 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.1 2023-03-27T10:10:36.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:36.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.1 2023-03-27T10:10:36.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:10:36.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:36.713 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-03-27T10:10:36.770 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:36.770 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:36.812 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:36.813 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:36.893 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:10:36.894 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:36.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.199+0000 7fd99a9ff700 1 Processor -- start 2023-03-27T10:10:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.199+0000 7fd99a9ff700 1 -- start start 2023-03-27T10:10:37.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.200+0000 7fd99a9ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd99415c6f0 0x7fd9940cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.200+0000 7fd99a9ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd994160390 con 0x7fd994065e30 2023-03-27T10:10:37.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.200+0000 7fd99a9ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd994160670 con 0x7fd9940b0f30 2023-03-27T10:10:37.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.200+0000 7fd99a9ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9940cb360 con 0x7fd99415c6f0 2023-03-27T10:10:37.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.200+0000 7fd993fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd99415c6f0 0x7fd9940cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd993fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd99415c6f0 0x7fd9940cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47020/0 (socket says 172.21.15.172:47020) 2023-03-27T10:10:37.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd993fff700 1 -- 172.21.15.172:0/3885069488 learned_addr learned my addr 172.21.15.172:0/3885069488 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:37.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd993fff700 1 -- 172.21.15.172:0/3885069488 >> v1:172.21.15.191:6789/0 conn(0x7fd9940b0f30 legacy=0x7fd9940b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd993fff700 1 -- 172.21.15.172:0/3885069488 >> v1:172.21.15.172:6789/0 conn(0x7fd994065e30 legacy=0x7fd994160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd993fff700 1 -- 172.21.15.172:0/3885069488 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994161210 con 0x7fd99415c6f0 2023-03-27T10:10:37.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd993fff700 1 --2- 172.21.15.172:0/3885069488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd99415c6f0 0x7fd9940cae20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd9840098f0 tx=0x7fd984009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0cb223ced7b0b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:37.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd992ffd700 1 -- 172.21.15.172:0/3885069488 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400b8a0 con 0x7fd99415c6f0 2023-03-27T10:10:37.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd992ffd700 1 -- 172.21.15.172:0/3885069488 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400ba00 con 0x7fd99415c6f0 2023-03-27T10:10:37.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.201+0000 7fd992ffd700 1 -- 172.21.15.172:0/3885069488 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400bd90 con 0x7fd99415c6f0 2023-03-27T10:10:37.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 -- 172.21.15.172:0/3885069488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd99415c6f0 msgr2=0x7fd9940cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/3885069488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd99415c6f0 0x7fd9940cae20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd9840098f0 tx=0x7fd984009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:37.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 -- 172.21.15.172:0/3885069488 shutdown_connections 2023-03-27T10:10:37.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/3885069488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd99415c6f0 0x7fd9940cae20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 -- 172.21.15.172:0/3885069488 >> 172.21.15.172:0/3885069488 conn(0x7fd9940cbf30 msgr2=0x7fd9940cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:37.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 -- 172.21.15.172:0/3885069488 shutdown_connections 2023-03-27T10:10:37.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.202+0000 7fd99a9ff700 1 -- 172.21.15.172:0/3885069488 wait complete. 2023-03-27T10:10:37.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.204+0000 7fd99a9ff700 1 Processor -- start 2023-03-27T10:10:37.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.204+0000 7fd99a9ff700 1 -- start start 2023-03-27T10:10:37.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd99a9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 0x7fd9941f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd99a9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9940b0f30 0x7fd9940c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd99a9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415c6f0 0x7fd99414d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd99a9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940b3d60 con 0x7fd994065e30 2023-03-27T10:10:37.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd99a9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c44b0 con 0x7fd9940b0f30 2023-03-27T10:10:37.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd99a9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940c4790 con 0x7fd99415c6f0 2023-03-27T10:10:37.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 0x7fd9941f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 0x7fd9941f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47032/0 (socket says 172.21.15.172:47032) 2023-03-27T10:10:37.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 -- 172.21.15.172:0/4072172197 learned_addr learned my addr 172.21.15.172:0/4072172197 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:37.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 -- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415c6f0 msgr2=0x7fd99414d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415c6f0 0x7fd99414d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 -- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9940b0f30 msgr2=0x7fd9940c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.205+0000 7fd993fff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9940b0f30 0x7fd9940c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd993fff700 1 -- 172.21.15.172:0/4072172197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009550 con 0x7fd994065e30 2023-03-27T10:10:37.213 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd993fff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 0x7fd9941f20c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd984009130 tx=0x7fd984004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:37.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840036a0 con 0x7fd994065e30 2023-03-27T10:10:37.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98401e070 con 0x7fd994065e30 2023-03-27T10:10:37.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984003a40 con 0x7fd994065e30 2023-03-27T10:10:37.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9940cb850 con 0x7fd994065e30 2023-03-27T10:10:37.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.206+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9940cb570 con 0x7fd994065e30 2023-03-27T10:10:37.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.207+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9940cbb30 con 0x7fd994065e30 2023-03-27T10:10:37.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.208+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd98400f050 con 0x7fd994065e30 2023-03-27T10:10:37.215 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.209+0000 7fd990ff9700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd980066e30 0x7fd9800692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.209+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd984020070 con 0x7fd994065e30 2023-03-27T10:10:37.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.209+0000 7fd9937fe700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd980066e30 0x7fd9800692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.210+0000 7fd9937fe700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd980066e30 0x7fd9800692e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd988000f60 tx=0x7fd988007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:37.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.213+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd984052ad0 con 0x7fd994065e30 2023-03-27T10:10:37.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.402+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9940c4950 con 0x7fd994065e30 2023-03-27T10:10:37.402 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.403+0000 7fd990ff9700 1 -- 172.21.15.172:0/4072172197 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7fd9840560f0 con 0x7fd994065e30 2023-03-27T10:10:37.402 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:37.402 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:32.667663+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:37.404 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd980066e30 msgr2=0x7fd9800692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd980066e30 0x7fd9800692e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd988000f60 tx=0x7fd988007a40 comp rx=0 tx=0).stop 2023-03-27T10:10:37.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 msgr2=0x7fd9941f20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 0x7fd9941f20c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd984009130 tx=0x7fd984004750 comp rx=0 tx=0).stop 2023-03-27T10:10:37.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 shutdown_connections 2023-03-27T10:10:37.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415c6f0 0x7fd99414d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.405 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd994065e30 0x7fd9941f20c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd980066e30 0x7fd9800692e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 --2- 172.21.15.172:0/4072172197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9940b0f30 0x7fd9940c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 >> 172.21.15.172:0/4072172197 conn(0x7fd9940cbf30 msgr2=0x7fd994072230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:37.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 shutdown_connections 2023-03-27T10:10:37.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.406+0000 7fd99a9ff700 1 -- 172.21.15.172:0/4072172197 wait complete. 2023-03-27T10:10:37.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:37.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:37.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.612+0000 7f4a223ff700 1 Processor -- start 2023-03-27T10:10:37.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.612+0000 7f4a223ff700 1 -- start start 2023-03-27T10:10:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a223ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a1c0b4300 0x7f4a1c0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a223ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c071910 con 0x7f4a1c0cba80 2023-03-27T10:10:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a223ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c06d200 con 0x7f4a1c15aab0 2023-03-27T10:10:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a223ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0cbf00 con 0x7f4a1c0b4300 2023-03-27T10:10:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a1b7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a1c0b4300 0x7f4a1c0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a1b7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a1c0b4300 0x7f4a1c0cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47040/0 (socket says 172.21.15.172:47040) 2023-03-27T10:10:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.613+0000 7f4a1b7fe700 1 -- 172.21.15.172:0/20966504 learned_addr learned my addr 172.21.15.172:0/20966504 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1b7fe700 1 -- 172.21.15.172:0/20966504 >> v1:172.21.15.191:6789/0 conn(0x7f4a1c15aab0 legacy=0x7f4a1c06ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1b7fe700 1 -- 172.21.15.172:0/20966504 >> v1:172.21.15.172:6789/0 conn(0x7f4a1c0cba80 legacy=0x7f4a1c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1b7fe700 1 -- 172.21.15.172:0/20966504 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0712c0 con 0x7f4a1c0b4300 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1b7fe700 1 --2- 172.21.15.172:0/20966504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0cb540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a100098f0 tx=0x7f4a10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a702ef61c75acf2f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1affd700 1 -- 172.21.15.172:0/20966504 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10004230 con 0x7f4a1c0b4300 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1affd700 1 -- 172.21.15.172:0/20966504 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10004390 con 0x7f4a1c0b4300 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.614+0000 7f4a1affd700 1 -- 172.21.15.172:0/20966504 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100036a0 con 0x7f4a1c0b4300 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 -- 172.21.15.172:0/20966504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 msgr2=0x7f4a1c0cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 --2- 172.21.15.172:0/20966504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0cb540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a100098f0 tx=0x7f4a10009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 -- 172.21.15.172:0/20966504 shutdown_connections 2023-03-27T10:10:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 --2- 172.21.15.172:0/20966504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0cb540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 -- 172.21.15.172:0/20966504 >> 172.21.15.172:0/20966504 conn(0x7f4a1c06a1a0 msgr2=0x7f4a1c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 -- 172.21.15.172:0/20966504 shutdown_connections 2023-03-27T10:10:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.615+0000 7f4a223ff700 1 -- 172.21.15.172:0/20966504 wait complete. 2023-03-27T10:10:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.616+0000 7f4a223ff700 1 Processor -- start 2023-03-27T10:10:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.617+0000 7f4a223ff700 1 -- start start 2023-03-27T10:10:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a223ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a223ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a1c0cba80 0x7f4a1c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a223ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a1c15aab0 0x7f4a1c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a223ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0c5120 con 0x7f4a1c0b4300 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a223ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0cd110 con 0x7f4a1c15aab0 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a223ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0cd3f0 con 0x7f4a1c0cba80 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47042/0 (socket says 172.21.15.172:47042) 2023-03-27T10:10:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 -- 172.21.15.172:0/498638930 learned_addr learned my addr 172.21.15.172:0/498638930 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:37.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a2099c700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a1c15aab0 0x7f4a1c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1b7fe700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a1c0cba80 0x7f4a1c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 -- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a1c0cba80 msgr2=0x7f4a1c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a1c0cba80 0x7f4a1c0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 -- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a1c15aab0 msgr2=0x7f4a1c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a1c15aab0 0x7f4a1c0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a1bfff700 1 -- 172.21.15.172:0/498638930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009550 con 0x7f4a1c0b4300 2023-03-27T10:10:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.618+0000 7f4a2099c700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a1c15aab0 0x7f4a1c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.619+0000 7f4a1bfff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0c4be0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00b4a0 tx=0x7f4a0c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.619+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c011830 con 0x7f4a1c0b4300 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.619+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c011990 con 0x7f4a1c0b4300 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.619+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c15ae80 con 0x7f4a1c0b4300 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.619+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c011d40 con 0x7f4a1c0b4300 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.619+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c0715a0 con 0x7f4a1c0b4300 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.620+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c0b19e0 con 0x7f4a1c0b4300 2023-03-27T10:10:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.621+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f4a0c021070 con 0x7f4a1c0b4300 2023-03-27T10:10:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.621+0000 7f4a18ff9700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a08066e60 0x7f4a08069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.622+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4a0c084130 con 0x7f4a1c0b4300 2023-03-27T10:10:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.622+0000 7f4a1b7fe700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a08066e60 0x7f4a08069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.622+0000 7f4a1b7fe700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a08066e60 0x7f4a08069310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009130 tx=0x7f4a10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.625+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f4a0c0512d0 con 0x7f4a1c0b4300 2023-03-27T10:10:37.820 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.822+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a1c074300 con 0x7f4a1c0b4300 2023-03-27T10:10:37.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.822+0000 7f4a18ff9700 1 -- 172.21.15.172:0/498638930 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a0c0548f0 con 0x7f4a1c0b4300 2023-03-27T10:10:37.821 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:37.823 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.824+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a08066e60 msgr2=0x7f4a08069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.823 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a08066e60 0x7f4a08069310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009130 tx=0x7f4a10008030 comp rx=0 tx=0).stop 2023-03-27T10:10:37.823 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 msgr2=0x7f4a1c0c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0c4be0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00b4a0 tx=0x7f4a0c00b7b0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 shutdown_connections 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4a08066e60 0x7f4a08069310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a1c15aab0 0x7f4a1c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a1c0b4300 0x7f4a1c0c4be0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 --2- 172.21.15.172:0/498638930 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a1c0cba80 0x7f4a1c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 >> 172.21.15.172:0/498638930 conn(0x7f4a1c06a1a0 msgr2=0x7f4a1c1595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:37.824 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 shutdown_connections 2023-03-27T10:10:37.825 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:37.825+0000 7f4a223ff700 1 -- 172.21.15.172:0/498638930 wait complete. 2023-03-27T10:10:37.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:38.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.028+0000 7f4429fff700 1 Processor -- start 2023-03-27T10:10:38.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.028+0000 7f4429fff700 1 -- start start 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.029+0000 7f4429fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f442415c520 0x7f44240d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.029+0000 7f4429fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f44240d1000 0x7f44240cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.029+0000 7f4429fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44240cdbf0 con 0x7f44240cfd50 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.029+0000 7f4429fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44240d2e80 con 0x7f442415c520 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.029+0000 7f4429fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44240d1430 con 0x7f44240d1000 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.029+0000 7f44237fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f442415c520 0x7f44240d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f442415c520 0x7f44240d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47052/0 (socket says 172.21.15.172:47052) 2023-03-27T10:10:38.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 -- 172.21.15.172:0/1850611401 learned_addr learned my addr 172.21.15.172:0/1850611401 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:38.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f4422ffd700 1 --2- 172.21.15.172:0/1850611401 >> v2:172.21.15.191:3300/0 conn(0x7f44240d1000 0x7f44240cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 -- 172.21.15.172:0/1850611401 >> v2:172.21.15.191:3300/0 conn(0x7f44240d1000 msgr2=0x7f44240cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:38.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 --2- 172.21.15.172:0/1850611401 >> v2:172.21.15.191:3300/0 conn(0x7f44240d1000 0x7f44240cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.030 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 -- 172.21.15.172:0/1850611401 >> v1:172.21.15.191:6789/0 conn(0x7f44240cfd50 legacy=0x7f4424160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 -- 172.21.15.172:0/1850611401 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240d01a0 con 0x7f442415c520 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f4422ffd700 1 --2- 172.21.15.172:0/1850611401 >> v2:172.21.15.191:3300/0 conn(0x7f44240d1000 0x7f44240cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44237fe700 1 --2- 172.21.15.172:0/1850611401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240d0ac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44240b8fa0 tx=0x7f4414009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35826fbdb6e3411c server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44227fc700 1 -- 172.21.15.172:0/1850611401 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414004230 con 0x7f442415c520 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44227fc700 1 -- 172.21.15.172:0/1850611401 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414004390 con 0x7f442415c520 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.030+0000 7f44227fc700 1 -- 172.21.15.172:0/1850611401 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140036a0 con 0x7f442415c520 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 -- 172.21.15.172:0/1850611401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 msgr2=0x7f44240d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 --2- 172.21.15.172:0/1850611401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240d0ac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44240b8fa0 tx=0x7f4414009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 -- 172.21.15.172:0/1850611401 shutdown_connections 2023-03-27T10:10:38.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 --2- 172.21.15.172:0/1850611401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240d0ac0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 --2- 172.21.15.172:0/1850611401 >> v2:172.21.15.191:3300/0 conn(0x7f44240d1000 0x7f44240cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 -- 172.21.15.172:0/1850611401 >> 172.21.15.172:0/1850611401 conn(0x7f44240721f0 msgr2=0x7f442409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:38.032 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 -- 172.21.15.172:0/1850611401 shutdown_connections 2023-03-27T10:10:38.033 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.031+0000 7f4429fff700 1 -- 172.21.15.172:0/1850611401 wait complete. 2023-03-27T10:10:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.033+0000 7f4429fff700 1 Processor -- start 2023-03-27T10:10:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.033+0000 7f4429fff700 1 -- start start 2023-03-27T10:10:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4429fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44240cfd50 0x7f4424155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4429fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44240d1000 0x7f44240b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4429fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4429fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240b4210 con 0x7f442415c520 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4429fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44240b4a70 con 0x7f44240cfd50 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4429fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44240cce80 con 0x7f44240d1000 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4423fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4423fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47054/0 (socket says 172.21.15.172:47054) 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4423fff700 1 -- 172.21.15.172:0/1333951526 learned_addr learned my addr 172.21.15.172:0/1333951526 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f44237fe700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44240cfd50 0x7f4424155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4422ffd700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44240d1000 0x7f44240b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.034+0000 7f4423fff700 1 -- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44240d1000 msgr2=0x7f44240b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4423fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44240d1000 0x7f44240b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4423fff700 1 -- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44240cfd50 msgr2=0x7f4424155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4423fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44240cfd50 0x7f4424155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4423fff700 1 -- 172.21.15.172:0/1333951526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414009550 con 0x7f442415c520 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4422ffd700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44240d1000 0x7f44240b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4423fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240b1ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f441c00cc10 tx=0x7f441c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00abb0 con 0x7f442415c520 2023-03-27T10:10:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c00ad10 con 0x7f442415c520 2023-03-27T10:10:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44240d0420 con 0x7f442415c520 2023-03-27T10:10:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c012660 con 0x7f442415c520 2023-03-27T10:10:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.035+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44240cd5e0 con 0x7f442415c520 2023-03-27T10:10:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.036+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44240cd880 con 0x7f442415c520 2023-03-27T10:10:38.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.037+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f441c022070 con 0x7f442415c520 2023-03-27T10:10:38.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.038+0000 7f440bfff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4410066e30 0x7f44100692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.038+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f441c084950 con 0x7f442415c520 2023-03-27T10:10:38.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.038+0000 7f44237fe700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4410066e30 0x7f44100692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.039+0000 7f44237fe700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4410066e30 0x7f44100692e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4414009130 tx=0x7f4414008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.042+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f441c051b50 con 0x7f442415c520 2023-03-27T10:10:38.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.229+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4424074300 con 0x7f442415c520 2023-03-27T10:10:38.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.229+0000 7f440bfff700 1 -- 172.21.15.172:0/1333951526 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f441c0160a0 con 0x7f442415c520 2023-03-27T10:10:38.228 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:38.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4410066e30 msgr2=0x7f44100692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4410066e30 0x7f44100692e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4414009130 tx=0x7f4414008030 comp rx=0 tx=0).stop 2023-03-27T10:10:38.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 msgr2=0x7f44240b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240b1ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f441c00cc10 tx=0x7f441c00a060 comp rx=0 tx=0).stop 2023-03-27T10:10:38.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 shutdown_connections 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442415c520 0x7f44240b1ec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4410066e30 0x7f44100692e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44240cfd50 0x7f4424155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 --2- 172.21.15.172:0/1333951526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44240d1000 0x7f44240b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 >> 172.21.15.172:0/1333951526 conn(0x7f44240721f0 msgr2=0x7f44240b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.231+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 shutdown_connections 2023-03-27T10:10:38.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.232+0000 7f4429fff700 1 -- 172.21.15.172:0/1333951526 wait complete. 2023-03-27T10:10:38.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:38.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.436+0000 7fd696fff700 1 Processor -- start 2023-03-27T10:10:38.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.436+0000 7fd696fff700 1 -- start start 2023-03-27T10:10:38.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd696fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd69006da00 0x7fd69006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd696fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd690072400 0x7fd690160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd696fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd69006ab40 0x7fd69015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd696fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6901611a0 con 0x7fd69006da00 2023-03-27T10:10:38.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd696fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6901463e0 con 0x7fd690072400 2023-03-27T10:10:38.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd696fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006e310 con 0x7fd69006ab40 2023-03-27T10:10:38.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd69006da00 0x7fd69006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd69006da00 0x7fd69006ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47068/0 (socket says 172.21.15.172:47068) 2023-03-27T10:10:38.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 -- 172.21.15.172:0/3453030564 learned_addr learned my addr 172.21.15.172:0/3453030564 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:38.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd68ffff700 1 --2- 172.21.15.172:0/3453030564 >> v2:172.21.15.191:3300/0 conn(0x7fd690072400 0x7fd690160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd69559c700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd69006ab40 0x7fd69015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 -- 172.21.15.172:0/3453030564 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd69006ab40 msgr2=0x7fd69015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:38.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd69006ab40 0x7fd69015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 -- 172.21.15.172:0/3453030564 >> v2:172.21.15.191:3300/0 conn(0x7fd690072400 msgr2=0x7fd690160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:38.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 --2- 172.21.15.172:0/3453030564 >> v2:172.21.15.191:3300/0 conn(0x7fd690072400 0x7fd690160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd694d9b700 1 -- 172.21.15.172:0/3453030564 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690160be0 con 0x7fd69006da00 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.438+0000 7fd69559c700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd69006ab40 0x7fd69015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd694d9b700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006da00 0x7fd69006ddd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6900b5350 tx=0x7fd684009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e930bc86d89313b5 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd68f7fe700 1 -- 172.21.15.172:0/3453030564 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400b870 con 0x7fd69006da00 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd68f7fe700 1 -- 172.21.15.172:0/3453030564 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400b9d0 con 0x7fd69006da00 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd68f7fe700 1 -- 172.21.15.172:0/3453030564 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68400bd60 con 0x7fd69006da00 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 -- 172.21.15.172:0/3453030564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006da00 msgr2=0x7fd69006ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006da00 0x7fd69006ddd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd6900b5350 tx=0x7fd684009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 -- 172.21.15.172:0/3453030564 shutdown_connections 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd69006ab40 0x7fd69015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 --2- 172.21.15.172:0/3453030564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006da00 0x7fd69006ddd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 --2- 172.21.15.172:0/3453030564 >> v2:172.21.15.191:3300/0 conn(0x7fd690072400 0x7fd690160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.439+0000 7fd696fff700 1 -- 172.21.15.172:0/3453030564 >> 172.21.15.172:0/3453030564 conn(0x7fd6900b1010 msgr2=0x7fd6900b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.440+0000 7fd696fff700 1 -- 172.21.15.172:0/3453030564 shutdown_connections 2023-03-27T10:10:38.441 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.440+0000 7fd696fff700 1 -- 172.21.15.172:0/3453030564 wait complete. 2023-03-27T10:10:38.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.441+0000 7fd696fff700 1 Processor -- start 2023-03-27T10:10:38.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.441+0000 7fd696fff700 1 -- start start 2023-03-27T10:10:38.443 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd696fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 0x7fd69013df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd696fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd69006da00 0x7fd69015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd696fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd690072400 0x7fd6900b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd696fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd690143ac0 con 0x7fd69006ab40 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd696fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd690142bf0 con 0x7fd69006da00 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd696fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd690144aa0 con 0x7fd690072400 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd694d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 0x7fd69013df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.444 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd694d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 0x7fd69013df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47078/0 (socket says 172.21.15.172:47078) 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.442+0000 7fd694d9b700 1 -- 172.21.15.172:0/3334384815 learned_addr learned my addr 172.21.15.172:0/3334384815 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd68ffff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd69006da00 0x7fd69015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd69559c700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd690072400 0x7fd6900b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd694d9b700 1 -- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd690072400 msgr2=0x7fd6900b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd694d9b700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd690072400 0x7fd6900b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd694d9b700 1 -- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd69006da00 msgr2=0x7fd69015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd694d9b700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd69006da00 0x7fd69015bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.445 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd694d9b700 1 -- 172.21.15.172:0/3334384815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009550 con 0x7fd69006ab40 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd69559c700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd690072400 0x7fd6900b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd68ffff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd69006da00 0x7fd69015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd694d9b700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 0x7fd69013df70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd684000c00 tx=0x7fd684004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684004540 con 0x7fd69006ab40 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840036a0 con 0x7fd69006ab40 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69006a340 con 0x7fd69006ab40 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.443+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684003a50 con 0x7fd69006ab40 2023-03-27T10:10:38.446 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.444+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd690160ec0 con 0x7fd69006ab40 2023-03-27T10:10:38.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.444+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69006a620 con 0x7fd69006ab40 2023-03-27T10:10:38.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.445+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd68400f050 con 0x7fd69006ab40 2023-03-27T10:10:38.447 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.446+0000 7fd68d7fa700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd674066e30 0x7fd6740692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.446+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd684085c30 con 0x7fd69006ab40 2023-03-27T10:10:38.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.447+0000 7fd68ffff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd674066e30 0x7fd6740692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.447+0000 7fd68ffff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd674066e30 0x7fd6740692e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ad750 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.448 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.450+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd684052e30 con 0x7fd69006ab40 2023-03-27T10:10:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.634+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd690074300 con 0x7fd69006ab40 2023-03-27T10:10:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.635+0000 7fd68d7fa700 1 -- 172.21.15.172:0/3334384815 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd684015020 con 0x7fd69006ab40 2023-03-27T10:10:38.634 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd674066e30 msgr2=0x7fd6740692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd674066e30 0x7fd6740692e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ad750 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2023-03-27T10:10:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 msgr2=0x7fd69013df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 0x7fd69013df70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd684000c00 tx=0x7fd684004750 comp rx=0 tx=0).stop 2023-03-27T10:10:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 shutdown_connections 2023-03-27T10:10:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd690072400 0x7fd6900b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd69006ab40 0x7fd69013df70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd674066e30 0x7fd6740692e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 --2- 172.21.15.172:0/3334384815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd69006da00 0x7fd69015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 >> 172.21.15.172:0/3334384815 conn(0x7fd6900b1010 msgr2=0x7fd690070320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 shutdown_connections 2023-03-27T10:10:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.637+0000 7fd696fff700 1 -- 172.21.15.172:0/3334384815 wait complete. 2023-03-27T10:10:38.653 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:38.839 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.841+0000 7fc6613ff700 1 Processor -- start 2023-03-27T10:10:38.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.841+0000 7fc6613ff700 1 -- start start 2023-03-27T10:10:38.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.842+0000 7fc6613ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc65c072400 0x7fc65c160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.842+0000 7fc6613ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c1463e0 con 0x7fc65c06da00 2023-03-27T10:10:38.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.842+0000 7fc6613ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c160be0 con 0x7fc65c06ab40 2023-03-27T10:10:38.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.842+0000 7fc6613ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c1611a0 con 0x7fc65c072400 2023-03-27T10:10:38.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc65affd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc65c06da00 0x7fc65c06ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47868/0 (socket says 172.21.15.172:47868) 2023-03-27T10:10:38.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc65affd700 1 -- 172.21.15.172:0/3110769546 learned_addr learned my addr 172.21.15.172:0/3110769546 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:38.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc65a7fc700 1 --2- 172.21.15.172:0/3110769546 >> v2:172.21.15.191:3300/0 conn(0x7fc65c072400 0x7fc65c160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc659ffb700 1 -- 172.21.15.172:0/3110769546 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767019849 0 0) 0x7fc65c1463e0 con 0x7fc65c06da00 2023-03-27T10:10:38.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc659ffb700 1 -- 172.21.15.172:0/3110769546 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6440035b0 con 0x7fc65c06da00 2023-03-27T10:10:38.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc65a7fc700 1 -- 172.21.15.172:0/3110769546 >> v1:172.21.15.191:6789/0 conn(0x7fc65c06ab40 legacy=0x7fc65c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc65a7fc700 1 -- 172.21.15.172:0/3110769546 >> v1:172.21.15.172:6789/0 conn(0x7fc65c06da00 legacy=0x7fc65c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.843+0000 7fc65a7fc700 1 -- 172.21.15.172:0/3110769546 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c160ec0 con 0x7fc65c072400 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc65a7fc700 1 --2- 172.21.15.172:0/3110769546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c072400 0x7fc65c160270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc650009840 tx=0x7fc650009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be797dbbba785cea server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc659ffb700 1 -- 172.21.15.172:0/3110769546 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650011830 con 0x7fc65c072400 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc659ffb700 1 -- 172.21.15.172:0/3110769546 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650011990 con 0x7fc65c072400 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc659ffb700 1 -- 172.21.15.172:0/3110769546 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650011d20 con 0x7fc65c072400 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc6613ff700 1 -- 172.21.15.172:0/3110769546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c072400 msgr2=0x7fc65c160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc6613ff700 1 --2- 172.21.15.172:0/3110769546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c072400 0x7fc65c160270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc650009840 tx=0x7fc650009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:38.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc6613ff700 1 -- 172.21.15.172:0/3110769546 shutdown_connections 2023-03-27T10:10:38.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc6613ff700 1 --2- 172.21.15.172:0/3110769546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c072400 0x7fc65c160270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.844+0000 7fc6613ff700 1 -- 172.21.15.172:0/3110769546 >> 172.21.15.172:0/3110769546 conn(0x7fc65c0b1010 msgr2=0x7fc65c0b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:38.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.845+0000 7fc6613ff700 1 -- 172.21.15.172:0/3110769546 shutdown_connections 2023-03-27T10:10:38.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.845+0000 7fc6613ff700 1 -- 172.21.15.172:0/3110769546 wait complete. 2023-03-27T10:10:38.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.846+0000 7fc6613ff700 1 Processor -- start 2023-03-27T10:10:38.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.846+0000 7fc6613ff700 1 -- start start 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc6613ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c06ab40 0x7fc65c145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc6613ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc65c06da00 0x7fc65c15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc6613ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 0x7fc65c140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc6613ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c142e50 con 0x7fc65c072400 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc6613ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c15fd50 con 0x7fc65c06ab40 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc6613ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c142240 con 0x7fc65c06da00 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 0x7fc65c140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.847+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 0x7fc65c140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47092/0 (socket says 172.21.15.172:47092) 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 -- 172.21.15.172:0/2698998900 learned_addr learned my addr 172.21.15.172:0/2698998900 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65affd700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c06ab40 0x7fc65c145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65a7fc700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc65c06da00 0x7fc65c15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 -- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc65c06da00 msgr2=0x7fc65c15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc65c06da00 0x7fc65c15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 -- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c06ab40 msgr2=0x7fc65c145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:38.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c06ab40 0x7fc65c145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 -- 172.21.15.172:0/2698998900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500094a0 con 0x7fc65c072400 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc65b7fe700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 0x7fc65c140c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc65400cc50 tx=0x7fc65400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65400ad80 con 0x7fc65c072400 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65400ce50 con 0x7fc65c072400 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c06a620 con 0x7fc65c072400 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654003c40 con 0x7fc65c072400 2023-03-27T10:10:38.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.848+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c06a340 con 0x7fc65c072400 2023-03-27T10:10:38.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.849+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c1607b0 con 0x7fc65c072400 2023-03-27T10:10:38.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.850+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc654010050 con 0x7fc65c072400 2023-03-27T10:10:38.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.851+0000 7fc6437fe700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc648066e30 0x7fc6480692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:38.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.851+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc6540842e0 con 0x7fc65c072400 2023-03-27T10:10:38.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.852+0000 7fc65affd700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc648066e30 0x7fc6480692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:38.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.852+0000 7fc65affd700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc648066e30 0x7fc6480692e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0011e0 tx=0x7fc64c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:38.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:38.855+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc654051480 con 0x7fc65c072400 2023-03-27T10:10:39.040 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.042+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc65c074300 con 0x7fc65c072400 2023-03-27T10:10:39.041 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.042+0000 7fc6437fe700 1 -- 172.21.15.172:0/2698998900 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc654054aa0 con 0x7fc65c072400 2023-03-27T10:10:39.041 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:39.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.044+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc648066e30 msgr2=0x7fc6480692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.044+0000 7fc6613ff700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc648066e30 0x7fc6480692e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0011e0 tx=0x7fc64c009040 comp rx=0 tx=0).stop 2023-03-27T10:10:39.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.044+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 msgr2=0x7fc65c140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.044+0000 7fc6613ff700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 0x7fc65c140c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc65400cc50 tx=0x7fc65400a340 comp rx=0 tx=0).stop 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 shutdown_connections 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc65c072400 0x7fc65c140c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc648066e30 0x7fc6480692e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc65c06ab40 0x7fc65c145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 --2- 172.21.15.172:0/2698998900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc65c06da00 0x7fc65c15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.044 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 >> 172.21.15.172:0/2698998900 conn(0x7fc65c0b1010 msgr2=0x7fc65c0b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:39.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 shutdown_connections 2023-03-27T10:10:39.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.045+0000 7fc6613ff700 1 -- 172.21.15.172:0/2698998900 wait complete. 2023-03-27T10:10:39.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blocklist ls' 2023-03-27T10:10:39.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.245+0000 7f0f72dff700 1 Processor -- start 2023-03-27T10:10:39.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.245+0000 7f0f72dff700 1 -- start start 2023-03-27T10:10:39.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.246+0000 7f0f72dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0ce7d0 0x7f0f6c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.246+0000 7f0f72dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0caa80 con 0x7f0f6c15a540 2023-03-27T10:10:39.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.246+0000 7f0f72dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c15aa90 con 0x7f0f6c0b0050 2023-03-27T10:10:39.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.246+0000 7f0f72dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c9570 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f6bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0f6c15a540 0x7f0f6c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47878/0 (socket says 172.21.15.172:47878) 2023-03-27T10:10:39.245 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f6bfff700 1 -- 172.21.15.172:0/2144402283 learned_addr learned my addr 172.21.15.172:0/2144402283 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:39.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f70b9b700 1 --2- 172.21.15.172:0/2144402283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0ce7d0 0x7f0f6c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71449205 0 0) 0x7f0f6c0caa80 con 0x7f0f6c15a540 2023-03-27T10:10:39.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c0035b0 con 0x7f0f6c15a540 2023-03-27T10:10:39.247 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490171781 0 0) 0x7f0f6c15aa90 con 0x7f0f6c0b0050 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6c0caa80 con 0x7f0f6c0b0050 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f70b9b700 1 -- 172.21.15.172:0/2144402283 >> v1:172.21.15.191:6789/0 conn(0x7f0f6c0b0050 legacy=0x7f0f6c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f70b9b700 1 -- 172.21.15.172:0/2144402283 >> v1:172.21.15.172:6789/0 conn(0x7f0f6c15a540 legacy=0x7f0f6c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.247+0000 7f0f70b9b700 1 -- 172.21.15.172:0/2144402283 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0c9780 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f70b9b700 1 --2- 172.21.15.172:0/2144402283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0ce7d0 0x7f0f6c0ca540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009870 tx=0x7f0f60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=775601d001cbb8c7 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60011830 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60011990 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.248 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f6b7fe700 1 -- 172.21.15.172:0/2144402283 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60011d20 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f72dff700 1 -- 172.21.15.172:0/2144402283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0ce7d0 msgr2=0x7f0f6c0ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f72dff700 1 --2- 172.21.15.172:0/2144402283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0ce7d0 0x7f0f6c0ca540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009870 tx=0x7f0f60009b80 comp rx=0 tx=0).stop 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f72dff700 1 -- 172.21.15.172:0/2144402283 shutdown_connections 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f72dff700 1 --2- 172.21.15.172:0/2144402283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0ce7d0 0x7f0f6c0ca540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.248+0000 7f0f72dff700 1 -- 172.21.15.172:0/2144402283 >> 172.21.15.172:0/2144402283 conn(0x7f0f6c06a1a0 msgr2=0x7f0f6c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.249+0000 7f0f72dff700 1 -- 172.21.15.172:0/2144402283 shutdown_connections 2023-03-27T10:10:39.249 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.249+0000 7f0f72dff700 1 -- 172.21.15.172:0/2144402283 wait complete. 2023-03-27T10:10:39.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.250+0000 7f0f72dff700 1 Processor -- start 2023-03-27T10:10:39.251 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.250+0000 7f0f72dff700 1 -- start start 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.251+0000 7f0f72dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0b0050 0x7f0f6c1f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.251+0000 7f0f72dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6c0ce7d0 0x7f0f6c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.251+0000 7f0f72dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6c15a540 0x7f0f6c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.251+0000 7f0f72dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0b1bc0 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.251+0000 7f0f72dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c06c000 con 0x7f0f6c15a540 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.251+0000 7f0f72dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1f5b50 con 0x7f0f6c0b0050 2023-03-27T10:10:39.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6c0ce7d0 0x7f0f6c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6c0ce7d0 0x7f0f6c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47106/0 (socket says 172.21.15.172:47106) 2023-03-27T10:10:39.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 -- 172.21.15.172:0/1444703666 learned_addr learned my addr 172.21.15.172:0/1444703666 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:39.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f70b9b700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0b0050 0x7f0f6c1f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f7139c700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6c15a540 0x7f0f6c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 -- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0b0050 msgr2=0x7f0f6c1f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6c0b0050 0x7f0f6c1f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 -- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6c15a540 msgr2=0x7f0f6c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6c15a540 0x7f0f6c15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 -- 172.21.15.172:0/1444703666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600094a0 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.252+0000 7f0f6bfff700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6c0ce7d0 0x7f0f6c14fae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0f58001eb0 tx=0x7f0f5800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:39.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.253+0000 7f0f697fa700 1 -- 172.21.15.172:0/1444703666 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58005d70 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.253+0000 7f0f697fa700 1 -- 172.21.15.172:0/1444703666 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f580070d0 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.253+0000 7f0f72dff700 1 -- 172.21.15.172:0/1444703666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0c9d40 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.253+0000 7f0f697fa700 1 -- 172.21.15.172:0/1444703666 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58007460 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.253+0000 7f0f72dff700 1 -- 172.21.15.172:0/1444703666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c0c9a60 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.254+0000 7f0f72dff700 1 -- 172.21.15.172:0/1444703666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0ca020 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.255+0000 7f0f697fa700 1 -- 172.21.15.172:0/1444703666 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0f58019030 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.256+0000 7f0f697fa700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f50066e30 0x7f0f500692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.256+0000 7f0f697fa700 1 -- 172.21.15.172:0/1444703666 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0f580835e0 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.256+0000 7f0f70b9b700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f50066e30 0x7f0f500692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.257+0000 7f0f70b9b700 1 --2- 172.21.15.172:0/1444703666 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f50066e30 0x7f0f500692e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0f600097c0 tx=0x7f0f6001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:39.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.259+0000 7f0f697fa700 1 -- 172.21.15.172:0/1444703666 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f0f580507e0 con 0x7f0f6c0ce7d0 2023-03-27T10:10:39.682 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:39.682 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:39.682 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:39.682 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:39.682 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:39.683 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:39.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:39.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blacklist ls' 2023-03-27T10:10:39.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.875+0000 7ff6c09ff700 1 Processor -- start 2023-03-27T10:10:39.874 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.875+0000 7ff6c09ff700 1 -- start start 2023-03-27T10:10:39.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.876+0000 7ff6c09ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc0d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.876+0000 7ff6c09ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff6bc0d33f0 0x7ff6bc0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6c09ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc0b1630 con 0x7ff6bc0b0250 2023-03-27T10:10:39.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6c09ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc0d3860 con 0x7ff6bc0d33f0 2023-03-27T10:10:39.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6c09ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0b36a0 con 0x7ff6bc15c670 2023-03-27T10:10:39.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff6bc0d33f0 0x7ff6bc0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff6bc0d33f0 0x7ff6bc0afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47118/0 (socket says 172.21.15.172:47118) 2023-03-27T10:10:39.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 -- 172.21.15.172:0/1299298696 learned_addr learned my addr 172.21.15.172:0/1299298696 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:39.877 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 -- 172.21.15.172:0/1299298696 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 msgr2=0x7ff6bc0d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:39.877 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 --2- 172.21.15.172:0/1299298696 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc0d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.877 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 -- 172.21.15.172:0/1299298696 >> v1:172.21.15.191:6789/0 conn(0x7ff6bc0b0250 legacy=0x7ff6bc160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.877+0000 7ff6b3fff700 1 -- 172.21.15.172:0/1299298696 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0b0a20 con 0x7ff6bc0d33f0 2023-03-27T10:10:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6b3fff700 1 --2- 172.21.15.172:0/1299298696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0afd10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22522c007845a026 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6b9d9b700 1 -- 172.21.15.172:0/1299298696 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004230 con 0x7ff6bc0d33f0 2023-03-27T10:10:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6b9d9b700 1 -- 172.21.15.172:0/1299298696 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4004390 con 0x7ff6bc0d33f0 2023-03-27T10:10:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6b9d9b700 1 -- 172.21.15.172:0/1299298696 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40036a0 con 0x7ff6bc0d33f0 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 -- 172.21.15.172:0/1299298696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0d33f0 msgr2=0x7ff6bc0afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 --2- 172.21.15.172:0/1299298696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0afd10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 -- 172.21.15.172:0/1299298696 shutdown_connections 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 --2- 172.21.15.172:0/1299298696 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc0d2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 --2- 172.21.15.172:0/1299298696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0afd10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 -- 172.21.15.172:0/1299298696 >> 172.21.15.172:0/1299298696 conn(0x7ff6bc0721f0 msgr2=0x7ff6bc09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 -- 172.21.15.172:0/1299298696 shutdown_connections 2023-03-27T10:10:39.880 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.878+0000 7ff6c09ff700 1 -- 172.21.15.172:0/1299298696 wait complete. 2023-03-27T10:10:39.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.880+0000 7ff6c09ff700 1 Processor -- start 2023-03-27T10:10:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.880+0000 7ff6c09ff700 1 -- start start 2023-03-27T10:10:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6c09ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0b0250 0x7ff6bc1f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6c09ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6c09ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6c09ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc15ca40 con 0x7ff6bc0b0250 2023-03-27T10:10:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6c09ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc1f2220 con 0x7ff6bc0d33f0 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6c09ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc0b72d0 con 0x7ff6bc15c670 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6ba59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0b0250 0x7ff6bc1f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6ba59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0b0250 0x7ff6bc1f1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47126/0 (socket says 172.21.15.172:47126) 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.881+0000 7ff6ba59c700 1 -- 172.21.15.172:0/3972083097 learned_addr learned my addr 172.21.15.172:0/3972083097 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6b3fff700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6bad9d700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6ba59c700 1 -- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 msgr2=0x7ff6bc06bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6ba59c700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc06bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6ba59c700 1 -- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6bc0d33f0 msgr2=0x7ff6bc0b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6ba59c700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6ba59c700 1 -- 172.21.15.172:0/3972083097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009550 con 0x7ff6bc0b0250 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6b3fff700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6bc0d33f0 0x7ff6bc0b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6bad9d700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6bc15c670 0x7ff6bc06bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6ba59c700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc0b0250 0x7ff6bc1f1ce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b520 tx=0x7ff6ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6b2ffd700 1 -- 172.21.15.172:0/3972083097 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac005aa0 con 0x7ff6bc0b0250 2023-03-27T10:10:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6b2ffd700 1 -- 172.21.15.172:0/3972083097 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac005c00 con 0x7ff6bc0b0250 2023-03-27T10:10:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6c09ff700 1 -- 172.21.15.172:0/3972083097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc0b0fe0 con 0x7ff6bc0b0250 2023-03-27T10:10:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.882+0000 7ff6b2ffd700 1 -- 172.21.15.172:0/3972083097 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac011630 con 0x7ff6bc0b0250 2023-03-27T10:10:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.883+0000 7ff6c09ff700 1 -- 172.21.15.172:0/3972083097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc0b0d00 con 0x7ff6bc0b0250 2023-03-27T10:10:39.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.884+0000 7ff6c09ff700 1 -- 172.21.15.172:0/3972083097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc0b12c0 con 0x7ff6bc0b0250 2023-03-27T10:10:39.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.884+0000 7ff6b2ffd700 1 -- 172.21.15.172:0/3972083097 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff6ac00f050 con 0x7ff6bc0b0250 2023-03-27T10:10:39.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.885+0000 7ff6b2ffd700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff69c066e30 0x7ff69c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:39.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.885+0000 7ff6b2ffd700 1 -- 172.21.15.172:0/3972083097 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff6ac083d70 con 0x7ff6bc0b0250 2023-03-27T10:10:39.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.886+0000 7ff6b3fff700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff69c066e30 0x7ff69c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:39.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.887+0000 7ff6b3fff700 1 --2- 172.21.15.172:0/3972083097 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff69c066e30 0x7ff69c0692e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0c97a0 tx=0x7ff6a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:39.888 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:39.889+0000 7ff6b2ffd700 1 -- 172.21.15.172:0/3972083097 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff6ac051000 con 0x7ff6bc0b0250 2023-03-27T10:10:40.308 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:40.308 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:40.308 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:40.310 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:40.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:40.316 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.2 2023-03-27T10:10:40.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:40.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.2 2023-03-27T10:10:40.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-03-27T10:10:40.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:40.402 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-03-27T10:10:40.443 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:40.444 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:40.490 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:40.491 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:40.573 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-27T10:10:40.574 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:10:40.657 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:40.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.844+0000 7f02225ff700 1 Processor -- start 2023-03-27T10:10:40.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.844+0000 7f02225ff700 1 -- start start 2023-03-27T10:10:40.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.845+0000 7f02225ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f021c0d0b90 0x7f021c0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:40.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.845+0000 7f02225ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0cebc0 con 0x7f021c15ca20 2023-03-27T10:10:40.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.845+0000 7f02225ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0ceea0 con 0x7f021c0cd610 2023-03-27T10:10:40.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.845+0000 7f02225ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0cf180 con 0x7f021c0d0b90 2023-03-27T10:10:40.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f021c0d0b90 0x7f021c0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:40.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f021c0d0b90 0x7f021c0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47142/0 (socket says 172.21.15.172:47142) 2023-03-27T10:10:40.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 -- 172.21.15.172:0/4233658395 learned_addr learned my addr 172.21.15.172:0/4233658395 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f0213fff700 1 --1- 172.21.15.172:0/4233658395 >> v1:172.21.15.172:6789/0 conn(0x7f021c15ca20 0x7f021c0d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47890/0 (socket says 172.21.15.172:47890) 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 -- 172.21.15.172:0/4233658395 >> v1:172.21.15.191:6789/0 conn(0x7f021c0cd610 legacy=0x7f021c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 -- 172.21.15.172:0/4233658395 >> v1:172.21.15.172:6789/0 conn(0x7f021c15ca20 legacy=0x7f021c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 -- 172.21.15.172:0/4233658395 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0cf460 con 0x7f021c0d0b90 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.846+0000 7f021bfff700 1 --2- 172.21.15.172:0/4233658395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0d0b90 0x7f021c0ce500 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098e0 tx=0x7f020c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5dbc6d568645ea server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f021b7fe700 1 -- 172.21.15.172:0/4233658395 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c004230 con 0x7f021c0d0b90 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f021b7fe700 1 -- 172.21.15.172:0/4233658395 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c004390 con 0x7f021c0d0b90 2023-03-27T10:10:40.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f021b7fe700 1 -- 172.21.15.172:0/4233658395 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0036a0 con 0x7f021c0d0b90 2023-03-27T10:10:40.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 -- 172.21.15.172:0/4233658395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0d0b90 msgr2=0x7f021c0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:40.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 --2- 172.21.15.172:0/4233658395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0d0b90 0x7f021c0ce500 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098e0 tx=0x7f020c009bf0 comp rx=0 tx=0).stop 2023-03-27T10:10:40.847 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 -- 172.21.15.172:0/4233658395 shutdown_connections 2023-03-27T10:10:40.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 --2- 172.21.15.172:0/4233658395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0d0b90 0x7f021c0ce500 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:40.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 -- 172.21.15.172:0/4233658395 >> 172.21.15.172:0/4233658395 conn(0x7f021c0721f0 msgr2=0x7f021c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:40.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 -- 172.21.15.172:0/4233658395 shutdown_connections 2023-03-27T10:10:40.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.847+0000 7f02225ff700 1 -- 172.21.15.172:0/4233658395 wait complete. 2023-03-27T10:10:40.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.849+0000 7f02225ff700 1 Processor -- start 2023-03-27T10:10:40.848 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.849+0000 7f02225ff700 1 -- start start 2023-03-27T10:10:40.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f02225ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f021c0cd610 0x7f021c0b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:40.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f02225ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f021c0d0b90 0x7f021c0b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:40.850 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f02225ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 0x7f021c0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:40.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f02225ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b7f10 con 0x7f021c15ca20 2023-03-27T10:10:40.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f02225ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b6ee0 con 0x7f021c0d0b90 2023-03-27T10:10:40.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f02225ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b7150 con 0x7f021c0cd610 2023-03-27T10:10:40.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f0220b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 0x7f021c0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:40.851 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f0220b9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 0x7f021c0d2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47154/0 (socket says 172.21.15.172:47154) 2023-03-27T10:10:40.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f0220b9c700 1 -- 172.21.15.172:0/504397652 learned_addr learned my addr 172.21.15.172:0/504397652 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:40.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f0213fff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f021c0d0b90 0x7f021c0b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:40.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.850+0000 7f021bfff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f021c0cd610 0x7f021c0b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:40.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f0220b9c700 1 -- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f021c0cd610 msgr2=0x7f021c0b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:40.852 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f0220b9c700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f021c0cd610 0x7f021c0b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f0220b9c700 1 -- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f021c0d0b90 msgr2=0x7f021c0b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f0220b9c700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f021c0d0b90 0x7f021c0b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f0220b9c700 1 -- 172.21.15.172:0/504397652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0094f0 con 0x7f021c15ca20 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f0220b9c700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 0x7f021c0d2ec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f021400cc10 tx=0x7f021400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400aa60 con 0x7f021c15ca20 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021400abc0 con 0x7f021c15ca20 2023-03-27T10:10:40.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0d2d30 con 0x7f021c15ca20 2023-03-27T10:10:40.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.851+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214012420 con 0x7f021c15ca20 2023-03-27T10:10:40.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.852+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0afc50 con 0x7f021c15ca20 2023-03-27T10:10:40.854 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.852+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0b0880 con 0x7f021c15ca20 2023-03-27T10:10:40.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.853+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0214010050 con 0x7f021c15ca20 2023-03-27T10:10:40.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.854+0000 7f02197fa700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f01fc066e30 0x7f01fc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:40.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.854+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0214084400 con 0x7f021c15ca20 2023-03-27T10:10:40.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.855+0000 7f021bfff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f01fc066e30 0x7f01fc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:40.855 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.855+0000 7f021bfff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f01fc066e30 0x7f01fc0692e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098e0 tx=0x7f020c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:40.856 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:40.858+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f02140515a0 con 0x7f021c15ca20 2023-03-27T10:10:41.045 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.047+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021c074290 con 0x7f021c15ca20 2023-03-27T10:10:41.046 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.048+0000 7f02197fa700 1 -- 172.21.15.172:0/504397652 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f0214054bc0 con 0x7f021c15ca20 2023-03-27T10:10:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:41.047 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:32.667663+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:41.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.050+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f01fc066e30 msgr2=0x7f01fc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.050+0000 7f02225ff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f01fc066e30 0x7f01fc0692e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098e0 tx=0x7f020c008030 comp rx=0 tx=0).stop 2023-03-27T10:10:41.049 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.050+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 msgr2=0x7f021c0d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.050+0000 7f02225ff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 0x7f021c0d2ec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f021400cc10 tx=0x7f021400cf20 comp rx=0 tx=0).stop 2023-03-27T10:10:41.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 shutdown_connections 2023-03-27T10:10:41.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c15ca20 0x7f021c0d2ec0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f021c0cd610 0x7f021c0b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f01fc066e30 0x7f01fc0692e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 --2- 172.21.15.172:0/504397652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f021c0d0b90 0x7f021c0b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 >> 172.21.15.172:0/504397652 conn(0x7f021c0721f0 msgr2=0x7f021c0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:41.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 shutdown_connections 2023-03-27T10:10:41.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.051+0000 7f02225ff700 1 -- 172.21.15.172:0/504397652 wait complete. 2023-03-27T10:10:41.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:41.067 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.254+0000 7fd6187ff700 1 Processor -- start 2023-03-27T10:10:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.254+0000 7fd6187ff700 1 -- start start 2023-03-27T10:10:41.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.255+0000 7fd6187ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd610159a00 0x7fd6100c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.255+0000 7fd6187ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd6100ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.255+0000 7fd6187ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61015d3d0 con 0x7fd61015d720 2023-03-27T10:10:41.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.255+0000 7fd6187ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61015e450 con 0x7fd610159a00 2023-03-27T10:10:41.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.255+0000 7fd6187ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610070050 con 0x7fd61015b0f0 2023-03-27T10:10:41.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd610159a00 0x7fd6100c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd610159a00 0x7fd6100c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47158/0 (socket says 172.21.15.172:47158) 2023-03-27T10:10:41.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 -- 172.21.15.172:0/3375915545 learned_addr learned my addr 172.21.15.172:0/3375915545 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:41.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd616d9c700 1 --1- 172.21.15.172:0/3375915545 >> v1:172.21.15.172:6789/0 conn(0x7fd61015d720 0x7fd61015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47892/0 (socket says 172.21.15.172:47892) 2023-03-27T10:10:41.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd615d9a700 1 --2- 172.21.15.172:0/3375915545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd6100ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 -- 172.21.15.172:0/3375915545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 msgr2=0x7fd6100ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 --2- 172.21.15.172:0/3375915545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd6100ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 -- 172.21.15.172:0/3375915545 >> v1:172.21.15.172:6789/0 conn(0x7fd61015d720 legacy=0x7fd61015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 -- 172.21.15.172:0/3375915545 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610070330 con 0x7fd610159a00 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd61659b700 1 --2- 172.21.15.172:0/3375915545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd6100c9b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098f0 tx=0x7fd60c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310b08a7529eec86 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.256+0000 7fd615599700 1 -- 172.21.15.172:0/3375915545 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00b8a0 con 0x7fd610159a00 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd615599700 1 -- 172.21.15.172:0/3375915545 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00ba00 con 0x7fd610159a00 2023-03-27T10:10:41.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd615599700 1 -- 172.21.15.172:0/3375915545 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00bd90 con 0x7fd610159a00 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 -- 172.21.15.172:0/3375915545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 msgr2=0x7fd6100c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 --2- 172.21.15.172:0/3375915545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd6100c9b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0098f0 tx=0x7fd60c009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 -- 172.21.15.172:0/3375915545 shutdown_connections 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 --2- 172.21.15.172:0/3375915545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd6100c9b70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 --2- 172.21.15.172:0/3375915545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd6100ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 -- 172.21.15.172:0/3375915545 >> 172.21.15.172:0/3375915545 conn(0x7fd61006a1a0 msgr2=0x7fd61006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 -- 172.21.15.172:0/3375915545 shutdown_connections 2023-03-27T10:10:41.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.257+0000 7fd6187ff700 1 -- 172.21.15.172:0/3375915545 wait complete. 2023-03-27T10:10:41.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.259+0000 7fd6187ff700 1 Processor -- start 2023-03-27T10:10:41.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.260+0000 7fd6187ff700 1 -- start start 2023-03-27T10:10:41.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd6187ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd610155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd6187ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd610153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd6187ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd61015d720 0x7fd6101e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd6187ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610154880 con 0x7fd610159a00 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd6187ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6101539a0 con 0x7fd61015d720 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd6187ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610153c00 con 0x7fd61015b0f0 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd61659b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd610155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd61659b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd610155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47170/0 (socket says 172.21.15.172:47170) 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd61659b700 1 -- 172.21.15.172:0/1656327629 learned_addr learned my addr 172.21.15.172:0/1656327629 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd615d9a700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd610153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.261+0000 7fd616d9c700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd61015d720 0x7fd6101e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd61659b700 1 -- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 msgr2=0x7fd610153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd61659b700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd610153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd61659b700 1 -- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd61015d720 msgr2=0x7fd6101e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd61659b700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd61015d720 0x7fd6101e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd61659b700 1 -- 172.21.15.172:0/1656327629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009550 con 0x7fd610159a00 2023-03-27T10:10:41.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd61659b700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd610155e60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd60c000c00 tx=0x7fd60c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:41.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004380 con 0x7fd610159a00 2023-03-27T10:10:41.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c01f070 con 0x7fd610159a00 2023-03-27T10:10:41.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0036a0 con 0x7fd610159a00 2023-03-27T10:10:41.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6100708f0 con 0x7fd610159a00 2023-03-27T10:10:41.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.262+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd610070610 con 0x7fd610159a00 2023-03-27T10:10:41.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.263+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd610159dd0 con 0x7fd610159a00 2023-03-27T10:10:41.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.264+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd60c02a020 con 0x7fd610159a00 2023-03-27T10:10:41.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.265+0000 7fd606ffd700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd5f4066e30 0x7fd5f40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.265+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd60c0857f0 con 0x7fd610159a00 2023-03-27T10:10:41.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.265+0000 7fd615d9a700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd5f4066e30 0x7fd5f40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.266+0000 7fd615d9a700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd5f4066e30 0x7fd5f40692e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd6100c55d0 tx=0x7fd600008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:41.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.269+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd60c0529f0 con 0x7fd610159a00 2023-03-27T10:10:41.455 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.457+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd610074300 con 0x7fd610159a00 2023-03-27T10:10:41.456 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.458+0000 7fd606ffd700 1 -- 172.21.15.172:0/1656327629 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd60c015020 con 0x7fd610159a00 2023-03-27T10:10:41.456 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:41.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd5f4066e30 msgr2=0x7fd5f40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.458 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd5f4066e30 0x7fd5f40692e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd6100c55d0 tx=0x7fd600008040 comp rx=0 tx=0).stop 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 msgr2=0x7fd610155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd610155e60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd60c000c00 tx=0x7fd60c004750 comp rx=0 tx=0).stop 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 shutdown_connections 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd5f4066e30 0x7fd5f40692e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd61015d720 0x7fd6101e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd610159a00 0x7fd610155e60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.459 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 --2- 172.21.15.172:0/1656327629 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd61015b0f0 0x7fd610153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 >> 172.21.15.172:0/1656327629 conn(0x7fd61006a1a0 msgr2=0x7fd6100b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:41.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 shutdown_connections 2023-03-27T10:10:41.460 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.460+0000 7fd6187ff700 1 -- 172.21.15.172:0/1656327629 wait complete. 2023-03-27T10:10:41.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:41.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.664+0000 7fbd403ff700 1 Processor -- start 2023-03-27T10:10:41.663 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.664+0000 7fbd403ff700 1 -- start start 2023-03-27T10:10:41.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.665+0000 7fbd403ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd3815a240 0x7fbd380d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.665+0000 7fbd403ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd380d3a30 0x7fbd380d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.665+0000 7fbd403ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd380d29d0 con 0x7fbd381604b0 2023-03-27T10:10:41.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.665+0000 7fbd403ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd38161020 con 0x7fbd3815a240 2023-03-27T10:10:41.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.665+0000 7fbd403ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38161200 con 0x7fbd380d3a30 2023-03-27T10:10:41.667 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd3815a240 0x7fbd380d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e99c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbd381604b0 0x7fbd38160910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47900/0 (socket says 172.21.15.172:47900) 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd3815a240 0x7fbd380d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47172/0 (socket says 172.21.15.172:47172) 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e99c700 1 -- 172.21.15.172:0/1007811534 learned_addr learned my addr 172.21.15.172:0/1007811534 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3d99a700 1 --2- 172.21.15.172:0/1007811534 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd380d3a30 0x7fbd380d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1007811534 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd380d3a30 msgr2=0x7fbd380d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 --2- 172.21.15.172:0/1007811534 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd380d3a30 0x7fbd380d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1007811534 >> v1:172.21.15.172:6789/0 conn(0x7fbd381604b0 legacy=0x7fbd38160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3d199700 1 -- 172.21.15.172:0/1007811534 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808404207 0 0) 0x7fbd380d29d0 con 0x7fbd381604b0 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1007811534 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3815a610 con 0x7fbd3815a240 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.666+0000 7fbd3e19b700 1 --2- 172.21.15.172:0/1007811534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd3815a240 0x7fbd380d0ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009840 tx=0x7fbd34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8795a2c2c3c44e7 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd3d199700 1 -- 172.21.15.172:0/1007811534 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34011830 con 0x7fbd3815a240 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd3d199700 1 -- 172.21.15.172:0/1007811534 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34011990 con 0x7fbd3815a240 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd3d199700 1 -- 172.21.15.172:0/1007811534 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34011d20 con 0x7fbd3815a240 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 -- 172.21.15.172:0/1007811534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd3815a240 msgr2=0x7fbd380d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1007811534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd3815a240 0x7fbd380d0ac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009840 tx=0x7fbd34009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 -- 172.21.15.172:0/1007811534 shutdown_connections 2023-03-27T10:10:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1007811534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd3815a240 0x7fbd380d0ac0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1007811534 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd380d3a30 0x7fbd380d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 -- 172.21.15.172:0/1007811534 >> 172.21.15.172:0/1007811534 conn(0x7fbd380721f0 msgr2=0x7fbd3809c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 -- 172.21.15.172:0/1007811534 shutdown_connections 2023-03-27T10:10:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.667+0000 7fbd403ff700 1 -- 172.21.15.172:0/1007811534 wait complete. 2023-03-27T10:10:41.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.669+0000 7fbd403ff700 1 Processor -- start 2023-03-27T10:10:41.672 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.669+0000 7fbd403ff700 1 -- start start 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd403ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 0x7fbd3814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd403ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd3815a240 0x7fbd3815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd403ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd381604b0 0x7fbd381568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd403ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380b7f50 con 0x7fbd380d3a30 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd403ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380b72d0 con 0x7fbd381604b0 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd403ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380b75b0 con 0x7fbd3815a240 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd3e19b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 0x7fbd3814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd3e19b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 0x7fbd3814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47188/0 (socket says 172.21.15.172:47188) 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1177426935 learned_addr learned my addr 172.21.15.172:0/1177426935 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd3d99a700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd3815a240 0x7fbd3815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.670+0000 7fbd3e99c700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd381604b0 0x7fbd381568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd3815a240 msgr2=0x7fbd3815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3e19b700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd3815a240 0x7fbd3815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd381604b0 msgr2=0x7fbd381568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3e19b700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd381604b0 0x7fbd381568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3e19b700 1 -- 172.21.15.172:0/1177426935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340094a0 con 0x7fbd380d3a30 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3d99a700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd3815a240 0x7fbd3815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd3e19b700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 0x7fbd3814e3b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd340090b0 tx=0x7fbd34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340038a0 con 0x7fbd380d3a30 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3401f070 con 0x7fbd380d3a30 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd380d2f50 con 0x7fbd380d3a30 2023-03-27T10:10:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34003c20 con 0x7fbd380d3a30 2023-03-27T10:10:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.671+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd380d2c70 con 0x7fbd380d3a30 2023-03-27T10:10:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.672+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd380d3230 con 0x7fbd380d3a30 2023-03-27T10:10:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.673+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fbd3400f050 con 0x7fbd380d3a30 2023-03-27T10:10:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.674+0000 7fbd2effd700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd1c066e30 0x7fbd1c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.674+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbd34021070 con 0x7fbd380d3a30 2023-03-27T10:10:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.674+0000 7fbd3d99a700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd1c066e30 0x7fbd1c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:41.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.675+0000 7fbd3d99a700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd1c066e30 0x7fbd1c0692e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbd3815c130 tx=0x7fbd28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:41.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.678+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fbd34052ef0 con 0x7fbd380d3a30 2023-03-27T10:10:41.867 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.869+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbd380b8090 con 0x7fbd380d3a30 2023-03-27T10:10:41.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.869+0000 7fbd2effd700 1 -- 172.21.15.172:0/1177426935 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbd340150a0 con 0x7fbd380d3a30 2023-03-27T10:10:41.868 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:41.870 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd1c066e30 msgr2=0x7fbd1c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.870 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd1c066e30 0x7fbd1c0692e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbd3815c130 tx=0x7fbd28008040 comp rx=0 tx=0).stop 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 msgr2=0x7fbd3814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 0x7fbd3814e3b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd340090b0 tx=0x7fbd34004750 comp rx=0 tx=0).stop 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 shutdown_connections 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fbd1c066e30 0x7fbd1c0692e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd381604b0 0x7fbd381568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd380d3a30 0x7fbd3814e3b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.871 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 --2- 172.21.15.172:0/1177426935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd3815a240 0x7fbd3815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:41.872 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 >> 172.21.15.172:0/1177426935 conn(0x7fbd380721f0 msgr2=0x7fbd381584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:41.872 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 shutdown_connections 2023-03-27T10:10:41.872 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:41.872+0000 7fbd403ff700 1 -- 172.21.15.172:0/1177426935 wait complete. 2023-03-27T10:10:41.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:42.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.075+0000 7f96651ff700 1 Processor -- start 2023-03-27T10:10:42.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.075+0000 7f96651ff700 1 -- start start 2023-03-27T10:10:42.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.076+0000 7f96651ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96600b1700 0x7f96600d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.076+0000 7f96651ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f96600d02c0 0x7f96600d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.076+0000 7f96651ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96600d0880 con 0x7f96600b2020 2023-03-27T10:10:42.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.076+0000 7f96651ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96600cd680 con 0x7f96600b1700 2023-03-27T10:10:42.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.076+0000 7f96651ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96600cd960 con 0x7f96600d02c0 2023-03-27T10:10:42.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96600b1700 0x7f96600d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96600b1700 0x7f96600d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47196/0 (socket says 172.21.15.172:47196) 2023-03-27T10:10:42.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 -- 172.21.15.172:0/1928413539 learned_addr learned my addr 172.21.15.172:0/1928413539 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:42.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 -- 172.21.15.172:0/1928413539 >> v2:172.21.15.191:3300/0 conn(0x7f96600d02c0 msgr2=0x7f96600d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:42.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 --2- 172.21.15.172:0/1928413539 >> v2:172.21.15.191:3300/0 conn(0x7f96600d02c0 0x7f96600d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 -- 172.21.15.172:0/1928413539 >> v1:172.21.15.191:6789/0 conn(0x7f96600b2020 legacy=0x7f9660160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:42.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 -- 172.21.15.172:0/1928413539 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96600cdc40 con 0x7f96600b1700 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.077+0000 7f965ed9d700 1 --2- 172.21.15.172:0/1928413539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600b1700 0x7f96600d0af0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f966008c390 tx=0x7f9650009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11459d4d9dd5d86 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f965e59c700 1 -- 172.21.15.172:0/1928413539 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650005e30 con 0x7f96600b1700 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f965e59c700 1 -- 172.21.15.172:0/1928413539 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650006030 con 0x7f96600b1700 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f965e59c700 1 -- 172.21.15.172:0/1928413539 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500063e0 con 0x7f96600b1700 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 -- 172.21.15.172:0/1928413539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600b1700 msgr2=0x7f96600d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 --2- 172.21.15.172:0/1928413539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600b1700 0x7f96600d0af0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f966008c390 tx=0x7f9650009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 -- 172.21.15.172:0/1928413539 shutdown_connections 2023-03-27T10:10:42.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 --2- 172.21.15.172:0/1928413539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600b1700 0x7f96600d0af0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 --2- 172.21.15.172:0/1928413539 >> v2:172.21.15.191:3300/0 conn(0x7f96600d02c0 0x7f96600d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 -- 172.21.15.172:0/1928413539 >> 172.21.15.172:0/1928413539 conn(0x7f966009c260 msgr2=0x7f96600d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:42.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 -- 172.21.15.172:0/1928413539 shutdown_connections 2023-03-27T10:10:42.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.078+0000 7f96651ff700 1 -- 172.21.15.172:0/1928413539 wait complete. 2023-03-27T10:10:42.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.081+0000 7f96651ff700 1 Processor -- start 2023-03-27T10:10:42.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.081+0000 7f96651ff700 1 -- start start 2023-03-27T10:10:42.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f96651ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96600b1700 0x7f96600b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f96651ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96600b2020 0x7f966015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f96651ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 0x7f966015d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f96651ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9660149f00 con 0x7f96600d02c0 2023-03-27T10:10:42.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f96651ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96600b4da0 con 0x7f96600b1700 2023-03-27T10:10:42.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f96651ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96600b3d00 con 0x7f96600b2020 2023-03-27T10:10:42.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f965f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 0x7f966015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f965f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 0x7f966015d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47210/0 (socket says 172.21.15.172:47210) 2023-03-27T10:10:42.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f965f59e700 1 -- 172.21.15.172:0/2420814175 learned_addr learned my addr 172.21.15.172:0/2420814175 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:42.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.082+0000 7f965ed9d700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96600b1700 0x7f96600b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f9657fff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96600b2020 0x7f966015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f965f59e700 1 -- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96600b2020 msgr2=0x7f966015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f965f59e700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96600b2020 0x7f966015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f965f59e700 1 -- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96600b1700 msgr2=0x7f96600b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f965f59e700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96600b1700 0x7f96600b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f965f59e700 1 -- 172.21.15.172:0/2420814175 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009500 con 0x7f96600d02c0 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f965f59e700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 0x7f966015d240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f965800b990 tx=0x7f965800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800d890 con 0x7f96600d02c0 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965800d9f0 con 0x7f96600d02c0 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800dda0 con 0x7f96600d02c0 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.083+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96600cf450 con 0x7f96600d02c0 2023-03-27T10:10:42.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.084+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96600cdf20 con 0x7f96600d02c0 2023-03-27T10:10:42.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.085+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96600afb50 con 0x7f96600d02c0 2023-03-27T10:10:42.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.086+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f965800e460 con 0x7f96600d02c0 2023-03-27T10:10:42.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.086+0000 7f96577fe700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9640066e30 0x7f96400692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.087+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9658084500 con 0x7f96600d02c0 2023-03-27T10:10:42.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.087+0000 7f965ed9d700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9640066e30 0x7f96400692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.087+0000 7f965ed9d700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9640066e30 0x7f96400692e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f966008c390 tx=0x7f9650008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.090+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f9658051840 con 0x7f96600d02c0 2023-03-27T10:10:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.278+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9660074300 con 0x7f96600d02c0 2023-03-27T10:10:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.279+0000 7f96577fe700 1 -- 172.21.15.172:0/2420814175 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9658054e60 con 0x7f96600d02c0 2023-03-27T10:10:42.277 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9640066e30 msgr2=0x7f96400692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9640066e30 0x7f96400692e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f966008c390 tx=0x7f9650008070 comp rx=0 tx=0).stop 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 msgr2=0x7f966015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 0x7f966015d240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f965800b990 tx=0x7f965800bca0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 shutdown_connections 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96600d02c0 0x7f966015d240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f9640066e30 0x7f96400692e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96600b1700 0x7f96600b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 --2- 172.21.15.172:0/2420814175 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96600b2020 0x7f966015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 >> 172.21.15.172:0/2420814175 conn(0x7f966009c260 msgr2=0x7f96600b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 shutdown_connections 2023-03-27T10:10:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.281+0000 7f96651ff700 1 -- 172.21.15.172:0/2420814175 wait complete. 2023-03-27T10:10:42.297 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:42.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.488+0000 7f44721ff700 1 Processor -- start 2023-03-27T10:10:42.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.488+0000 7f44721ff700 1 -- start start 2023-03-27T10:10:42.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f44721ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c15c620 0x7f446c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f44721ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f446c06b2b0 0x7f446c06b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f44721ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0cc780 con 0x7f446c0cb400 2023-03-27T10:10:42.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f44721ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c06bc70 con 0x7f446c06b2b0 2023-03-27T10:10:42.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f44721ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15c9f0 con 0x7f446c15c620 2023-03-27T10:10:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f446bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f446c06b2b0 0x7f446c06b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f446affd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f446c0cb400 0x7f446c0ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47906/0 (socket says 172.21.15.172:47906) 2023-03-27T10:10:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f446bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f446c06b2b0 0x7f446c06b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47216/0 (socket says 172.21.15.172:47216) 2023-03-27T10:10:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f446affd700 1 -- 172.21.15.172:0/3608418451 learned_addr learned my addr 172.21.15.172:0/3608418451 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.489+0000 7f446b7fe700 1 --2- 172.21.15.172:0/3608418451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c15c620 0x7f446c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446bfff700 1 -- 172.21.15.172:0/3608418451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c15c620 msgr2=0x7f446c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446bfff700 1 --2- 172.21.15.172:0/3608418451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c15c620 0x7f446c0ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446bfff700 1 -- 172.21.15.172:0/3608418451 >> v1:172.21.15.172:6789/0 conn(0x7f446c0cb400 legacy=0x7f446c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446bfff700 1 -- 172.21.15.172:0/3608418451 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0cbb70 con 0x7f446c06b2b0 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446a7fc700 1 -- 172.21.15.172:0/3608418451 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718408963 0 0) 0x7f446c0cc780 con 0x7f446c0cb400 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446bfff700 1 --2- 172.21.15.172:0/3608418451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c06b2b0 0x7f446c06b730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4464009d90 tx=0x7f446400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce170209596e3f server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446a7fc700 1 -- 172.21.15.172:0/3608418451 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400e070 con 0x7f446c06b2b0 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446a7fc700 1 -- 172.21.15.172:0/3608418451 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400bb20 con 0x7f446c06b2b0 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.490+0000 7f446a7fc700 1 -- 172.21.15.172:0/3608418451 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464012430 con 0x7f446c06b2b0 2023-03-27T10:10:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 -- 172.21.15.172:0/3608418451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c06b2b0 msgr2=0x7f446c06b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 --2- 172.21.15.172:0/3608418451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c06b2b0 0x7f446c06b730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4464009d90 tx=0x7f446400b330 comp rx=0 tx=0).stop 2023-03-27T10:10:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 -- 172.21.15.172:0/3608418451 shutdown_connections 2023-03-27T10:10:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 --2- 172.21.15.172:0/3608418451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c06b2b0 0x7f446c06b730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 --2- 172.21.15.172:0/3608418451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c15c620 0x7f446c0ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 -- 172.21.15.172:0/3608418451 >> 172.21.15.172:0/3608418451 conn(0x7f446c072230 msgr2=0x7f446c06aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:42.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 -- 172.21.15.172:0/3608418451 shutdown_connections 2023-03-27T10:10:42.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.491+0000 7f44721ff700 1 -- 172.21.15.172:0/3608418451 wait complete. 2023-03-27T10:10:42.493 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.493+0000 7f44721ff700 1 Processor -- start 2023-03-27T10:10:42.494 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.493+0000 7f44721ff700 1 -- start start 2023-03-27T10:10:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f44721ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c06b2b0 0x7f446c1f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f44721ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f446c0cb400 0x7f446c1e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f44721ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 0x7f446c1e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f44721ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c144910 con 0x7f446c15c620 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f44721ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c145490 con 0x7f446c0cb400 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f44721ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1f1c90 con 0x7f446c06b2b0 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 0x7f446c1e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 0x7f446c1e7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47224/0 (socket says 172.21.15.172:47224) 2023-03-27T10:10:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 -- 172.21.15.172:0/3707210680 learned_addr learned my addr 172.21.15.172:0/3707210680 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446b7fe700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c06b2b0 0x7f446c1f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446affd700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f446c0cb400 0x7f446c1e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 -- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c06b2b0 msgr2=0x7f446c1f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c06b2b0 0x7f446c1f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 -- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f446c0cb400 msgr2=0x7f446c1e75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f446c0cb400 0x7f446c1e75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.495+0000 7f446bfff700 1 -- 172.21.15.172:0/3707210680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009a70 con 0x7f446c15c620 2023-03-27T10:10:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.496+0000 7f446bfff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 0x7f446c1e7b20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f446c071700 tx=0x7f4464004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.496+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464012430 con 0x7f446c15c620 2023-03-27T10:10:42.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.496+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464020070 con 0x7f446c15c620 2023-03-27T10:10:42.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.496+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0cc130 con 0x7f446c15c620 2023-03-27T10:10:42.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.496+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464004280 con 0x7f446c15c620 2023-03-27T10:10:42.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.496+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0cbe50 con 0x7f446c15c620 2023-03-27T10:10:42.498 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.497+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0cc410 con 0x7f446c15c620 2023-03-27T10:10:42.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.498+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f446402e070 con 0x7f446c15c620 2023-03-27T10:10:42.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.499+0000 7f4453fff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4458066e30 0x7f44580692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.499+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4464022070 con 0x7f446c15c620 2023-03-27T10:10:42.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.499+0000 7f446b7fe700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4458066e30 0x7f44580692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.500+0000 7f446b7fe700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4458066e30 0x7f44580692e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f445c009bc0 tx=0x7f445c0091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.501 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.503+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f44640530f0 con 0x7f446c15c620 2023-03-27T10:10:42.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.693+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f446c145600 con 0x7f446c15c620 2023-03-27T10:10:42.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.693+0000 7f4453fff700 1 -- 172.21.15.172:0/3707210680 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f446402c020 con 0x7f446c15c620 2023-03-27T10:10:42.692 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:42.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.695+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4458066e30 msgr2=0x7f44580692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.695+0000 7f44721ff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4458066e30 0x7f44580692e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f445c009bc0 tx=0x7f445c0091c0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 msgr2=0x7f446c1e7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 0x7f446c1e7b20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f446c071700 tx=0x7f4464004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 shutdown_connections 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f446c15c620 0x7f446c1e7b20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f446c06b2b0 0x7f446c1f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f4458066e30 0x7f44580692e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 --2- 172.21.15.172:0/3707210680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f446c0cb400 0x7f446c1e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 >> 172.21.15.172:0/3707210680 conn(0x7f446c072230 msgr2=0x7f446c0c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:42.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 shutdown_connections 2023-03-27T10:10:42.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.696+0000 7f44721ff700 1 -- 172.21.15.172:0/3707210680 wait complete. 2023-03-27T10:10:42.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blocklist ls' 2023-03-27T10:10:42.893 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.895+0000 7fe9d7fff700 1 Processor -- start 2023-03-27T10:10:42.893 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.895+0000 7fe9d7fff700 1 -- start start 2023-03-27T10:10:42.894 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d7fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe9d015ca20 0x7fe9d00ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.894 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d7fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d00cebc0 con 0x7fe9d00d0b90 2023-03-27T10:10:42.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d7fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d00ceea0 con 0x7fe9d00cd610 2023-03-27T10:10:42.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d7fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00cf180 con 0x7fe9d015ca20 2023-03-27T10:10:42.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d5d9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe9d00d0b90 0x7fe9d00d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47920/0 (socket says 172.21.15.172:47920) 2023-03-27T10:10:42.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d5d9b700 1 -- 172.21.15.172:0/2778719488 learned_addr learned my addr 172.21.15.172:0/2778719488 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:42.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.896+0000 7fe9d559a700 1 --2- 172.21.15.172:0/2778719488 >> v2:172.21.15.191:3300/0 conn(0x7fe9d015ca20 0x7fe9d00ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752061201 0 0) 0x7fe9d00cebc0 con 0x7fe9d00d0b90 2023-03-27T10:10:42.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9bc0035b0 con 0x7fe9d00d0b90 2023-03-27T10:10:42.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901655126 0 0) 0x7fe9d00ceea0 con 0x7fe9d00cd610 2023-03-27T10:10:42.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d00cebc0 con 0x7fe9d00cd610 2023-03-27T10:10:42.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1929418497 0 0) 0x7fe9bc0035b0 con 0x7fe9d00d0b90 2023-03-27T10:10:42.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d559a700 1 -- 172.21.15.172:0/2778719488 >> v1:172.21.15.191:6789/0 conn(0x7fe9d00cd610 legacy=0x7fe9d00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d559a700 1 -- 172.21.15.172:0/2778719488 >> v1:172.21.15.172:6789/0 conn(0x7fe9d00d0b90 legacy=0x7fe9d00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d559a700 1 -- 172.21.15.172:0/2778719488 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00cf460 con 0x7fe9d015ca20 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.897+0000 7fe9d559a700 1 --2- 172.21.15.172:0/2778719488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d015ca20 0x7fe9d00ce500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009840 tx=0x7fe9c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd52697a65cefc4c server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0017f0 con 0x7fe9d015ca20 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0004030 con 0x7fe9d015ca20 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d4d99700 1 -- 172.21.15.172:0/2778719488 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00043c0 con 0x7fe9d015ca20 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 -- 172.21.15.172:0/2778719488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d015ca20 msgr2=0x7fe9d00ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 --2- 172.21.15.172:0/2778719488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d015ca20 0x7fe9d00ce500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009840 tx=0x7fe9c0009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 -- 172.21.15.172:0/2778719488 shutdown_connections 2023-03-27T10:10:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 --2- 172.21.15.172:0/2778719488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d015ca20 0x7fe9d00ce500 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 -- 172.21.15.172:0/2778719488 >> 172.21.15.172:0/2778719488 conn(0x7fe9d00721f0 msgr2=0x7fe9d009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 -- 172.21.15.172:0/2778719488 shutdown_connections 2023-03-27T10:10:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.898+0000 7fe9d7fff700 1 -- 172.21.15.172:0/2778719488 wait complete. 2023-03-27T10:10:42.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.900+0000 7fe9d7fff700 1 Processor -- start 2023-03-27T10:10:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.900+0000 7fe9d7fff700 1 -- start start 2023-03-27T10:10:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d00cd610 0x7fe9d00b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9d00d0b90 0x7fe9d01f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9d015ca20 0x7fe9d00b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d7fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00b87a0 con 0x7fe9d015ca20 2023-03-27T10:10:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d7fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01f64c0 con 0x7fe9d00cd610 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d7fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01f5f00 con 0x7fe9d00d0b90 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9d015ca20 0x7fe9d00b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9d015ca20 0x7fe9d00b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47230/0 (socket says 172.21.15.172:47230) 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.901+0000 7fe9d659c700 1 -- 172.21.15.172:0/1568995607 learned_addr learned my addr 172.21.15.172:0/1568995607 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d559a700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9d00d0b90 0x7fe9d01f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d5d9b700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d00cd610 0x7fe9d00b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d659c700 1 -- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9d00d0b90 msgr2=0x7fe9d01f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d659c700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe9d00d0b90 0x7fe9d01f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d659c700 1 -- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d00cd610 msgr2=0x7fe9d00b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d659c700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe9d00cd610 0x7fe9d00b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d659c700 1 -- 172.21.15.172:0/1568995607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00094a0 con 0x7fe9d015ca20 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d659c700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9d015ca20 0x7fe9d00b21b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800cc20 tx=0x7fe9c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9c67fc700 1 -- 172.21.15.172:0/1568995607 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c800ac20 con 0x7fe9d015ca20 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9c67fc700 1 -- 172.21.15.172:0/1568995607 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c800ad80 con 0x7fe9d015ca20 2023-03-27T10:10:42.904 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d7fff700 1 -- 172.21.15.172:0/1568995607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00d2d30 con 0x7fe9d015ca20 2023-03-27T10:10:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9c67fc700 1 -- 172.21.15.172:0/1568995607 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8003c20 con 0x7fe9d015ca20 2023-03-27T10:10:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.902+0000 7fe9d7fff700 1 -- 172.21.15.172:0/1568995607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d00afc50 con 0x7fe9d015ca20 2023-03-27T10:10:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.903+0000 7fe9d7fff700 1 -- 172.21.15.172:0/1568995607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d00b0880 con 0x7fe9d015ca20 2023-03-27T10:10:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.904+0000 7fe9c67fc700 1 -- 172.21.15.172:0/1568995607 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe9c8010050 con 0x7fe9d015ca20 2023-03-27T10:10:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.905+0000 7fe9c67fc700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe9b4066e30 0x7fe9b40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.905+0000 7fe9c67fc700 1 -- 172.21.15.172:0/1568995607 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe9c8084340 con 0x7fe9d015ca20 2023-03-27T10:10:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.906+0000 7fe9d5d9b700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe9b4066e30 0x7fe9b40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.906+0000 7fe9d5d9b700 1 --2- 172.21.15.172:0/1568995607 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe9b4066e30 0x7fe9b40692e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc001170 tx=0x7fe9cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:42.909+0000 7fe9c67fc700 1 -- 172.21.15.172:0/1568995607 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe9c8051540 con 0x7fe9d015ca20 2023-03-27T10:10:43.335 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:43.336 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:43.337 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:43.337 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:43.337 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:43.337 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:43.343 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:43.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph 'osd blacklist ls' 2023-03-27T10:10:43.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.530+0000 7fc3c89ff700 1 Processor -- start 2023-03-27T10:10:43.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.530+0000 7fc3c89ff700 1 -- start start 2023-03-27T10:10:43.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c89ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c40d0b90 0x7fc3c40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:43.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c89ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc3c40cd610 0x7fc3c40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:43.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c89ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c40cebc0 con 0x7fc3c415ca20 2023-03-27T10:10:43.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c89ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40ceea0 con 0x7fc3c40d0b90 2023-03-27T10:10:43.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c89ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c40cf180 con 0x7fc3c40cd610 2023-03-27T10:10:43.531 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c40d0b90 0x7fc3c40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c40d0b90 0x7fc3c40ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47240/0 (socket says 172.21.15.172:47240) 2023-03-27T10:10:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 -- 172.21.15.172:0/2437487152 learned_addr learned my addr 172.21.15.172:0/2437487152 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 -- 172.21.15.172:0/2437487152 >> v2:172.21.15.191:3300/0 conn(0x7fc3c40cd610 msgr2=0x7fc3c40b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 --2- 172.21.15.172:0/2437487152 >> v2:172.21.15.191:3300/0 conn(0x7fc3c40cd610 0x7fc3c40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 -- 172.21.15.172:0/2437487152 >> v1:172.21.15.191:6789/0 conn(0x7fc3c415ca20 legacy=0x7fc3c40d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.532+0000 7fc3c259c700 1 -- 172.21.15.172:0/2437487152 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40cf460 con 0x7fc3c40d0b90 2023-03-27T10:10:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c259c700 1 --2- 172.21.15.172:0/2437487152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40d0b90 0x7fc3c40ce500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc3c408c720 tx=0x7fc3b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f4447f25ac9301 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c1d9b700 1 -- 172.21.15.172:0/2437487152 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4005e30 con 0x7fc3c40d0b90 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c1d9b700 1 -- 172.21.15.172:0/2437487152 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4006030 con 0x7fc3c40d0b90 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c1d9b700 1 -- 172.21.15.172:0/2437487152 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40063e0 con 0x7fc3c40d0b90 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c89ff700 1 -- 172.21.15.172:0/2437487152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40d0b90 msgr2=0x7fc3c40ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c89ff700 1 --2- 172.21.15.172:0/2437487152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40d0b90 0x7fc3c40ce500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc3c408c720 tx=0x7fc3b4009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c89ff700 1 -- 172.21.15.172:0/2437487152 shutdown_connections 2023-03-27T10:10:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c89ff700 1 --2- 172.21.15.172:0/2437487152 >> v2:172.21.15.191:3300/0 conn(0x7fc3c40cd610 0x7fc3c40b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c89ff700 1 --2- 172.21.15.172:0/2437487152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40d0b90 0x7fc3c40ce500 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.533+0000 7fc3c89ff700 1 -- 172.21.15.172:0/2437487152 >> 172.21.15.172:0/2437487152 conn(0x7fc3c40721f0 msgr2=0x7fc3c409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.534+0000 7fc3c89ff700 1 -- 172.21.15.172:0/2437487152 shutdown_connections 2023-03-27T10:10:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.534+0000 7fc3c89ff700 1 -- 172.21.15.172:0/2437487152 wait complete. 2023-03-27T10:10:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.536+0000 7fc3c89ff700 1 Processor -- start 2023-03-27T10:10:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.536+0000 7fc3c89ff700 1 -- start start 2023-03-27T10:10:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c89ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40cd610 0x7fc3c40b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c89ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3c40d0b90 0x7fc3c41f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c89ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c415ca20 0x7fc3c415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c89ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40ca090 con 0x7fc3c40cd610 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c89ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c41f6830 con 0x7fc3c415ca20 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c89ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c40b7e40 con 0x7fc3c40d0b90 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.537+0000 7fc3c259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40cd610 0x7fc3c40b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40cd610 0x7fc3c40b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47254/0 (socket says 172.21.15.172:47254) 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 -- 172.21.15.172:0/1168181023 learned_addr learned my addr 172.21.15.172:0/1168181023 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c2d9d700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c415ca20 0x7fc3c415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3bbfff700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3c40d0b90 0x7fc3c41f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:43.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 -- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3c40d0b90 msgr2=0x7fc3c41f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3c40d0b90 0x7fc3c41f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 -- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c415ca20 msgr2=0x7fc3c415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c415ca20 0x7fc3c415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 -- 172.21.15.172:0/1168181023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4009500 con 0x7fc3c40cd610 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c2d9d700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3c415ca20 0x7fc3c415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3bbfff700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3c40d0b90 0x7fc3c41f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:43.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c259c700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c40cd610 0x7fc3c40b77f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4006000 tx=0x7fc3b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:43.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3baffd700 1 -- 172.21.15.172:0/1168181023 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4025430 con 0x7fc3c40cd610 2023-03-27T10:10:43.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3baffd700 1 -- 172.21.15.172:0/1168181023 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4020070 con 0x7fc3c40cd610 2023-03-27T10:10:43.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3baffd700 1 -- 172.21.15.172:0/1168181023 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40257d0 con 0x7fc3c40cd610 2023-03-27T10:10:43.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.538+0000 7fc3c89ff700 1 -- 172.21.15.172:0/1168181023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c40d2d30 con 0x7fc3c40cd610 2023-03-27T10:10:43.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.539+0000 7fc3c89ff700 1 -- 172.21.15.172:0/1168181023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c40afc50 con 0x7fc3c40cd610 2023-03-27T10:10:43.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.540+0000 7fc3c89ff700 1 -- 172.21.15.172:0/1168181023 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c40b06b0 con 0x7fc3c40cd610 2023-03-27T10:10:43.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.540+0000 7fc3baffd700 1 -- 172.21.15.172:0/1168181023 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc3b402b020 con 0x7fc3c40cd610 2023-03-27T10:10:43.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.541+0000 7fc3baffd700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc3a4066e30 0x7fc3a40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:43.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.541+0000 7fc3baffd700 1 -- 172.21.15.172:0/1168181023 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc3b4085d60 con 0x7fc3c40cd610 2023-03-27T10:10:43.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.542+0000 7fc3bbfff700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc3a4066e30 0x7fc3a40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:43.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.542+0000 7fc3bbfff700 1 --2- 172.21.15.172:0/1168181023 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc3a4066e30 0x7fc3a40692e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006fd0 tx=0x7fc3ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:43.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:43.545+0000 7fc3baffd700 1 -- 172.21.15.172:0/1168181023 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc3b4052f60 con 0x7fc3c40cd610 2023-03-27T10:10:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:no valid command found; 10 closest matches: 2023-03-27T10:10:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:pg stat 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg getmap 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump [...] 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_json [...] 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_pools_json 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-pool [...] 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-primary [] [...] 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls-by-osd [] [...] 2023-03-27T10:10:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:pg ls [] [...] 2023-03-27T10:10:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:pg dump_stuck [...] [] 2023-03-27T10:10:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:Error EINVAL: invalid command 2023-03-27T10:10:43.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-03-27T10:10:43.965 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.3 2023-03-27T10:10:43.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:43.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.3 2023-03-27T10:10:44.055 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-03-27T10:10:44.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:10:44.056 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-03-27T10:10:44.100 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-03-27T10:10:44.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:10:44.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.291+0000 7fe48d3ff700 1 Processor -- start 2023-03-27T10:10:44.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.291+0000 7fe48d3ff700 1 -- start start 2023-03-27T10:10:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.292+0000 7fe48d3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe48815ca20 0x7fe4880ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.292+0000 7fe48d3ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4880cd610 0x7fe4880b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe48d3ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880cebc0 con 0x7fe4880d0b90 2023-03-27T10:10:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe48d3ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880ceea0 con 0x7fe4880cd610 2023-03-27T10:10:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe48d3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880cf180 con 0x7fe48815ca20 2023-03-27T10:10:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4880cd610 0x7fe4880b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4880cd610 0x7fe4880b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47264/0 (socket says 172.21.15.172:47264) 2023-03-27T10:10:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 -- 172.21.15.172:0/3884754416 learned_addr learned my addr 172.21.15.172:0/3884754416 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4867fc700 1 --2- 172.21.15.172:0/3884754416 >> v2:172.21.15.191:3300/0 conn(0x7fe48815ca20 0x7fe4880ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 -- 172.21.15.172:0/3884754416 >> v2:172.21.15.191:3300/0 conn(0x7fe48815ca20 msgr2=0x7fe4880ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:44.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 --2- 172.21.15.172:0/3884754416 >> v2:172.21.15.191:3300/0 conn(0x7fe48815ca20 0x7fe4880ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 -- 172.21.15.172:0/3884754416 >> v1:172.21.15.191:6789/0 conn(0x7fe4880d0b90 legacy=0x7fe4880d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 -- 172.21.15.172:0/3884754416 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880cf460 con 0x7fe4880cd610 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.293+0000 7fe4877fe700 1 --2- 172.21.15.172:0/3884754416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880cd610 0x7fe4880b0170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe488067930 tx=0x7fe48000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b797eb1e4f3d5bd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe485ffb700 1 -- 172.21.15.172:0/3884754416 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000e070 con 0x7fe4880cd610 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe485ffb700 1 -- 172.21.15.172:0/3884754416 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000b910 con 0x7fe4880cd610 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe485ffb700 1 -- 172.21.15.172:0/3884754416 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000bcc0 con 0x7fe4880cd610 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe48d3ff700 1 -- 172.21.15.172:0/3884754416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880cd610 msgr2=0x7fe4880b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.294 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/3884754416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880cd610 0x7fe4880b0170 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe488067930 tx=0x7fe48000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe48d3ff700 1 -- 172.21.15.172:0/3884754416 shutdown_connections 2023-03-27T10:10:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/3884754416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880cd610 0x7fe4880b0170 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/3884754416 >> v2:172.21.15.191:3300/0 conn(0x7fe48815ca20 0x7fe4880ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.294+0000 7fe48d3ff700 1 -- 172.21.15.172:0/3884754416 >> 172.21.15.172:0/3884754416 conn(0x7fe4880721f0 msgr2=0x7fe48809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.295+0000 7fe48d3ff700 1 -- 172.21.15.172:0/3884754416 shutdown_connections 2023-03-27T10:10:44.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.295+0000 7fe48d3ff700 1 -- 172.21.15.172:0/3884754416 wait complete. 2023-03-27T10:10:44.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.297+0000 7fe48d3ff700 1 Processor -- start 2023-03-27T10:10:44.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.297+0000 7fe48d3ff700 1 -- start start 2023-03-27T10:10:44.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.298+0000 7fe48d3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4880cd610 0x7fe488157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.298+0000 7fe48d3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 0x7fe4880c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.298+0000 7fe48d3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48815ca20 0x7fe48806bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.298+0000 7fe48d3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488158410 con 0x7fe4880d0b90 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.298+0000 7fe48d3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880cb650 con 0x7fe48815ca20 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.298+0000 7fe48d3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880cb930 con 0x7fe4880cd610 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 0x7fe4880c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 0x7fe4880c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47272/0 (socket says 172.21.15.172:47272) 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 -- 172.21.15.172:0/2325712510 learned_addr learned my addr 172.21.15.172:0/2325712510 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4877fe700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48815ca20 0x7fe48806bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe486ffd700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4880cd610 0x7fe488157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 -- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4880cd610 msgr2=0x7fe488157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4880cd610 0x7fe488157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 -- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48815ca20 msgr2=0x7fe48806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48815ca20 0x7fe48806bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 -- 172.21.15.172:0/2325712510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009b30 con 0x7fe4880d0b90 2023-03-27T10:10:44.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe4867fc700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 0x7fe4880c8fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e870 tx=0x7fe47c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.299+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c009590 con 0x7fe4880d0b90 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.300+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c013680 con 0x7fe4880d0b90 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.300+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0139f0 con 0x7fe4880d0b90 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.300+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4880d2d30 con 0x7fe4880d0b90 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.300+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4880afc50 con 0x7fe4880d0b90 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.301+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4880b06b0 con 0x7fe4880d0b90 2023-03-27T10:10:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.301+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe47c019030 con 0x7fe4880d0b90 2023-03-27T10:10:44.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.302+0000 7fe46f7fe700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe474066e60 0x7fe474069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.302+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe47c084140 con 0x7fe4880d0b90 2023-03-27T10:10:44.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.303+0000 7fe486ffd700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe474066e60 0x7fe474069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.303+0000 7fe486ffd700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe474066e60 0x7fe474069310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe478000fb0 tx=0x7fe478009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.306+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe47c051250 con 0x7fe4880d0b90 2023-03-27T10:10:44.536 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.538+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe488074290 con 0x7fe4880d0b90 2023-03-27T10:10:44.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.538+0000 7fe46f7fe700 1 -- 172.21.15.172:0/2325712510 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4624 (secure 0 0 0) 0x7fe47c054870 con 0x7fe4880d0b90 2023-03-27T10:10:44.537 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:44.537 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:09:52.070050+0000","modified":"2023-03-27T10:09:55.094484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-27T10:10:44.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe474066e60 msgr2=0x7fe474069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe474066e60 0x7fe474069310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe478000fb0 tx=0x7fe478009040 comp rx=0 tx=0).stop 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 msgr2=0x7fe4880c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 0x7fe4880c8fe0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e870 tx=0x7fe47c00eb80 comp rx=0 tx=0).stop 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 shutdown_connections 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe474066e60 0x7fe474069310 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48815ca20 0x7fe48806bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4880cd610 0x7fe488157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 --2- 172.21.15.172:0/2325712510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4880d0b90 0x7fe4880c8fe0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 >> 172.21.15.172:0/2325712510 conn(0x7fe4880721f0 msgr2=0x7fe48809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:44.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 shutdown_connections 2023-03-27T10:10:44.541 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.541+0000 7fe48d3ff700 1 -- 172.21.15.172:0/2325712510 wait complete. 2023-03-27T10:10:44.541 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2023-03-27T10:10:44.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:44.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.746+0000 7f2e4cfff700 1 Processor -- start 2023-03-27T10:10:44.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.746+0000 7f2e4cfff700 1 -- start start 2023-03-27T10:10:44.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.747+0000 7f2e4cfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e480afee0 0x7f2e48163d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e4cfff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e480c4290 con 0x7f2e48142680 2023-03-27T10:10:44.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e4cfff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e480c3cd0 con 0x7f2e480cbfc0 2023-03-27T10:10:44.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e4cfff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480c9a10 con 0x7f2e480afee0 2023-03-27T10:10:44.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e4659c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2e48142680 0x7f2e480c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47932/0 (socket says 172.21.15.172:47932) 2023-03-27T10:10:44.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e4659c700 1 -- 172.21.15.172:0/525472473 learned_addr learned my addr 172.21.15.172:0/525472473 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:44.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e46d9d700 1 --2- 172.21.15.172:0/525472473 >> v2:172.21.15.172:3300/0 conn(0x7f2e480afee0 0x7f2e48163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e46d9d700 1 -- 172.21.15.172:0/525472473 >> v1:172.21.15.191:6789/0 conn(0x7f2e480cbfc0 legacy=0x7f2e480af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e46d9d700 1 -- 172.21.15.172:0/525472473 >> v1:172.21.15.172:6789/0 conn(0x7f2e48142680 legacy=0x7f2e480c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e46d9d700 1 -- 172.21.15.172:0/525472473 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480c3fb0 con 0x7f2e480afee0 2023-03-27T10:10:44.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e4559a700 1 -- 172.21.15.172:0/525472473 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648625901 0 0) 0x7f2e480c4290 con 0x7f2e48142680 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.748+0000 7f2e46d9d700 1 --2- 172.21.15.172:0/525472473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480afee0 0x7f2e48163d30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000aea0 tx=0x7f2e4000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e52f886992b07e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4559a700 1 -- 172.21.15.172:0/525472473 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000f070 con 0x7f2e480afee0 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4559a700 1 -- 172.21.15.172:0/525472473 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000c9c0 con 0x7f2e480afee0 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4559a700 1 -- 172.21.15.172:0/525472473 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000cd70 con 0x7f2e480afee0 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 -- 172.21.15.172:0/525472473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480afee0 msgr2=0x7f2e48163d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/525472473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480afee0 0x7f2e48163d30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000aea0 tx=0x7f2e4000c330 comp rx=0 tx=0).stop 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 -- 172.21.15.172:0/525472473 shutdown_connections 2023-03-27T10:10:44.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/525472473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480afee0 0x7f2e48163d30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 -- 172.21.15.172:0/525472473 >> 172.21.15.172:0/525472473 conn(0x7f2e4806a1a0 msgr2=0x7f2e4806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:44.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 -- 172.21.15.172:0/525472473 shutdown_connections 2023-03-27T10:10:44.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.749+0000 7f2e4cfff700 1 -- 172.21.15.172:0/525472473 wait complete. 2023-03-27T10:10:44.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.751+0000 7f2e4cfff700 1 Processor -- start 2023-03-27T10:10:44.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.751+0000 7f2e4cfff700 1 -- start start 2023-03-27T10:10:44.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e4cfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e480afee0 0x7f2e480b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e4cfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480cbfc0 0x7f2e481f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e4cfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 0x7f2e481f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e4cfff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481f6bb0 con 0x7f2e48142680 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e4cfff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b3980 con 0x7f2e480cbfc0 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e4cfff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b3c60 con 0x7f2e480afee0 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.752+0000 7f2e46d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 0x7f2e481f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 0x7f2e481f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47296/0 (socket says 172.21.15.172:47296) 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 -- 172.21.15.172:0/1620438028 learned_addr learned my addr 172.21.15.172:0/1620438028 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:44.753 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e45d9b700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480cbfc0 0x7f2e481f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e4659c700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e480afee0 0x7f2e480b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 -- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e480afee0 msgr2=0x7f2e480b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e480afee0 0x7f2e480b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 -- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480cbfc0 msgr2=0x7f2e481f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480cbfc0 0x7f2e481f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 -- 172.21.15.172:0/1620438028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4000ab80 con 0x7f2e48142680 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e45d9b700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480cbfc0 0x7f2e481f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:44.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e46d9d700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 0x7f2e481f1e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e48067a20 tx=0x7f2e40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:44.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.753+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4001c630 con 0x7f2e48142680 2023-03-27T10:10:44.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.754+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4001c7b0 con 0x7f2e48142680 2023-03-27T10:10:44.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.754+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4001cb60 con 0x7f2e48142680 2023-03-27T10:10:44.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.754+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480c5a30 con 0x7f2e48142680 2023-03-27T10:10:44.755 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.754+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e480af2b0 con 0x7f2e48142680 2023-03-27T10:10:44.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.755+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e48142a50 con 0x7f2e48142680 2023-03-27T10:10:44.756 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.756+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f2e40024030 con 0x7f2e48142680 2023-03-27T10:10:44.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.756+0000 7f2e36ffd700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2e28066e30 0x7f2e280692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:44.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.756+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2e400859c0 con 0x7f2e48142680 2023-03-27T10:10:44.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.757+0000 7f2e4659c700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2e28066e30 0x7f2e280692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:44.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.757+0000 7f2e4659c700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2e28066e30 0x7f2e280692e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000f60 tx=0x7f2e38007d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:44.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.761+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f2e40052c50 con 0x7f2e48142680 2023-03-27T10:10:44.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.952+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e48074290 con 0x7f2e48142680 2023-03-27T10:10:44.952 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.954+0000 7f2e36ffd700 1 -- 172.21.15.172:0/1620438028 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f2e40056270 con 0x7f2e48142680 2023-03-27T10:10:44.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:44.953 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:32.667663+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:44.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.956+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2e28066e30 msgr2=0x7f2e280692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.956+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2e28066e30 0x7f2e280692e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e38000f60 tx=0x7f2e38007d90 comp rx=0 tx=0).stop 2023-03-27T10:10:44.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.956+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 msgr2=0x7f2e481f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:44.955 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.956+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 0x7f2e481f1e60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e48067a20 tx=0x7f2e40004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 shutdown_connections 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e48142680 0x7f2e481f1e60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e480afee0 0x7f2e480b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2e28066e30 0x7f2e280692e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 --2- 172.21.15.172:0/1620438028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480cbfc0 0x7f2e481f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 >> 172.21.15.172:0/1620438028 conn(0x7f2e4806a1a0 msgr2=0x7f2e481403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 shutdown_connections 2023-03-27T10:10:44.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:44.957+0000 7f2e4cfff700 1 -- 172.21.15.172:0/1620438028 wait complete. 2023-03-27T10:10:44.957 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:10:44.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:10:44.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-27T10:09:49.913750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-27T10:09:51.061906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:44.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:45.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.202+0000 7fb32d7ff700 1 Processor -- start 2023-03-27T10:10:45.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.202+0000 7fb32d7ff700 1 -- start start 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb32d7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3280d1200 0x7fb3280ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb32d7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280d02c0 0x7fb3280ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb32d7ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3280d0880 con 0x7fb3280b1700 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb32d7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280cd680 con 0x7fb3280d1200 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb32d7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280cd960 con 0x7fb3280d02c0 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb31ffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3280d1200 0x7fb3280ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb31ffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3280d1200 0x7fb3280ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47310/0 (socket says 172.21.15.172:47310) 2023-03-27T10:10:45.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb31ffff700 1 -- 172.21.15.172:0/3860918990 learned_addr learned my addr 172.21.15.172:0/3860918990 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:45.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.203+0000 7fb3277fe700 1 --2- 172.21.15.172:0/3860918990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280d02c0 0x7fb3280ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb31ffff700 1 -- 172.21.15.172:0/3860918990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280d02c0 msgr2=0x7fb3280ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:45.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb31ffff700 1 --2- 172.21.15.172:0/3860918990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280d02c0 0x7fb3280ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb31ffff700 1 -- 172.21.15.172:0/3860918990 >> v1:172.21.15.191:6789/0 conn(0x7fb3280b1700 legacy=0x7fb3280d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb31ffff700 1 -- 172.21.15.172:0/3860918990 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280cdc40 con 0x7fb3280d1200 2023-03-27T10:10:45.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb31ffff700 1 --2- 172.21.15.172:0/3860918990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d1200 0x7fb3280ce440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3100098f0 tx=0x7fb310009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80aa3ea04f7dfcb server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb3267fc700 1 -- 172.21.15.172:0/3860918990 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310011830 con 0x7fb3280d1200 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb3267fc700 1 -- 172.21.15.172:0/3860918990 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310011990 con 0x7fb3280d1200 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.204+0000 7fb3267fc700 1 -- 172.21.15.172:0/3860918990 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310011d20 con 0x7fb3280d1200 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 -- 172.21.15.172:0/3860918990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d1200 msgr2=0x7fb3280ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/3860918990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d1200 0x7fb3280ce440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3100098f0 tx=0x7fb310009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 -- 172.21.15.172:0/3860918990 shutdown_connections 2023-03-27T10:10:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/3860918990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280d02c0 0x7fb3280ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/3860918990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d1200 0x7fb3280ce440 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 -- 172.21.15.172:0/3860918990 >> 172.21.15.172:0/3860918990 conn(0x7fb32809c260 msgr2=0x7fb3280d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 -- 172.21.15.172:0/3860918990 shutdown_connections 2023-03-27T10:10:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.205+0000 7fb32d7ff700 1 -- 172.21.15.172:0/3860918990 wait complete. 2023-03-27T10:10:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.207+0000 7fb32d7ff700 1 Processor -- start 2023-03-27T10:10:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.207+0000 7fb32d7ff700 1 -- start start 2023-03-27T10:10:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb32d7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280b1700 0x7fb328156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb32d7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 0x7fb3281f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb32d7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3280d1200 0x7fb3281f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb32d7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280caa00 con 0x7fb3280d02c0 2023-03-27T10:10:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb32d7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280cb580 con 0x7fb3280d1200 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb32d7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb328156550 con 0x7fb3280b1700 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 0x7fb3281f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 0x7fb3281f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47318/0 (socket says 172.21.15.172:47318) 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 -- 172.21.15.172:0/206617417 learned_addr learned my addr 172.21.15.172:0/206617417 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb326ffd700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280b1700 0x7fb328156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb3277fe700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3280d1200 0x7fb3281f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 -- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280b1700 msgr2=0x7fb328156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280b1700 0x7fb328156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 -- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3280d1200 msgr2=0x7fb3281f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3280d1200 0x7fb3281f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.208+0000 7fb31ffff700 1 -- 172.21.15.172:0/206617417 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310009550 con 0x7fb3280d02c0 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.209+0000 7fb31ffff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 0x7fb3281f5cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb310009c40 tx=0x7fb310004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.209+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310004400 con 0x7fb3280d02c0 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.209+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31001f070 con 0x7fb3280d02c0 2023-03-27T10:10:45.210 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.209+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3280afb50 con 0x7fb3280d02c0 2023-03-27T10:10:45.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.209+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100038e0 con 0x7fb3280d02c0 2023-03-27T10:10:45.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.209+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280cdf20 con 0x7fb3280d02c0 2023-03-27T10:10:45.211 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.210+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3280d2c50 con 0x7fb3280d02c0 2023-03-27T10:10:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.211+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fb31002a020 con 0x7fb3280d02c0 2023-03-27T10:10:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.212+0000 7fb31f7fe700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb308066e30 0x7fb3080692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.212+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb3100858b0 con 0x7fb3280d02c0 2023-03-27T10:10:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.212+0000 7fb326ffd700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb308066e30 0x7fb3080692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.213+0000 7fb326ffd700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb308066e30 0x7fb3080692e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb318000fb0 tx=0x7fb318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:45.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.216+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fb310052b40 con 0x7fb3280d02c0 2023-03-27T10:10:45.403 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.404+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb328074300 con 0x7fb3280d02c0 2023-03-27T10:10:45.403 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.405+0000 7fb31f7fe700 1 -- 172.21.15.172:0/206617417 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb310015020 con 0x7fb3280d02c0 2023-03-27T10:10:45.404 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb308066e30 msgr2=0x7fb3080692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb308066e30 0x7fb3080692e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb318000fb0 tx=0x7fb318009040 comp rx=0 tx=0).stop 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 msgr2=0x7fb3281f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 0x7fb3281f5cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb310009c40 tx=0x7fb310004750 comp rx=0 tx=0).stop 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 shutdown_connections 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb308066e30 0x7fb3080692e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.406 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3280d1200 0x7fb3281f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.407 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3280b1700 0x7fb328156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.407 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 --2- 172.21.15.172:0/206617417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3280d02c0 0x7fb3281f5cc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.407 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 >> 172.21.15.172:0/206617417 conn(0x7fb32809c260 msgr2=0x7fb3280d35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:45.407 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 shutdown_connections 2023-03-27T10:10:45.407 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.407+0000 7fb32d7ff700 1 -- 172.21.15.172:0/206617417 wait complete. 2023-03-27T10:10:45.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:45.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.611+0000 7f8e56dff700 1 Processor -- start 2023-03-27T10:10:45.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.612+0000 7f8e56dff700 1 -- start start 2023-03-27T10:10:45.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e56dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8e500ce270 0x7f8e500cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e56dff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8e5006b2b0 0x7f8e5006b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e56dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e500cb940 con 0x7f8e5015c620 2023-03-27T10:10:45.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e56dff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500ce6e0 con 0x7f8e5006b2b0 2023-03-27T10:10:45.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e56dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5006bc70 con 0x7f8e500ce270 2023-03-27T10:10:45.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e5539c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8e5006b2b0 0x7f8e5006b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e54b9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8e5015c620 0x7f8e500ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47936/0 (socket says 172.21.15.172:47936) 2023-03-27T10:10:45.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e54b9b700 1 -- 172.21.15.172:0/556241693 learned_addr learned my addr 172.21.15.172:0/556241693 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:45.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e4ffff700 1 --2- 172.21.15.172:0/556241693 >> v2:172.21.15.191:3300/0 conn(0x7f8e500ce270 0x7f8e500cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e5539c700 1 -- 172.21.15.172:0/556241693 >> v2:172.21.15.191:3300/0 conn(0x7f8e500ce270 msgr2=0x7f8e500cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e5539c700 1 --2- 172.21.15.172:0/556241693 >> v2:172.21.15.191:3300/0 conn(0x7f8e500ce270 0x7f8e500cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e5539c700 1 -- 172.21.15.172:0/556241693 >> v1:172.21.15.172:6789/0 conn(0x7f8e5015c620 legacy=0x7f8e500ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e5539c700 1 -- 172.21.15.172:0/556241693 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500cc780 con 0x7f8e5006b2b0 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.613+0000 7f8e4f7fe700 1 -- 172.21.15.172:0/556241693 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593759871 0 0) 0x7f8e500cb940 con 0x7f8e5015c620 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e5539c700 1 --2- 172.21.15.172:0/556241693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5006b2b0 0x7f8e5006b730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e500715e0 tx=0x7f8e4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c190a02b75c7a477 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e4f7fe700 1 -- 172.21.15.172:0/556241693 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800e070 con 0x7f8e5006b2b0 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e4f7fe700 1 -- 172.21.15.172:0/556241693 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800bbd0 con 0x7f8e5006b2b0 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e4f7fe700 1 -- 172.21.15.172:0/556241693 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48012430 con 0x7f8e5006b2b0 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e56dff700 1 -- 172.21.15.172:0/556241693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5006b2b0 msgr2=0x7f8e5006b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e56dff700 1 --2- 172.21.15.172:0/556241693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5006b2b0 0x7f8e5006b730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8e500715e0 tx=0x7f8e4800b330 comp rx=0 tx=0).stop 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e56dff700 1 -- 172.21.15.172:0/556241693 shutdown_connections 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e56dff700 1 --2- 172.21.15.172:0/556241693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5006b2b0 0x7f8e5006b730 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.615 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e56dff700 1 --2- 172.21.15.172:0/556241693 >> v2:172.21.15.191:3300/0 conn(0x7f8e500ce270 0x7f8e500cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.614+0000 7f8e56dff700 1 -- 172.21.15.172:0/556241693 >> 172.21.15.172:0/556241693 conn(0x7f8e50072230 msgr2=0x7f8e5006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:45.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.615+0000 7f8e56dff700 1 -- 172.21.15.172:0/556241693 shutdown_connections 2023-03-27T10:10:45.616 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.615+0000 7f8e56dff700 1 -- 172.21.15.172:0/556241693 wait complete. 2023-03-27T10:10:45.617 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.616+0000 7f8e56dff700 1 Processor -- start 2023-03-27T10:10:45.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.616+0000 7f8e56dff700 1 -- start start 2023-03-27T10:10:45.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e56dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8e5006b2b0 0x7f8e501562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e56dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e500ce270 0x7f8e500b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e56dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 0x7f8e50158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e56dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b63b0 con 0x7f8e5015c620 2023-03-27T10:10:45.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e56dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b6690 con 0x7f8e500ce270 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e56dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b6970 con 0x7f8e5006b2b0 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.617+0000 7f8e5539c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 0x7f8e50158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 0x7f8e50158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47342/0 (socket says 172.21.15.172:47342) 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 -- 172.21.15.172:0/3988151714 learned_addr learned my addr 172.21.15.172:0/3988151714 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e4ffff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e500ce270 0x7f8e500b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e54b9b700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8e5006b2b0 0x7f8e501562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 -- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8e5006b2b0 msgr2=0x7f8e501562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.619 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8e5006b2b0 0x7f8e501562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 -- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e500ce270 msgr2=0x7f8e500b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e500ce270 0x7f8e500b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 -- 172.21.15.172:0/3988151714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48009a70 con 0x7f8e5015c620 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e5539c700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 0x7f8e50158880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e48014040 tx=0x7f8e48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48012430 con 0x7f8e5015c620 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48020070 con 0x7f8e5015c620 2023-03-27T10:10:45.620 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48004280 con 0x7f8e5015c620 2023-03-27T10:10:45.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.618+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e500cbb70 con 0x7f8e5015c620 2023-03-27T10:10:45.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.619+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5015c9f0 con 0x7f8e5015c620 2023-03-27T10:10:45.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.620+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e500cbe50 con 0x7f8e5015c620 2023-03-27T10:10:45.621 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.620+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f8e4802e070 con 0x7f8e5015c620 2023-03-27T10:10:45.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.621+0000 7f8e4d7fa700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8e34066e60 0x7f8e34069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:45.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.621+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8e48022070 con 0x7f8e5015c620 2023-03-27T10:10:45.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.622+0000 7f8e54b9b700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8e34066e60 0x7f8e34069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:45.622 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.622+0000 7f8e54b9b700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8e34066e60 0x7f8e34069310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e440010e0 tx=0x7f8e44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:45.623 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.625+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f8e480533b0 con 0x7f8e5015c620 2023-03-27T10:10:45.810 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.812+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e500b3810 con 0x7f8e5015c620 2023-03-27T10:10:45.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.812+0000 7f8e4d7fa700 1 -- 172.21.15.172:0/3988151714 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e480569d0 con 0x7f8e5015c620 2023-03-27T10:10:45.811 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:45.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8e34066e60 msgr2=0x7f8e34069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8e34066e60 0x7f8e34069310 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e440010e0 tx=0x7f8e44009040 comp rx=0 tx=0).stop 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 msgr2=0x7f8e50158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 0x7f8e50158880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8e48014040 tx=0x7f8e48004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 shutdown_connections 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e5015c620 0x7f8e50158880 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8e5006b2b0 0x7f8e501562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f8e34066e60 0x7f8e34069310 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 --2- 172.21.15.172:0/3988151714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e500ce270 0x7f8e500b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 >> 172.21.15.172:0/3988151714 conn(0x7f8e50072230 msgr2=0x7f8e5015b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 shutdown_connections 2023-03-27T10:10:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:45.815+0000 7f8e56dff700 1 -- 172.21.15.172:0/3988151714 wait complete. 2023-03-27T10:10:45.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-27T10:10:46.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.018+0000 7fd2663ff700 1 Processor -- start 2023-03-27T10:10:46.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.018+0000 7fd2663ff700 1 -- start start 2023-03-27T10:10:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd2663ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd260159a00 0x7fd2600c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd2663ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd2600ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd2663ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26015d3d0 con 0x7fd26015b0f0 2023-03-27T10:10:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd2663ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26015e450 con 0x7fd260159a00 2023-03-27T10:10:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd2663ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd260070050 con 0x7fd26015de30 2023-03-27T10:10:46.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd260159a00 0x7fd2600c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd260159a00 0x7fd2600c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47344/0 (socket says 172.21.15.172:47344) 2023-03-27T10:10:46.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 -- 172.21.15.172:0/2482735154 learned_addr learned my addr 172.21.15.172:0/2482735154 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:46.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd26499c700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd2600ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 -- 172.21.15.172:0/2482735154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 msgr2=0x7fd2600ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd2600ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 -- 172.21.15.172:0/2482735154 >> v1:172.21.15.191:6789/0 conn(0x7fd26015b0f0 legacy=0x7fd26015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd25ffff700 1 -- 172.21.15.172:0/2482735154 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260070330 con 0x7fd260159a00 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.020+0000 7fd26499c700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd2600ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.021+0000 7fd25ffff700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd2600c9b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd2500098f0 tx=0x7fd250009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93896a19f7065c65 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.021+0000 7fd25f7fe700 1 -- 172.21.15.172:0/2482735154 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000b8a0 con 0x7fd260159a00 2023-03-27T10:10:46.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.021+0000 7fd25f7fe700 1 -- 172.21.15.172:0/2482735154 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000ba00 con 0x7fd260159a00 2023-03-27T10:10:46.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.021+0000 7fd25f7fe700 1 -- 172.21.15.172:0/2482735154 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000bd90 con 0x7fd260159a00 2023-03-27T10:10:46.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.021+0000 7fd2663ff700 1 -- 172.21.15.172:0/2482735154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 msgr2=0x7fd2600c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.021+0000 7fd2663ff700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd2600c9b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd2500098f0 tx=0x7fd250009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:46.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.022+0000 7fd2663ff700 1 -- 172.21.15.172:0/2482735154 shutdown_connections 2023-03-27T10:10:46.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.022+0000 7fd2663ff700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd2600ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.022+0000 7fd2663ff700 1 --2- 172.21.15.172:0/2482735154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd2600c9b70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.022+0000 7fd2663ff700 1 -- 172.21.15.172:0/2482735154 >> 172.21.15.172:0/2482735154 conn(0x7fd26006a1a0 msgr2=0x7fd26006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:46.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.022+0000 7fd2663ff700 1 -- 172.21.15.172:0/2482735154 shutdown_connections 2023-03-27T10:10:46.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.022+0000 7fd2663ff700 1 -- 172.21.15.172:0/2482735154 wait complete. 2023-03-27T10:10:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.023+0000 7fd2663ff700 1 Processor -- start 2023-03-27T10:10:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.023+0000 7fd2663ff700 1 -- start start 2023-03-27T10:10:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd2663ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd260146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd2663ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd26015b0f0 0x7fd26015c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd2663ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd26015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd2663ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd260148b80 con 0x7fd260159a00 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd2663ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600ccfc0 con 0x7fd26015b0f0 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd2663ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600cd2a0 con 0x7fd26015de30 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.024+0000 7fd25ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd260146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd260146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47358/0 (socket says 172.21.15.172:47358) 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 -- 172.21.15.172:0/4023139424 learned_addr learned my addr 172.21.15.172:0/4023139424 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 -- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 msgr2=0x7fd26015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd26015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 -- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd26015b0f0 msgr2=0x7fd26015c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd26015b0f0 0x7fd26015c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 -- 172.21.15.172:0/4023139424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd250009550 con 0x7fd260159a00 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25ffff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd260146660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd250000c00 tx=0x7fd250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250004480 con 0x7fd260159a00 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25001f070 con 0x7fd260159a00 2023-03-27T10:10:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2600708f0 con 0x7fd260159a00 2023-03-27T10:10:46.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.025+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2500038c0 con 0x7fd260159a00 2023-03-27T10:10:46.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.026+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260070610 con 0x7fd260159a00 2023-03-27T10:10:46.028 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.027+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd260159dd0 con 0x7fd260159a00 2023-03-27T10:10:46.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.027+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd25002a020 con 0x7fd260159a00 2023-03-27T10:10:46.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.028+0000 7fd25d7fa700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd240066e30 0x7fd2400692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.028+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd2500858d0 con 0x7fd260159a00 2023-03-27T10:10:46.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.029+0000 7fd257fff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd240066e30 0x7fd2400692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.029 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.029+0000 7fd257fff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd240066e30 0x7fd2400692e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd248000f60 tx=0x7fd248007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.031 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.032+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd250052ad0 con 0x7fd260159a00 2023-03-27T10:10:46.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.220+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2600cd7c0 con 0x7fd260159a00 2023-03-27T10:10:46.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.220+0000 7fd25d7fa700 1 -- 172.21.15.172:0/4023139424 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2500560f0 con 0x7fd260159a00 2023-03-27T10:10:46.219 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2023-03-27T10:10:46.221 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.222+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd240066e30 msgr2=0x7fd2400692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.221 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.222+0000 7fd2663ff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd240066e30 0x7fd2400692e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd248000f60 tx=0x7fd248007a40 comp rx=0 tx=0).stop 2023-03-27T10:10:46.221 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.222+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 msgr2=0x7fd260146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.222+0000 7fd2663ff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd260146660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd250000c00 tx=0x7fd250004750 comp rx=0 tx=0).stop 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.222+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 shutdown_connections 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd26015de30 0x7fd26015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd260159a00 0x7fd260146660 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd240066e30 0x7fd2400692e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 --2- 172.21.15.172:0/4023139424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd26015b0f0 0x7fd26015c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 >> 172.21.15.172:0/4023139424 conn(0x7fd26006a1a0 msgr2=0x7fd26015b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:46.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 shutdown_connections 2023-03-27T10:10:46.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.223+0000 7fd2663ff700 1 -- 172.21.15.172:0/4023139424 wait complete. 2023-03-27T10:10:46.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-27T10:10:46.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.425+0000 7f73921ff700 1 Processor -- start 2023-03-27T10:10:46.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.426+0000 7f73921ff700 1 -- start start 2023-03-27T10:10:46.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.427+0000 7f73921ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.427+0000 7f73921ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f738c072400 0x7f738c160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.427+0000 7f73921ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c1463e0 con 0x7f738c06ab40 2023-03-27T10:10:46.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.427+0000 7f73921ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c1611a0 con 0x7f738c072400 2023-03-27T10:10:46.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.427+0000 7f73921ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c06e310 con 0x7f738c06da00 2023-03-27T10:10:46.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f738c06ab40 0x7f738c15e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47684/0 (socket says 172.21.15.172:47684) 2023-03-27T10:10:46.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738bfff700 1 -- 172.21.15.172:0/3113309515 learned_addr learned my addr 172.21.15.172:0/3113309515 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:46.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738b7fe700 1 --2- 172.21.15.172:0/3113309515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738affd700 1 --2- 172.21.15.172:0/3113309515 >> v2:172.21.15.191:3300/0 conn(0x7f738c072400 0x7f738c160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738a7fc700 1 -- 172.21.15.172:0/3113309515 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640664607 0 0) 0x7f738c1463e0 con 0x7f738c06ab40 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738a7fc700 1 -- 172.21.15.172:0/3113309515 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73740035b0 con 0x7f738c06ab40 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738b7fe700 1 -- 172.21.15.172:0/3113309515 >> v2:172.21.15.191:3300/0 conn(0x7f738c072400 msgr2=0x7f738c160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738b7fe700 1 --2- 172.21.15.172:0/3113309515 >> v2:172.21.15.191:3300/0 conn(0x7f738c072400 0x7f738c160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738b7fe700 1 -- 172.21.15.172:0/3113309515 >> v1:172.21.15.172:6789/0 conn(0x7f738c06ab40 legacy=0x7f738c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.428+0000 7f738b7fe700 1 -- 172.21.15.172:0/3113309515 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c160be0 con 0x7f738c06da00 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f738b7fe700 1 --2- 172.21.15.172:0/3113309515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c06ddd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f737c009840 tx=0x7f737c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5847e6d0501be03 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f738a7fc700 1 -- 172.21.15.172:0/3113309515 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c011830 con 0x7f738c06da00 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f738a7fc700 1 -- 172.21.15.172:0/3113309515 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c011990 con 0x7f738c06da00 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f738a7fc700 1 -- 172.21.15.172:0/3113309515 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c011d20 con 0x7f738c06da00 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f73921ff700 1 -- 172.21.15.172:0/3113309515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 msgr2=0x7f738c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f73921ff700 1 --2- 172.21.15.172:0/3113309515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c06ddd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f737c009840 tx=0x7f737c009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f73921ff700 1 -- 172.21.15.172:0/3113309515 shutdown_connections 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f73921ff700 1 --2- 172.21.15.172:0/3113309515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c06ddd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f73921ff700 1 --2- 172.21.15.172:0/3113309515 >> v2:172.21.15.191:3300/0 conn(0x7f738c072400 0x7f738c160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.431 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.429+0000 7f73921ff700 1 -- 172.21.15.172:0/3113309515 >> 172.21.15.172:0/3113309515 conn(0x7f738c0b1010 msgr2=0x7f738c0b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:46.431 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.430+0000 7f73921ff700 1 -- 172.21.15.172:0/3113309515 shutdown_connections 2023-03-27T10:10:46.431 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.430+0000 7f73921ff700 1 -- 172.21.15.172:0/3113309515 wait complete. 2023-03-27T10:10:46.432 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.431+0000 7f73921ff700 1 Processor -- start 2023-03-27T10:10:46.432 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.431+0000 7f73921ff700 1 -- start start 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f73921ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f738c06ab40 0x7f738c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f73921ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c1e6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f73921ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 0x7f738c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f73921ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c15c5f0 con 0x7f738c072400 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f73921ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c1e6a70 con 0x7f738c06ab40 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f73921ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c1e6d50 con 0x7f738c06da00 2023-03-27T10:10:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f738bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 0x7f738c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f738bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 0x7f738c15f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43628/0 (socket says 172.21.15.172:43628) 2023-03-27T10:10:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.432+0000 7f738bfff700 1 -- 172.21.15.172:0/1949102691 learned_addr learned my addr 172.21.15.172:0/1949102691 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738b7fe700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f738c06ab40 0x7f738c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738affd700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c1e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738bfff700 1 -- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 msgr2=0x7f738c1e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738bfff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c1e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738bfff700 1 -- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f738c06ab40 msgr2=0x7f738c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738bfff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f738c06ab40 0x7f738c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738bfff700 1 -- 172.21.15.172:0/1949102691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0094a0 con 0x7f738c072400 2023-03-27T10:10:46.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f738bfff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 0x7f738c15f3a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f738400cb40 tx=0x7f738400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400a9e0 con 0x7f738c072400 2023-03-27T10:10:46.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400ab40 con 0x7f738c072400 2023-03-27T10:10:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c06a340 con 0x7f738c072400 2023-03-27T10:10:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384012400 con 0x7f738c072400 2023-03-27T10:10:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.433+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c160ec0 con 0x7f738c072400 2023-03-27T10:10:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.434+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c06a620 con 0x7f738c072400 2023-03-27T10:10:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.435+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f7384019030 con 0x7f738c072400 2023-03-27T10:10:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.436+0000 7f7373fff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7378066e30 0x7f73780692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.436+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7384083c90 con 0x7f738c072400 2023-03-27T10:10:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.437+0000 7f738b7fe700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7378066e30 0x7f73780692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.437+0000 7f738b7fe700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7378066e30 0x7f73780692e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f737c000c00 tx=0x7f737c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.440+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f738404b4f0 con 0x7f738c072400 2023-03-27T10:10:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.631+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f738c074300 con 0x7f738c072400 2023-03-27T10:10:46.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.631+0000 7f7373fff700 1 -- 172.21.15.172:0/1949102691 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7384050f40 con 0x7f738c072400 2023-03-27T10:10:46.630 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2023-03-27T10:10:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7378066e30 msgr2=0x7f73780692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7378066e30 0x7f73780692e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f737c000c00 tx=0x7f737c008030 comp rx=0 tx=0).stop 2023-03-27T10:10:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 msgr2=0x7f738c15f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 0x7f738c15f3a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f738400cb40 tx=0x7f738400ce50 comp rx=0 tx=0).stop 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 shutdown_connections 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c072400 0x7f738c15f3a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7378066e30 0x7f73780692e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f738c06ab40 0x7f738c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 --2- 172.21.15.172:0/1949102691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f738c06da00 0x7f738c1e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.633+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 >> 172.21.15.172:0/1949102691 conn(0x7f738c0b1010 msgr2=0x7f738c0b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.634+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 shutdown_connections 2023-03-27T10:10:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.634+0000 7f73921ff700 1 -- 172.21.15.172:0/1949102691 wait complete. 2023-03-27T10:10:46.649 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:10:46.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.834+0000 7f752ebff700 1 Processor -- start 2023-03-27T10:10:46.833 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.834+0000 7f752ebff700 1 -- start start 2023-03-27T10:10:46.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752ebff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75280cd760 0x7f75280cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752ebff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f752806be30 0x7f752806c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.834 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752ebff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75280cb3a0 con 0x7f752815c8f0 2023-03-27T10:10:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752ebff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752806b9a0 con 0x7f75280cd760 2023-03-27T10:10:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752ebff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7528070220 con 0x7f752806be30 2023-03-27T10:10:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75280cd760 0x7f75280cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75280cd760 0x7f75280cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43636/0 (socket says 172.21.15.172:43636) 2023-03-27T10:10:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 -- 172.21.15.172:0/2542361444 learned_addr learned my addr 172.21.15.172:0/2542361444 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752d19c700 1 --2- 172.21.15.172:0/2542361444 >> v2:172.21.15.191:3300/0 conn(0x7f752806be30 0x7f752806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.836 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 -- 172.21.15.172:0/2542361444 >> v2:172.21.15.191:3300/0 conn(0x7f752806be30 msgr2=0x7f752806c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 --2- 172.21.15.172:0/2542361444 >> v2:172.21.15.191:3300/0 conn(0x7f752806be30 0x7f752806c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 -- 172.21.15.172:0/2542361444 >> v1:172.21.15.191:6789/0 conn(0x7f752815c8f0 legacy=0x7f752806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.836+0000 7f752c99b700 1 -- 172.21.15.172:0/2542361444 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280ce070 con 0x7f75280cd760 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752c99b700 1 --2- 172.21.15.172:0/2542361444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75280cd760 0x7f75280cdb30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7528070860 tx=0x7f7524009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af33ec54371a013 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f751f7fe700 1 -- 172.21.15.172:0/2542361444 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400b870 con 0x7f75280cd760 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f751f7fe700 1 -- 172.21.15.172:0/2542361444 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400b9d0 con 0x7f75280cd760 2023-03-27T10:10:46.837 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f751f7fe700 1 -- 172.21.15.172:0/2542361444 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400bd60 con 0x7f75280cd760 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752ebff700 1 -- 172.21.15.172:0/2542361444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75280cd760 msgr2=0x7f75280cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752ebff700 1 --2- 172.21.15.172:0/2542361444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75280cd760 0x7f75280cdb30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7528070860 tx=0x7f7524009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752ebff700 1 -- 172.21.15.172:0/2542361444 shutdown_connections 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752ebff700 1 --2- 172.21.15.172:0/2542361444 >> v2:172.21.15.191:3300/0 conn(0x7f752806be30 0x7f752806c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752ebff700 1 --2- 172.21.15.172:0/2542361444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75280cd760 0x7f75280cdb30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.837+0000 7f752ebff700 1 -- 172.21.15.172:0/2542361444 >> 172.21.15.172:0/2542361444 conn(0x7f752806dd60 msgr2=0x7f752806e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.838+0000 7f752ebff700 1 -- 172.21.15.172:0/2542361444 shutdown_connections 2023-03-27T10:10:46.838 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.838+0000 7f752ebff700 1 -- 172.21.15.172:0/2542361444 wait complete. 2023-03-27T10:10:46.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.839+0000 7f752ebff700 1 Processor -- start 2023-03-27T10:10:46.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.839+0000 7f752ebff700 1 -- start start 2023-03-27T10:10:46.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752ebff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 0x7f75280b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.840 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752ebff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f75280cd760 0x7f75280b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752ebff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752815c8f0 0x7f752815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752ebff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280b0cd0 con 0x7f752806be30 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752ebff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280b36d0 con 0x7f752815c8f0 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752ebff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280b2ec0 con 0x7f75280cd760 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752c99b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 0x7f75280b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752c99b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 0x7f75280b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43652/0 (socket says 172.21.15.172:43652) 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.840+0000 7f752c99b700 1 -- 172.21.15.172:0/3641638550 learned_addr learned my addr 172.21.15.172:0/3641638550 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:46.841 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f751ffff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f75280cd760 0x7f75280b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752d19c700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752815c8f0 0x7f752815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752c99b700 1 -- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f75280cd760 msgr2=0x7f75280b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752c99b700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f75280cd760 0x7f75280b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752c99b700 1 -- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752815c8f0 msgr2=0x7f752815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752c99b700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752815c8f0 0x7f752815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752c99b700 1 -- 172.21.15.172:0/3641638550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524009550 con 0x7f752806be30 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f751ffff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f75280cd760 0x7f75280b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:46.842 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752d19c700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752815c8f0 0x7f752815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752c99b700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 0x7f75280b10f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7524014040 tx=0x7f7524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524004520 con 0x7f752806be30 2023-03-27T10:10:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752401e070 con 0x7f752806be30 2023-03-27T10:10:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240038a0 con 0x7f752806be30 2023-03-27T10:10:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75280d0a90 con 0x7f752806be30 2023-03-27T10:10:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.841+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75280d07b0 con 0x7f752806be30 2023-03-27T10:10:46.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.843+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752806b350 con 0x7f752806be30 2023-03-27T10:10:46.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.843+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f752400f050 con 0x7f752806be30 2023-03-27T10:10:46.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.844+0000 7f751d7fa700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7514066e30 0x7f75140692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:46.844 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.844+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7524020070 con 0x7f752806be30 2023-03-27T10:10:46.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.845+0000 7f751ffff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7514066e30 0x7f75140692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:46.845 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.845+0000 7f751ffff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7514066e30 0x7f75140692e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f752815f280 tx=0x7f7518009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:46.846 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:46.848+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f7524052a50 con 0x7f752806be30 2023-03-27T10:10:47.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.078+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75280b0790 con 0x7f752806be30 2023-03-27T10:10:47.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.078+0000 7f751d7fa700 1 -- 172.21.15.172:0/3641638550 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4624 (secure 0 0 0) 0x7f75280b0790 con 0x7f752806be30 2023-03-27T10:10:47.077 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:47.077 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:09:52.070050+0000","modified":"2023-03-27T10:09:55.094484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-27T10:10:47.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7514066e30 msgr2=0x7f75140692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7514066e30 0x7f75140692e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f752815f280 tx=0x7f7518009040 comp rx=0 tx=0).stop 2023-03-27T10:10:47.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 msgr2=0x7f75280b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 0x7f75280b10f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7524014040 tx=0x7f7524004750 comp rx=0 tx=0).stop 2023-03-27T10:10:47.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 shutdown_connections 2023-03-27T10:10:47.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f7514066e30 0x7f75140692e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f752815c8f0 0x7f752815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f752806be30 0x7f75280b10f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 --2- 172.21.15.172:0/3641638550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f75280cd760 0x7f75280b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 >> 172.21.15.172:0/3641638550 conn(0x7f752806dd60 msgr2=0x7f752815b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:47.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 shutdown_connections 2023-03-27T10:10:47.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.081+0000 7f752ebff700 1 -- 172.21.15.172:0/3641638550 wait complete. 2023-03-27T10:10:47.081 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2023-03-27T10:10:47.096 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.282+0000 7fe28c5ff700 1 Processor -- start 2023-03-27T10:10:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.283+0000 7fe28c5ff700 1 -- start start 2023-03-27T10:10:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.284+0000 7fe28c5ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe28415ca20 0x7fe2840ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.284+0000 7fe28c5ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840cebc0 con 0x7fe2840d0b90 2023-03-27T10:10:47.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.284+0000 7fe28c5ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840ceea0 con 0x7fe2840cd610 2023-03-27T10:10:47.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.284+0000 7fe28c5ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2840cf180 con 0x7fe28415ca20 2023-03-27T10:10:47.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.284+0000 7fe28a39b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe2840d0b90 0x7fe2840d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47690/0 (socket says 172.21.15.172:47690) 2023-03-27T10:10:47.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.284+0000 7fe28a39b700 1 -- 172.21.15.172:0/2370180686 learned_addr learned my addr 172.21.15.172:0/2370180686 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:47.285 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289b9a700 1 --2- 172.21.15.172:0/2370180686 >> v2:172.21.15.191:3300/0 conn(0x7fe28415ca20 0x7fe2840ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072576934 0 0) 0x7fe2840cebc0 con 0x7fe2840d0b90 2023-03-27T10:10:47.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2700035b0 con 0x7fe2840d0b90 2023-03-27T10:10:47.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3469795999 0 0) 0x7fe2700035b0 con 0x7fe2840d0b90 2023-03-27T10:10:47.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 >> v2:172.21.15.191:3300/0 conn(0x7fe28415ca20 msgr2=0x7fe2840ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:47.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 --2- 172.21.15.172:0/2370180686 >> v2:172.21.15.191:3300/0 conn(0x7fe28415ca20 0x7fe2840ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 >> v1:172.21.15.191:6789/0 conn(0x7fe2840cd610 legacy=0x7fe2840b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840cf460 con 0x7fe2840d0b90 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7fe2800017f0 con 0x7fe2840d0b90 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 >> v1:172.21.15.172:6789/0 conn(0x7fe2840d0b90 legacy=0x7fe2840d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe270003a70 0x7fe270003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270004850 0x7fe270004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe270005200 0x7fe27000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840cf180 con 0x7fe270003a70 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27000c0e0 con 0x7fe270005200 2023-03-27T10:10:47.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27000c2a0 con 0x7fe270004850 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.285+0000 7fe28a39b700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe270003a70 0x7fe270003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe289b9a700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270004850 0x7fe270004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28ab9c700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe270005200 0x7fe27000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28a39b700 1 -- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270004850 msgr2=0x7fe270004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28a39b700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270004850 0x7fe270004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28a39b700 1 -- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe270005200 msgr2=0x7fe27000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:47.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28a39b700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe270005200 0x7fe27000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28a39b700 1 -- 172.21.15.172:0/2370180686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700035b0 con 0x7fe270003a70 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28ab9c700 1 -- 172.21.15.172:0/2370180686 reap_dead start 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe289b9a700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270004850 0x7fe270004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe28a39b700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe270003a70 0x7fe270003e80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c240 tx=0x7fe270005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee7b3ef200f0a17 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28000cde0 con 0x7fe270003a70 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280007b80 con 0x7fe270003a70 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.286+0000 7fe289399700 1 -- 172.21.15.172:0/2370180686 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800072f0 con 0x7fe270003a70 2023-03-27T10:10:47.292 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 -- 172.21.15.172:0/2370180686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe270003a70 msgr2=0x7fe270003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe270003a70 0x7fe270003e80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c240 tx=0x7fe270005880 comp rx=0 tx=0).stop 2023-03-27T10:10:47.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 -- 172.21.15.172:0/2370180686 shutdown_connections 2023-03-27T10:10:47.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/2370180686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe270003a70 0x7fe270003e80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 -- 172.21.15.172:0/2370180686 >> 172.21.15.172:0/2370180686 conn(0x7fe2840721f0 msgr2=0x7fe28409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:47.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 -- 172.21.15.172:0/2370180686 shutdown_connections 2023-03-27T10:10:47.293 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.287+0000 7fe28c5ff700 1 -- 172.21.15.172:0/2370180686 wait complete. 2023-03-27T10:10:47.295 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.289+0000 7fe28c5ff700 1 Processor -- start 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.289+0000 7fe28c5ff700 1 -- start start 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28c5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270003a70 0x7fe2841f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28c5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2840b2290 0x7fe2840b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28c5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 0x7fe2840b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28c5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840b2c40 con 0x7fe2840b7a10 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28c5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840b8780 con 0x7fe2840b2290 2023-03-27T10:10:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28c5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840caae0 con 0x7fe270003a70 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 0x7fe2840b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 0x7fe2840b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43682/0 (socket says 172.21.15.172:43682) 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 -- 172.21.15.172:0/1323360233 learned_addr learned my addr 172.21.15.172:0/1323360233 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28a39b700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270003a70 0x7fe2841f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe289b9a700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2840b2290 0x7fe2840b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 -- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270003a70 msgr2=0x7fe2841f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.297 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270003a70 0x7fe2841f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 -- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2840b2290 msgr2=0x7fe2840b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2840b2290 0x7fe2840b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.290+0000 7fe28ab9c700 1 -- 172.21.15.172:0/1323360233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840d2d30 con 0x7fe2840b7a10 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.291+0000 7fe28ab9c700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 0x7fe2840b7e80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2840d1bf0 tx=0x7fe27c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.291+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c003c10 con 0x7fe2840b7a10 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.291+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c003d90 con 0x7fe2840b7a10 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.291+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2840afc50 con 0x7fe2840b7a10 2023-03-27T10:10:47.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.291+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c005310 con 0x7fe2840b7a10 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.291+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2840ce500 con 0x7fe2840b7a10 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.292+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe284074290 con 0x7fe2840b7a10 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.293+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe27c005470 con 0x7fe2840b7a10 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.294+0000 7fe27affd700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe268066e30 0x7fe2680692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.294+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe27c0844e0 con 0x7fe2840b7a10 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.295+0000 7fe28a39b700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe268066e30 0x7fe2680692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.299 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.295+0000 7fe28a39b700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe268066e30 0x7fe2680692e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe280007d30 tx=0x7fe280007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:47.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.298+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe27c0516e0 con 0x7fe2840b7a10 2023-03-27T10:10:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.486+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2840c9570 con 0x7fe2840b7a10 2023-03-27T10:10:47.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.488+0000 7fe27affd700 1 -- 172.21.15.172:0/1323360233 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7fe27c01a310 con 0x7fe2840b7a10 2023-03-27T10:10:47.486 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:47.486 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:32.667663+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:47.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe268066e30 msgr2=0x7fe2680692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe268066e30 0x7fe2680692e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe280007d30 tx=0x7fe280007000 comp rx=0 tx=0).stop 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 msgr2=0x7fe2840b7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 0x7fe2840b7e80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2840d1bf0 tx=0x7fe27c00ee80 comp rx=0 tx=0).stop 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 shutdown_connections 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2840b7a10 0x7fe2840b7e80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe270003a70 0x7fe2841f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe268066e30 0x7fe2680692e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 --2- 172.21.15.172:0/1323360233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2840b2290 0x7fe2840b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 >> 172.21.15.172:0/1323360233 conn(0x7fe2840721f0 msgr2=0x7fe28406b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:47.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 shutdown_connections 2023-03-27T10:10:47.490 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.490+0000 7fe28c5ff700 1 -- 172.21.15.172:0/1323360233 wait complete. 2023-03-27T10:10:47.506 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-27T10:10:47.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:10:47.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.694+0000 7fabd0bff700 1 Processor -- start 2023-03-27T10:10:47.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.694+0000 7fabd0bff700 1 -- start start 2023-03-27T10:10:47.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.695+0000 7fabd0bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fabcc0d0b90 0x7fabcc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.695+0000 7fabd0bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc15ca20 0x7fabcc0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.695+0000 7fabd0bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0d14a0 con 0x7fabcc0cd610 2023-03-27T10:10:47.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.695+0000 7fabd0bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc0cebc0 con 0x7fabcc0d0b90 2023-03-27T10:10:47.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.695+0000 7fabd0bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0ceea0 con 0x7fabcc15ca20 2023-03-27T10:10:47.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.695+0000 7fabca59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fabcc0d0b90 0x7fabcc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabcad9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fabcc0cd610 0x7fabcc0cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47704/0 (socket says 172.21.15.172:47704) 2023-03-27T10:10:47.695 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabca59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fabcc0d0b90 0x7fabcc0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43684/0 (socket says 172.21.15.172:43684) 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabcad9d700 1 -- 172.21.15.172:0/3984134312 learned_addr learned my addr 172.21.15.172:0/3984134312 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabc9d9b700 1 --2- 172.21.15.172:0/3984134312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc15ca20 0x7fabcc0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabca59c700 1 -- 172.21.15.172:0/3984134312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc15ca20 msgr2=0x7fabcc0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabca59c700 1 --2- 172.21.15.172:0/3984134312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc15ca20 0x7fabcc0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabca59c700 1 -- 172.21.15.172:0/3984134312 >> v1:172.21.15.172:6789/0 conn(0x7fabcc0cd610 legacy=0x7fabcc0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabca59c700 1 -- 172.21.15.172:0/3984134312 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0cf180 con 0x7fabcc0d0b90 2023-03-27T10:10:47.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabca59c700 1 --2- 172.21.15.172:0/3984134312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0d0b90 0x7fabcc0ce500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009820 tx=0x7fabbc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dacd0db02e2eb1 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:47.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabc959a700 1 -- 172.21.15.172:0/3984134312 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc005e30 con 0x7fabcc0d0b90 2023-03-27T10:10:47.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabc959a700 1 -- 172.21.15.172:0/3984134312 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc006030 con 0x7fabcc0d0b90 2023-03-27T10:10:47.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.696+0000 7fabc959a700 1 -- 172.21.15.172:0/3984134312 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0063e0 con 0x7fabcc0d0b90 2023-03-27T10:10:47.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 -- 172.21.15.172:0/3984134312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0d0b90 msgr2=0x7fabcc0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 --2- 172.21.15.172:0/3984134312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0d0b90 0x7fabcc0ce500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009820 tx=0x7fabbc009b30 comp rx=0 tx=0).stop 2023-03-27T10:10:47.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 -- 172.21.15.172:0/3984134312 shutdown_connections 2023-03-27T10:10:47.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 --2- 172.21.15.172:0/3984134312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0d0b90 0x7fabcc0ce500 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 --2- 172.21.15.172:0/3984134312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc15ca20 0x7fabcc0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 -- 172.21.15.172:0/3984134312 >> 172.21.15.172:0/3984134312 conn(0x7fabcc0721f0 msgr2=0x7fabcc09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:47.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 -- 172.21.15.172:0/3984134312 shutdown_connections 2023-03-27T10:10:47.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.697+0000 7fabd0bff700 1 -- 172.21.15.172:0/3984134312 wait complete. 2023-03-27T10:10:47.700 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.699+0000 7fabd0bff700 1 Processor -- start 2023-03-27T10:10:47.700 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.699+0000 7fabd0bff700 1 -- start start 2023-03-27T10:10:47.703 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabd0bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabcc0cd610 0x7fabcc1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.704 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabd0bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc0d0b90 0x7fabcc1f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.704 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabd0bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 0x7fabcc0b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.704 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabd0bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1f60a0 con 0x7fabcc15ca20 2023-03-27T10:10:47.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabd0bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0ca530 con 0x7fabcc0cd610 2023-03-27T10:10:47.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabd0bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1589f0 con 0x7fabcc0d0b90 2023-03-27T10:10:47.705 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabcad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 0x7fabcc0b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabcad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 0x7fabcc0b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43698/0 (socket says 172.21.15.172:43698) 2023-03-27T10:10:47.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.700+0000 7fabcad9d700 1 -- 172.21.15.172:0/1052410074 learned_addr learned my addr 172.21.15.172:0/1052410074 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:47.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabc9d9b700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc0d0b90 0x7fabcc1f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.706 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabca59c700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabcc0cd610 0x7fabcc1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabcad9d700 1 -- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc0d0b90 msgr2=0x7fabcc1f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabcad9d700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc0d0b90 0x7fabcc1f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabcad9d700 1 -- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabcc0cd610 msgr2=0x7fabcc1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.707 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabcad9d700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabcc0cd610 0x7fabcc1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabcad9d700 1 -- 172.21.15.172:0/1052410074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc009430 con 0x7fabcc15ca20 2023-03-27T10:10:47.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabc9d9b700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc0d0b90 0x7fabcc1f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:47.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabca59c700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabcc0cd610 0x7fabcc1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:47.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabcad9d700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 0x7fabcc0b4380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fabc400cab0 tx=0x7fabc400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:47.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400aa60 con 0x7fabcc15ca20 2023-03-27T10:10:47.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400abc0 con 0x7fabcc15ca20 2023-03-27T10:10:47.709 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc0afc50 con 0x7fabcc15ca20 2023-03-27T10:10:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4012400 con 0x7fabcc15ca20 2023-03-27T10:10:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.701+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc0cf460 con 0x7fabcc15ca20 2023-03-27T10:10:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.702+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc0d2d30 con 0x7fabcc15ca20 2023-03-27T10:10:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.703+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fabc4019030 con 0x7fabcc15ca20 2023-03-27T10:10:47.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.704+0000 7fabbaffd700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fabac066e30 0x7fabac0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:47.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.704+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fabc4083d10 con 0x7fabcc15ca20 2023-03-27T10:10:47.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.704+0000 7fabca59c700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fabac066e30 0x7fabac0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:47.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.705+0000 7fabca59c700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fabac066e30 0x7fabac0692e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabbc013040 tx=0x7fabbc008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:47.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.708+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fabc404b4f0 con 0x7fabcc15ca20 2023-03-27T10:10:47.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.940+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabcc0ca670 con 0x7fabcc15ca20 2023-03-27T10:10:47.939 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.941+0000 7fabbaffd700 1 -- 172.21.15.172:0/1052410074 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4624 (secure 0 0 0) 0x7fabc4051050 con 0x7fabcc15ca20 2023-03-27T10:10:47.940 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:47.940 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:09:52.070050+0000","modified":"2023-03-27T10:09:55.094484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-27T10:10:47.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.943+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fabac066e30 msgr2=0x7fabac0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.943+0000 7fabd0bff700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fabac066e30 0x7fabac0692e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabbc013040 tx=0x7fabbc008070 comp rx=0 tx=0).stop 2023-03-27T10:10:47.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.943+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 msgr2=0x7fabcc0b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.943+0000 7fabd0bff700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 0x7fabcc0b4380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fabc400cab0 tx=0x7fabc400ce70 comp rx=0 tx=0).stop 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 shutdown_connections 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc15ca20 0x7fabcc0b4380 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fabac066e30 0x7fabac0692e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabcc0cd610 0x7fabcc1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 --2- 172.21.15.172:0/1052410074 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabcc0d0b90 0x7fabcc1f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 >> 172.21.15.172:0/1052410074 conn(0x7fabcc0721f0 msgr2=0x7fabcc0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:47.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 shutdown_connections 2023-03-27T10:10:47.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:47.944+0000 7fabd0bff700 1 -- 172.21.15.172:0/1052410074 wait complete. 2023-03-27T10:10:47.944 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2023-03-27T10:10:47.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:10:48.146 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.148+0000 7f0f6cbff700 1 Processor -- start 2023-03-27T10:10:48.147 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.148+0000 7f0f6cbff700 1 -- start start 2023-03-27T10:10:48.148 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.149+0000 7f0f6cbff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0f6815a5f0 0x7f0f6815e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.148 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.149+0000 7f0f6cbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6815a9c0 0x7f0f680afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.148 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.149+0000 7f0f6cbff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f680b0370 0x7f0f680cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.148 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.149+0000 7f0f6cbff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f68071df0 con 0x7f0f680b0370 2023-03-27T10:10:48.148 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.149+0000 7f0f6cbff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f680caa00 con 0x7f0f6815a5f0 2023-03-27T10:10:48.149 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.149+0000 7f0f6cbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680cace0 con 0x7f0f6815a9c0 2023-03-27T10:10:48.149 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f680b0370 0x7f0f680cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.149 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f680b0370 0x7f0f680cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43708/0 (socket says 172.21.15.172:43708) 2023-03-27T10:10:48.149 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 -- 172.21.15.172:0/3624029724 learned_addr learned my addr 172.21.15.172:0/3624029724 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:48.150 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f65d9b700 1 --2- 172.21.15.172:0/3624029724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6815a9c0 0x7f0f680afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.150 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f6659c700 1 --2- 172.21.15.172:0/3624029724 >> v2:172.21.15.191:3300/0 conn(0x7f0f6815a5f0 0x7f0f6815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 -- 172.21.15.172:0/3624029724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6815a9c0 msgr2=0x7f0f680afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 --2- 172.21.15.172:0/3624029724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6815a9c0 0x7f0f680afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 -- 172.21.15.172:0/3624029724 >> v2:172.21.15.191:3300/0 conn(0x7f0f6815a5f0 msgr2=0x7f0f6815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 --2- 172.21.15.172:0/3624029724 >> v2:172.21.15.191:3300/0 conn(0x7f0f6815a5f0 0x7f0f6815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 -- 172.21.15.172:0/3624029724 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f680cafc0 con 0x7f0f680b0370 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.150+0000 7f0f66d9d700 1 --2- 172.21.15.172:0/3624029724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f680b0370 0x7f0f680cb610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0f6806f8b0 tx=0x7f0f6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6099b33f1328b88b server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:48.151 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6559a700 1 -- 172.21.15.172:0/3624029724 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000e070 con 0x7f0f680b0370 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6559a700 1 -- 172.21.15.172:0/3624029724 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6000b9c0 con 0x7f0f680b0370 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6559a700 1 -- 172.21.15.172:0/3624029724 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000bd70 con 0x7f0f680b0370 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 -- 172.21.15.172:0/3624029724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f680b0370 msgr2=0x7f0f680cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/3624029724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f680b0370 0x7f0f680cb610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0f6806f8b0 tx=0x7f0f6000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 -- 172.21.15.172:0/3624029724 shutdown_connections 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/3624029724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f680b0370 0x7f0f680cb610 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.152 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/3624029724 >> v2:172.21.15.191:3300/0 conn(0x7f0f6815a5f0 0x7f0f6815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/3624029724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f6815a9c0 0x7f0f680afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 -- 172.21.15.172:0/3624029724 >> 172.21.15.172:0/3624029724 conn(0x7f0f6806a1a0 msgr2=0x7f0f6806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:48.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 -- 172.21.15.172:0/3624029724 shutdown_connections 2023-03-27T10:10:48.153 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.151+0000 7f0f6cbff700 1 -- 172.21.15.172:0/3624029724 wait complete. 2023-03-27T10:10:48.154 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.153+0000 7f0f6cbff700 1 Processor -- start 2023-03-27T10:10:48.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.153+0000 7f0f6cbff700 1 -- start start 2023-03-27T10:10:48.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f6cbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f680b0370 0x7f0f680ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f6cbff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6815a5f0 0x7f0f680c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f6cbff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 0x7f0f680ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f6cbff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680adde0 con 0x7f0f6815a9c0 2023-03-27T10:10:48.155 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f6cbff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680ad160 con 0x7f0f6815a5f0 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f6cbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680ad440 con 0x7f0f680b0370 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f66d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 0x7f0f680ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f66d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 0x7f0f680ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43722/0 (socket says 172.21.15.172:43722) 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.154+0000 7f0f66d9d700 1 -- 172.21.15.172:0/338684348 learned_addr learned my addr 172.21.15.172:0/338684348 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f6659c700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f680b0370 0x7f0f680ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f65d9b700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6815a5f0 0x7f0f680c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f66d9d700 1 -- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f680b0370 msgr2=0x7f0f680ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.156 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f66d9d700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f680b0370 0x7f0f680ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f66d9d700 1 -- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6815a5f0 msgr2=0x7f0f680c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f66d9d700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6815a5f0 0x7f0f680c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f66d9d700 1 -- 172.21.15.172:0/338684348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60009b30 con 0x7f0f6815a9c0 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f66d9d700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 0x7f0f680ac8a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f68067a20 tx=0x7f0f60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600099b0 con 0x7f0f6815a9c0 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60004250 con 0x7f0f6815a9c0 2023-03-27T10:10:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f680ca6b0 con 0x7f0f6815a9c0 2023-03-27T10:10:48.158 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.155+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004600 con 0x7f0f6815a9c0 2023-03-27T10:10:48.158 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.156+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f680cb2a0 con 0x7f0f6815a9c0 2023-03-27T10:10:48.158 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.156+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f680adf20 con 0x7f0f6815a9c0 2023-03-27T10:10:48.158 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.158+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0f60004760 con 0x7f0f6815a9c0 2023-03-27T10:10:48.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.159+0000 7f0f56ffd700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f48066e30 0x7f0f480692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.159+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0f60085af0 con 0x7f0f6815a9c0 2023-03-27T10:10:48.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.160+0000 7f0f6659c700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f48066e30 0x7f0f480692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.159 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.160+0000 7f0f6659c700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f48066e30 0x7f0f480692e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009950 tx=0x7f0f58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:48.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.162+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f0f60052d70 con 0x7f0f6815a9c0 2023-03-27T10:10:48.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.394+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f680adf20 con 0x7f0f6815a9c0 2023-03-27T10:10:48.393 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.394+0000 7f0f56ffd700 1 -- 172.21.15.172:0/338684348 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4624 (secure 0 0 0) 0x7f0f680adf20 con 0x7f0f6815a9c0 2023-03-27T10:10:48.393 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:48.394 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/4089458840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":4089458840},{"type":"v1","addr":"172.21.15.191:6837","nonce":4089458840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3513149571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3513149571},{"type":"v1","addr":"172.21.15.191:6835","nonce":3513149571}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3089845754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3089845754},{"type":"v1","addr":"172.21.15.172:6834","nonce":3089845754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:09:52.070050+0000","modified":"2023-03-27T10:09:55.094484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/4073767112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4073767112},{"type":"v1","addr":"172.21.15.172:6835","nonce":4073767112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-27T10:10:48.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f48066e30 msgr2=0x7f0f480692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f48066e30 0x7f0f480692e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009950 tx=0x7f0f58008040 comp rx=0 tx=0).stop 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 msgr2=0x7f0f680ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 0x7f0f680ac8a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f68067a20 tx=0x7f0f60004ad0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 shutdown_connections 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f6815a9c0 0x7f0f680ac8a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f680b0370 0x7f0f680ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0f48066e30 0x7f0f480692e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 --2- 172.21.15.172:0/338684348 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f6815a5f0 0x7f0f680c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 >> 172.21.15.172:0/338684348 conn(0x7f0f6806a1a0 msgr2=0x7f0f68070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:48.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 shutdown_connections 2023-03-27T10:10:48.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.397+0000 7f0f6cbff700 1 -- 172.21.15.172:0/338684348 wait complete. 2023-03-27T10:10:48.397 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2023-03-27T10:10:48.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:48.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.599+0000 7fb4713ff700 1 Processor -- start 2023-03-27T10:10:48.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.599+0000 7fb4713ff700 1 -- start start 2023-03-27T10:10:48.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.600+0000 7fb4713ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb46c142680 0x7fb46c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.600+0000 7fb4713ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb46c0cbfc0 0x7fb46c0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.600+0000 7fb4713ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c0c4290 con 0x7fb46c0afd10 2023-03-27T10:10:48.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.600+0000 7fb4713ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0af0c0 con 0x7fb46c142680 2023-03-27T10:10:48.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.600+0000 7fb4713ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0c3cd0 con 0x7fb46c0cbfc0 2023-03-27T10:10:48.600 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb46c142680 0x7fb46c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb46c142680 0x7fb46c0c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43734/0 (socket says 172.21.15.172:43734) 2023-03-27T10:10:48.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 -- 172.21.15.172:0/661577521 learned_addr learned my addr 172.21.15.172:0/661577521 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:48.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 -- 172.21.15.172:0/661577521 >> v2:172.21.15.191:3300/0 conn(0x7fb46c0cbfc0 msgr2=0x7fb46c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:48.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46a7fc700 1 --2- 172.21.15.172:0/661577521 >> v2:172.21.15.191:3300/0 conn(0x7fb46c0cbfc0 0x7fb46c0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 --2- 172.21.15.172:0/661577521 >> v2:172.21.15.191:3300/0 conn(0x7fb46c0cbfc0 0x7fb46c0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 -- 172.21.15.172:0/661577521 >> v1:172.21.15.191:6789/0 conn(0x7fb46c0afd10 legacy=0x7fb46c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 -- 172.21.15.172:0/661577521 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0c3fb0 con 0x7fb46c142680 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46a7fc700 1 --2- 172.21.15.172:0/661577521 >> v2:172.21.15.191:3300/0 conn(0x7fb46c0cbfc0 0x7fb46c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.601+0000 7fb46affd700 1 --2- 172.21.15.172:0/661577521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c142680 0x7fb46c0c9300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb46c067920 tx=0x7fb45c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7708cd3de993d044 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb469ffb700 1 -- 172.21.15.172:0/661577521 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c004230 con 0x7fb46c142680 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb469ffb700 1 -- 172.21.15.172:0/661577521 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c004390 con 0x7fb46c142680 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb469ffb700 1 -- 172.21.15.172:0/661577521 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0036a0 con 0x7fb46c142680 2023-03-27T10:10:48.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 -- 172.21.15.172:0/661577521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c142680 msgr2=0x7fb46c0c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 --2- 172.21.15.172:0/661577521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c142680 0x7fb46c0c9300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb46c067920 tx=0x7fb45c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 -- 172.21.15.172:0/661577521 shutdown_connections 2023-03-27T10:10:48.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 --2- 172.21.15.172:0/661577521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c142680 0x7fb46c0c9300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 --2- 172.21.15.172:0/661577521 >> v2:172.21.15.191:3300/0 conn(0x7fb46c0cbfc0 0x7fb46c0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 -- 172.21.15.172:0/661577521 >> 172.21.15.172:0/661577521 conn(0x7fb46c06a1a0 msgr2=0x7fb46c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:48.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 -- 172.21.15.172:0/661577521 shutdown_connections 2023-03-27T10:10:48.604 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.602+0000 7fb4713ff700 1 -- 172.21.15.172:0/661577521 wait complete. 2023-03-27T10:10:48.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.604+0000 7fb4713ff700 1 Processor -- start 2023-03-27T10:10:48.606 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.604+0000 7fb4713ff700 1 -- start start 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb4713ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 0x7fb46c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb4713ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46c0cbfc0 0x7fb46c1e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb4713ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb46c142680 0x7fb46c131970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb4713ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c131eb0 con 0x7fb46c0afd10 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb4713ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1e35e0 con 0x7fb46c0cbfc0 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb4713ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1e38c0 con 0x7fb46c142680 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb46affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 0x7fb46c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.607 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb46affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 0x7fb46c0c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43746/0 (socket says 172.21.15.172:43746) 2023-03-27T10:10:48.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb46affd700 1 -- 172.21.15.172:0/3574259185 learned_addr learned my addr 172.21.15.172:0/3574259185 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:48.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.605+0000 7fb46a7fc700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46c0cbfc0 0x7fb46c1e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46b7fe700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb46c142680 0x7fb46c131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46affd700 1 -- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb46c142680 msgr2=0x7fb46c131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.608 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46affd700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb46c142680 0x7fb46c131970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46affd700 1 -- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46c0cbfc0 msgr2=0x7fb46c1e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46affd700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46c0cbfc0 0x7fb46c1e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46affd700 1 -- 172.21.15.172:0/3574259185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c009550 con 0x7fb46c0afd10 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46a7fc700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46c0cbfc0 0x7fb46c1e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb46affd700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 0x7fb46c0c6e20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb46c067a20 tx=0x7fb45c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c011630 con 0x7fb46c0afd10 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c011790 con 0x7fb46c0afd10 2023-03-27T10:10:48.609 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c011b40 con 0x7fb46c0afd10 2023-03-27T10:10:48.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c0c5a30 con 0x7fb46c0afd10 2023-03-27T10:10:48.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.606+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c0af2b0 con 0x7fb46c0afd10 2023-03-27T10:10:48.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.607+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c0c9840 con 0x7fb46c0afd10 2023-03-27T10:10:48.610 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.608+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fb45c017020 con 0x7fb46c0afd10 2023-03-27T10:10:48.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.609+0000 7fb4537fe700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb458066e30 0x7fb4580692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:48.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.610+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb45c085940 con 0x7fb46c0afd10 2023-03-27T10:10:48.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.610+0000 7fb46a7fc700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb458066e30 0x7fb4580692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:48.611 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.610+0000 7fb46a7fc700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb458066e30 0x7fb4580692e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0c9810 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:48.612 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.614+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fb45c052b40 con 0x7fb46c0afd10 2023-03-27T10:10:48.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.803+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb46c074290 con 0x7fb46c0afd10 2023-03-27T10:10:48.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.804+0000 7fb4537fe700 1 -- 172.21.15.172:0/3574259185 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18051 (secure 0 0 0) 0x7fb45c028020 con 0x7fb46c0afd10 2023-03-27T10:10:48.803 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:48.803 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:32.667663+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:09:49.913750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-27T10:09:51.061906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:48.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb458066e30 msgr2=0x7fb4580692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb458066e30 0x7fb4580692e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0c9810 tx=0x7fb460008040 comp rx=0 tx=0).stop 2023-03-27T10:10:48.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 msgr2=0x7fb46c0c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:48.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 0x7fb46c0c6e20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb46c067a20 tx=0x7fb45c004750 comp rx=0 tx=0).stop 2023-03-27T10:10:48.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 shutdown_connections 2023-03-27T10:10:48.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb46c142680 0x7fb46c131970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb46c0afd10 0x7fb46c0c6e20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fb458066e30 0x7fb4580692e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 --2- 172.21.15.172:0/3574259185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb46c0cbfc0 0x7fb46c1e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:48.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.806+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 >> 172.21.15.172:0/3574259185 conn(0x7fb46c06a1a0 msgr2=0x7fb46c0b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:48.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.807+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 shutdown_connections 2023-03-27T10:10:48.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:48.807+0000 7fb4713ff700 1 -- 172.21.15.172:0/3574259185 wait complete. 2023-03-27T10:10:48.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-27T10:10:49.006 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.008+0000 7f64e89ff700 1 Processor -- start 2023-03-27T10:10:49.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.008+0000 7f64e89ff700 1 -- start start 2023-03-27T10:10:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.009+0000 7f64e89ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64e415c620 0x7f64e40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.009+0000 7f64e89ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e40cb400 0x7f64e40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.009+0000 7f64e89ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f64e406b2b0 0x7f64e406b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.009+0000 7f64e89ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e406bc70 con 0x7f64e415c620 2023-03-27T10:10:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.009+0000 7f64e89ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e40cc780 con 0x7f64e406b2b0 2023-03-27T10:10:49.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.009+0000 7f64e89ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e415c9f0 con 0x7f64e40cb400 2023-03-27T10:10:49.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64e415c620 0x7f64e40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64e415c620 0x7f64e40ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43750/0 (socket says 172.21.15.172:43750) 2023-03-27T10:10:49.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 -- 172.21.15.172:0/4199474526 learned_addr learned my addr 172.21.15.172:0/4199474526 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:49.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64dbfff700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e40cb400 0x7f64e40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e2d9d700 1 --2- 172.21.15.172:0/4199474526 >> v2:172.21.15.191:3300/0 conn(0x7f64e406b2b0 0x7f64e406b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 -- 172.21.15.172:0/4199474526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e40cb400 msgr2=0x7f64e40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e40cb400 0x7f64e40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 -- 172.21.15.172:0/4199474526 >> v2:172.21.15.191:3300/0 conn(0x7f64e406b2b0 msgr2=0x7f64e406b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 --2- 172.21.15.172:0/4199474526 >> v2:172.21.15.191:3300/0 conn(0x7f64e406b2b0 0x7f64e406b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 -- 172.21.15.172:0/4199474526 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40cbb70 con 0x7f64e415c620 2023-03-27T10:10:49.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64dbfff700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e40cb400 0x7f64e40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e2d9d700 1 --2- 172.21.15.172:0/4199474526 >> v2:172.21.15.191:3300/0 conn(0x7f64e406b2b0 0x7f64e406b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e259c700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e415c620 0x7f64e40ce270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64e4161230 tx=0x7f64d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f4b4210eeaa871 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.010+0000 7f64e1d9b700 1 -- 172.21.15.172:0/4199474526 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4005e30 con 0x7f64e415c620 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e1d9b700 1 -- 172.21.15.172:0/4199474526 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d4004030 con 0x7f64e415c620 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e1d9b700 1 -- 172.21.15.172:0/4199474526 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d40043e0 con 0x7f64e415c620 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 -- 172.21.15.172:0/4199474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e415c620 msgr2=0x7f64e40ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e415c620 0x7f64e40ce270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64e4161230 tx=0x7f64d4009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 -- 172.21.15.172:0/4199474526 shutdown_connections 2023-03-27T10:10:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 --2- 172.21.15.172:0/4199474526 >> v2:172.21.15.191:3300/0 conn(0x7f64e406b2b0 0x7f64e406b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e415c620 0x7f64e40ce270 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 --2- 172.21.15.172:0/4199474526 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e40cb400 0x7f64e40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 -- 172.21.15.172:0/4199474526 >> 172.21.15.172:0/4199474526 conn(0x7f64e4072230 msgr2=0x7f64e406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 -- 172.21.15.172:0/4199474526 shutdown_connections 2023-03-27T10:10:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.011+0000 7f64e89ff700 1 -- 172.21.15.172:0/4199474526 wait complete. 2023-03-27T10:10:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.013+0000 7f64e89ff700 1 Processor -- start 2023-03-27T10:10:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.013+0000 7f64e89ff700 1 -- start start 2023-03-27T10:10:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e89ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64e406b2b0 0x7f64e4153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e89ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 0x7f64e41e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e89ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e415c620 0x7f64e40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e89ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e4154020 con 0x7f64e40cb400 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e89ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40d0500 con 0x7f64e406b2b0 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e89ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40d0da0 con 0x7f64e415c620 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 0x7f64e41e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 0x7f64e41e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43766/0 (socket says 172.21.15.172:43766) 2023-03-27T10:10:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 -- 172.21.15.172:0/527514662 learned_addr learned my addr 172.21.15.172:0/527514662 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 -- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e415c620 msgr2=0x7f64e40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e2d9d700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e415c620 0x7f64e40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e259c700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64e406b2b0 0x7f64e4153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e415c620 0x7f64e40ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 -- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64e406b2b0 msgr2=0x7f64e4153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64e406b2b0 0x7f64e4153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64dbfff700 1 -- 172.21.15.172:0/527514662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4009500 con 0x7f64e40cb400 2023-03-27T10:10:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.014+0000 7f64e2d9d700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e415c620 0x7f64e40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.015+0000 7f64dbfff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 0x7f64e41e8140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c750 tx=0x7f64cc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.015+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc011800 con 0x7f64e40cb400 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.015+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc011960 con 0x7f64e40cb400 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.015+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e40cc130 con 0x7f64e40cb400 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.015+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc011cd0 con 0x7f64e40cb400 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.015+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e40cbe50 con 0x7f64e40cb400 2023-03-27T10:10:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.016+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e40cc410 con 0x7f64e40cb400 2023-03-27T10:10:49.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.017+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f64cc020070 con 0x7f64e40cb400 2023-03-27T10:10:49.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.018+0000 7f64daffd700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f64c4066e30 0x7f64c40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.019 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.018+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f64cc084170 con 0x7f64e40cb400 2023-03-27T10:10:49.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.018+0000 7f64e259c700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f64c4066e30 0x7f64c40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.019+0000 7f64e259c700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f64c4066e30 0x7f64c40692e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f64e4161230 tx=0x7f64d4008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:49.020 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.022+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f64cc051370 con 0x7f64e40cb400 2023-03-27T10:10:49.250 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.252+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64e40b6940 con 0x7f64e40cb400 2023-03-27T10:10:49.736 INFO:tasks.ceph.mon.a.smithi172.stderr:2023-03-27T10:10:49.738+0000 7f4a561f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-27T10:10:49.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.747+0000 7f64daffd700 1 -- 172.21.15.172:0/527514662 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f64cc054990 con 0x7f64e40cb400 2023-03-27T10:10:49.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f64c4066e30 msgr2=0x7f64c40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f64c4066e30 0x7f64c40692e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f64e4161230 tx=0x7f64d4008070 comp rx=0 tx=0).stop 2023-03-27T10:10:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 msgr2=0x7f64e41e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 0x7f64e41e8140 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c750 tx=0x7f64cc00cb10 comp rx=0 tx=0).stop 2023-03-27T10:10:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 shutdown_connections 2023-03-27T10:10:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64e415c620 0x7f64e40ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f64c4066e30 0x7f64c40692e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64e406b2b0 0x7f64e4153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 --2- 172.21.15.172:0/527514662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e40cb400 0x7f64e41e8140 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 >> 172.21.15.172:0/527514662 conn(0x7f64e4072230 msgr2=0x7f64e40add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 shutdown_connections 2023-03-27T10:10:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.750+0000 7f64e89ff700 1 -- 172.21.15.172:0/527514662 wait complete. 2023-03-27T10:10:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-27T10:10:49.767 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-27T10:10:49.812 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2023-03-27T10:10:49.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.961+0000 7fdec9fff700 1 Processor -- start 2023-03-27T10:10:49.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.961+0000 7fdec9fff700 1 -- start start 2023-03-27T10:10:49.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec9fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdec406ab40 0x7fdec415e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec9fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec4160980 con 0x7fdec406da00 2023-03-27T10:10:49.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec9fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec41463e0 con 0x7fdec4072400 2023-03-27T10:10:49.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec9fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec41611a0 con 0x7fdec406ab40 2023-03-27T10:10:49.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec37fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdec406da00 0x7fdec406ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47708/0 (socket says 172.21.15.172:47708) 2023-03-27T10:10:49.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec37fe700 1 -- 172.21.15.172:0/1656665742 learned_addr learned my addr 172.21.15.172:0/1656665742 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:49.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec3fff700 1 --2- 172.21.15.172:0/1656665742 >> v2:172.21.15.191:3300/0 conn(0x7fdec406ab40 0x7fdec415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215067081 0 0) 0x7fdec4160980 con 0x7fdec406da00 2023-03-27T10:10:49.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.963+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac0035b0 con 0x7fdec406da00 2023-03-27T10:10:49.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897137058 0 0) 0x7fdec41463e0 con 0x7fdec4072400 2023-03-27T10:10:49.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4160980 con 0x7fdec4072400 2023-03-27T10:10:49.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec3fff700 1 -- 172.21.15.172:0/1656665742 >> v1:172.21.15.191:6789/0 conn(0x7fdec4072400 legacy=0x7fdec4160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec3fff700 1 -- 172.21.15.172:0/1656665742 >> v1:172.21.15.172:6789/0 conn(0x7fdec406da00 legacy=0x7fdec406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec3fff700 1 -- 172.21.15.172:0/1656665742 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4160be0 con 0x7fdec406ab40 2023-03-27T10:10:49.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec3fff700 1 --2- 172.21.15.172:0/1656665742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec415e050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009d90 tx=0x7fdebc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67bc6aff6773d6e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:49.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00e070 con 0x7fdec406ab40 2023-03-27T10:10:49.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00bb20 con 0x7fdec406ab40 2023-03-27T10:10:49.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.964+0000 7fdec27fc700 1 -- 172.21.15.172:0/1656665742 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc012430 con 0x7fdec406ab40 2023-03-27T10:10:49.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 -- 172.21.15.172:0/1656665742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 msgr2=0x7fdec415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 --2- 172.21.15.172:0/1656665742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec415e050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009d90 tx=0x7fdebc00b330 comp rx=0 tx=0).stop 2023-03-27T10:10:49.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 -- 172.21.15.172:0/1656665742 shutdown_connections 2023-03-27T10:10:49.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 --2- 172.21.15.172:0/1656665742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec415e050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 -- 172.21.15.172:0/1656665742 >> 172.21.15.172:0/1656665742 conn(0x7fdec40b1010 msgr2=0x7fdec40b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:49.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 -- 172.21.15.172:0/1656665742 shutdown_connections 2023-03-27T10:10:49.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.965+0000 7fdec9fff700 1 -- 172.21.15.172:0/1656665742 wait complete. 2023-03-27T10:10:49.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.966+0000 7fdec9fff700 1 Processor -- start 2023-03-27T10:10:49.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 -- start start 2023-03-27T10:10:49.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec413d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 0x7fdec415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdec4072400 0x7fdec415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec415ef30 con 0x7fdec406da00 2023-03-27T10:10:49.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec415f210 con 0x7fdec406ab40 2023-03-27T10:10:49.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.967+0000 7fdec9fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec415f4f0 con 0x7fdec4072400 2023-03-27T10:10:49.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 0x7fdec415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 0x7fdec415ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43782/0 (socket says 172.21.15.172:43782) 2023-03-27T10:10:49.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 -- 172.21.15.172:0/520062871 learned_addr learned my addr 172.21.15.172:0/520062871 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:49.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec37fe700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec413d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec3fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdec4072400 0x7fdec415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 -- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdec4072400 msgr2=0x7fdec415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdec4072400 0x7fdec415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 -- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 msgr2=0x7fdec413d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:49.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec413d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:49.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 -- 172.21.15.172:0/520062871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009a70 con 0x7fdec406da00 2023-03-27T10:10:49.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.968+0000 7fdec2ffd700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 0x7fdec415ffd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c4f0 tx=0x7fdeb800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:49.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.969+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80052d0 con 0x7fdec406da00 2023-03-27T10:10:49.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.969+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8005430 con 0x7fdec406da00 2023-03-27T10:10:49.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.969+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8003880 con 0x7fdec406da00 2023-03-27T10:10:49.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.969+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec406a340 con 0x7fdec406da00 2023-03-27T10:10:49.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.969+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4160ec0 con 0x7fdec406da00 2023-03-27T10:10:49.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.970+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec406a620 con 0x7fdec406da00 2023-03-27T10:10:49.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.971+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fdeb8019030 con 0x7fdec406da00 2023-03-27T10:10:49.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.972+0000 7fdeabfff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdeb0066e30 0x7fdeb00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:49.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.972+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fdeb80835e0 con 0x7fdec406da00 2023-03-27T10:10:49.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.972+0000 7fdec37fe700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdeb0066e30 0x7fdeb00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:49.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.973+0000 7fdec37fe700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdeb0066e30 0x7fdeb00692e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40011e0 tx=0x7fdeb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:49.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:49.976+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fdeb804b4f0 con 0x7fdec406da00 2023-03-27T10:10:50.206 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.207+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdec4070bc0 con 0x7fdec406da00 2023-03-27T10:10:50.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.749+0000 7fdeabfff700 1 -- 172.21.15.172:0/520062871 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdeb80508b0 con 0x7fdec406da00 2023-03-27T10:10:50.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdeb0066e30 msgr2=0x7fdeb00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdeb0066e30 0x7fdeb00692e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40011e0 tx=0x7fdeb4009040 comp rx=0 tx=0).stop 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 msgr2=0x7fdec415ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 0x7fdec415ffd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800c4f0 tx=0x7fdeb800c8b0 comp rx=0 tx=0).stop 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 shutdown_connections 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdec4072400 0x7fdec415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdeb0066e30 0x7fdeb00692e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:50.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdec406ab40 0x7fdec413d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:50.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 --2- 172.21.15.172:0/520062871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdec406da00 0x7fdec415ffd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:50.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 >> 172.21.15.172:0/520062871 conn(0x7fdec40b1010 msgr2=0x7fdec40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:50.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 shutdown_connections 2023-03-27T10:10:50.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:50.752+0000 7fdec9fff700 1 -- 172.21.15.172:0/520062871 wait complete. 2023-03-27T10:10:50.770 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-27T10:10:50.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.001+0000 7f4990fff700 1 Processor -- start 2023-03-27T10:10:50.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.001+0000 7f4990fff700 1 -- start start 2023-03-27T10:10:51.000 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f4990fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f498c0b4540 0x7f498c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f4990fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c160c00 0x7f498c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f4990fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c161080 con 0x7f498c0d1050 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f4990fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c0d14c0 con 0x7f498c0b4540 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f4990fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0cdf60 con 0x7f498c160c00 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f498a59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f498c0b4540 0x7f498c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f498a59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f498c0b4540 0x7f498c0d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43796/0 (socket says 172.21.15.172:43796) 2023-03-27T10:10:51.001 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f498a59c700 1 -- 172.21.15.172:0/3106882782 learned_addr learned my addr 172.21.15.172:0/3106882782 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:51.002 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f4983fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f498c0d1050 0x7f498c1604f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47716/0 (socket says 172.21.15.172:47716) 2023-03-27T10:10:51.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.002+0000 7f498ad9d700 1 --2- 172.21.15.172:0/3106882782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c160c00 0x7f498c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f498a59c700 1 -- 172.21.15.172:0/3106882782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c160c00 msgr2=0x7f498c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:51.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f498a59c700 1 --2- 172.21.15.172:0/3106882782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c160c00 0x7f498c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.003 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f498a59c700 1 -- 172.21.15.172:0/3106882782 >> v1:172.21.15.172:6789/0 conn(0x7f498c0d1050 legacy=0x7f498c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f498a59c700 1 -- 172.21.15.172:0/3106882782 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c15cd20 con 0x7f498c0b4540 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f498a59c700 1 --2- 172.21.15.172:0/3106882782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0b4540 0x7f498c0d0b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f497c006fd0 tx=0x7f497c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e1030c639caa58 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f4989d9b700 1 -- 172.21.15.172:0/3106882782 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c005e30 con 0x7f498c0b4540 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f4989d9b700 1 -- 172.21.15.172:0/3106882782 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c004030 con 0x7f498c0b4540 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.003+0000 7f4989d9b700 1 -- 172.21.15.172:0/3106882782 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0043e0 con 0x7f498c0b4540 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 -- 172.21.15.172:0/3106882782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0b4540 msgr2=0x7f498c0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 --2- 172.21.15.172:0/3106882782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0b4540 0x7f498c0d0b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f497c006fd0 tx=0x7f497c009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 -- 172.21.15.172:0/3106882782 shutdown_connections 2023-03-27T10:10:51.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 --2- 172.21.15.172:0/3106882782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0b4540 0x7f498c0d0b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 --2- 172.21.15.172:0/3106882782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c160c00 0x7f498c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 -- 172.21.15.172:0/3106882782 >> 172.21.15.172:0/3106882782 conn(0x7f498c0721f0 msgr2=0x7f498c09c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:51.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 -- 172.21.15.172:0/3106882782 shutdown_connections 2023-03-27T10:10:51.005 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.004+0000 7f4990fff700 1 -- 172.21.15.172:0/3106882782 wait complete. 2023-03-27T10:10:51.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.006+0000 7f4990fff700 1 Processor -- start 2023-03-27T10:10:51.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.006+0000 7f4990fff700 1 -- start start 2023-03-27T10:10:51.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4990fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c0b4540 0x7f498c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4990fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 0x7f498c0b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4990fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f498c160c00 0x7f498c150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4990fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c15d000 con 0x7f498c0d1050 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4990fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c15d2e0 con 0x7f498c160c00 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4990fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c15d5c0 con 0x7f498c0b4540 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 0x7f498c0b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 0x7f498c0b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43800/0 (socket says 172.21.15.172:43800) 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 -- 172.21.15.172:0/533639419 learned_addr learned my addr 172.21.15.172:0/533639419 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f498a59c700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c0b4540 0x7f498c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f498ad9d700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f498c160c00 0x7f498c150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 -- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c0b4540 msgr2=0x7f498c0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c0b4540 0x7f498c0afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 -- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f498c160c00 msgr2=0x7f498c150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f498c160c00 0x7f498c150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f4983fff700 1 -- 172.21.15.172:0/533639419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c009500 con 0x7f498c0d1050 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.007+0000 7f498ad9d700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f498c160c00 0x7f498c150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:51.009 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.008+0000 7f4983fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 0x7f498c0b83f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f497400c520 tx=0x7f497400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.008+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974005cb0 con 0x7f498c0d1050 2023-03-27T10:10:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.008+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974005e10 con 0x7f498c0d1050 2023-03-27T10:10:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.008+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740072d0 con 0x7f498c0d1050 2023-03-27T10:10:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.008+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c1612b0 con 0x7f498c0d1050 2023-03-27T10:10:51.010 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.008+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c0b2860 con 0x7f498c0d1050 2023-03-27T10:10:51.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.009+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c0cd630 con 0x7f498c0d1050 2023-03-27T10:10:51.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.010+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f4974019030 con 0x7f498c0d1050 2023-03-27T10:10:51.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.011+0000 7f4982ffd700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f496c066e30 0x7f496c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.011+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f4974083520 con 0x7f498c0d1050 2023-03-27T10:10:51.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.011+0000 7f498a59c700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f496c066e30 0x7f496c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.012+0000 7f498a59c700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f496c066e30 0x7f496c0692e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f497c009c10 tx=0x7f497c008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:51.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.015+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f497404b4f0 con 0x7f498c0d1050 2023-03-27T10:10:51.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.203+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f498c074290 con 0x7f498c0d1050 2023-03-27T10:10:51.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.754+0000 7f4982ffd700 1 -- 172.21.15.172:0/533639419 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f49740541b0 con 0x7f498c0d1050 2023-03-27T10:10:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f496c066e30 msgr2=0x7f496c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f496c066e30 0x7f496c0692e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f497c009c10 tx=0x7f497c008070 comp rx=0 tx=0).stop 2023-03-27T10:10:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 msgr2=0x7f498c0b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 0x7f498c0b83f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f497400c520 tx=0x7f497400c830 comp rx=0 tx=0).stop 2023-03-27T10:10:51.757 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 shutdown_connections 2023-03-27T10:10:51.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f496c066e30 0x7f496c0692e0 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f497c009c10 tx=0x7f497c008070 comp rx=0 tx=0).stop 2023-03-27T10:10:51.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f498c160c00 0x7f498c150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f498c0b4540 0x7f498c0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 --2- 172.21.15.172:0/533639419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f498c0d1050 0x7f498c0b83f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.758 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.758+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 >> 172.21.15.172:0/533639419 conn(0x7f498c0721f0 msgr2=0x7f498c160380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:51.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.760+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 shutdown_connections 2023-03-27T10:10:51.759 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.760+0000 7f4990fff700 1 -- 172.21.15.172:0/533639419 wait complete. 2023-03-27T10:10:51.760 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2023-03-27T10:10:51.777 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-27T10:10:51.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.965+0000 7fe8179ff700 1 Processor -- start 2023-03-27T10:10:51.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.965+0000 7fe8179ff700 1 -- start start 2023-03-27T10:10:51.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.966+0000 7fe8179ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe81015cd80 0x7fe810167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe8179ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8100ae840 con 0x7fe8100ae060 2023-03-27T10:10:51.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe8179ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81006d5b0 con 0x7fe8101609f0 2023-03-27T10:10:51.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe8179ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81006b1b0 con 0x7fe81015cd80 2023-03-27T10:10:51.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe814f9a700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe8100ae060 0x7fe81015c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47730/0 (socket says 172.21.15.172:47730) 2023-03-27T10:10:51.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe814f9a700 1 -- 172.21.15.172:0/1511470086 learned_addr learned my addr 172.21.15.172:0/1511470086 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe815f9c700 1 --2- 172.21.15.172:0/1511470086 >> v2:172.21.15.191:3300/0 conn(0x7fe81015cd80 0x7fe810167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918342809 0 0) 0x7fe8100ae840 con 0x7fe8100ae060 2023-03-27T10:10:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7fc0035b0 con 0x7fe8100ae060 2023-03-27T10:10:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110812451 0 0) 0x7fe7fc0035b0 con 0x7fe8100ae060 2023-03-27T10:10:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 >> v2:172.21.15.191:3300/0 conn(0x7fe81015cd80 msgr2=0x7fe810167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe807fff700 1 --2- 172.21.15.172:0/1511470086 >> v2:172.21.15.191:3300/0 conn(0x7fe81015cd80 0x7fe810167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.967+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 >> v1:172.21.15.191:6789/0 conn(0x7fe8101609f0 legacy=0x7fe810160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81006d890 con 0x7fe8100ae060 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7fe800001670 con 0x7fe8100ae060 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 >> v1:172.21.15.172:6789/0 conn(0x7fe8100ae060 legacy=0x7fe81015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7fc003a70 0x7fe7fc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc004850 0x7fe7fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7fc005200 0x7fe7fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc00c030 con 0x7fe7fc003a70 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc00c1a0 con 0x7fe7fc005200 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc00c360 con 0x7fe7fc004850 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe81579b700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7fc003a70 0x7fe7fc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe815f9c700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7fc005200 0x7fe7fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe814f9a700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc004850 0x7fe7fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe81579b700 1 -- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc004850 msgr2=0x7fe7fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:51.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe81579b700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc004850 0x7fe7fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe81579b700 1 -- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7fc005200 msgr2=0x7fe7fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe81579b700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7fc005200 0x7fe7fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe81579b700 1 -- 172.21.15.172:0/1511470086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0035b0 con 0x7fe7fc003a70 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.968+0000 7fe815f9c700 1 -- 172.21.15.172:0/1511470086 reap_dead start 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe81579b700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7fc003a70 0x7fe7fc003e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001980 tx=0x7fe7fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9b124c4b333c37 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c001420 con 0x7fe7fc003a70 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0052d0 con 0x7fe7fc003a70 2023-03-27T10:10:51.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe807fff700 1 -- 172.21.15.172:0/1511470086 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c003680 con 0x7fe7fc003a70 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 -- 172.21.15.172:0/1511470086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7fc003a70 msgr2=0x7fe7fc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7fc003a70 0x7fe7fc003e40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001980 tx=0x7fe7fc005880 comp rx=0 tx=0).stop 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 -- 172.21.15.172:0/1511470086 shutdown_connections 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1511470086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7fc003a70 0x7fe7fc003e40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 -- 172.21.15.172:0/1511470086 >> 172.21.15.172:0/1511470086 conn(0x7fe8100cc9b0 msgr2=0x7fe8100cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 -- 172.21.15.172:0/1511470086 shutdown_connections 2023-03-27T10:10:51.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.969+0000 7fe8179ff700 1 -- 172.21.15.172:0/1511470086 wait complete. 2023-03-27T10:10:51.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.971+0000 7fe8179ff700 1 Processor -- start 2023-03-27T10:10:51.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.971+0000 7fe8179ff700 1 -- start start 2023-03-27T10:10:51.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe8179ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc003a70 0x7fe8100c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.974 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe8179ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8100c4190 0x7fe810154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe8179ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 0x7fe8101591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe8179ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101550e0 con 0x7fe81009ac60 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe8179ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100c4670 con 0x7fe8100c4190 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe8179ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100c4950 con 0x7fe7fc003a70 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe815f9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 0x7fe8101591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe815f9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 0x7fe8101591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43804/0 (socket says 172.21.15.172:43804) 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe815f9c700 1 -- 172.21.15.172:0/1737258305 learned_addr learned my addr 172.21.15.172:0/1737258305 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:51.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe814f9a700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8100c4190 0x7fe810154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.972+0000 7fe81579b700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc003a70 0x7fe8100c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe815f9c700 1 -- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc003a70 msgr2=0x7fe8100c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe815f9c700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc003a70 0x7fe8100c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe815f9c700 1 -- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8100c4190 msgr2=0x7fe810154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe815f9c700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8100c4190 0x7fe810154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe815f9c700 1 -- 172.21.15.172:0/1737258305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81006cb70 con 0x7fe81009ac60 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe815f9c700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 0x7fe8101591b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8100701c0 tx=0x7fe808011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80800e040 con 0x7fe81009ac60 2023-03-27T10:10:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80800f040 con 0x7fe81009ac60 2023-03-27T10:10:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80800fc40 con 0x7fe81009ac60 2023-03-27T10:10:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.973+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81006c890 con 0x7fe81009ac60 2023-03-27T10:10:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.974+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81006d090 con 0x7fe81009ac60 2023-03-27T10:10:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.975+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8100c5c50 con 0x7fe81009ac60 2023-03-27T10:10:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.975+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fe80800fda0 con 0x7fe81009ac60 2023-03-27T10:10:51.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.976+0000 7fe805ffb700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe7f4066e30 0x7fe7f40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:51.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.976+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fe808084760 con 0x7fe81009ac60 2023-03-27T10:10:51.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.977+0000 7fe81579b700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe7f4066e30 0x7fe7f40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:51.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.978+0000 7fe81579b700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe7f4066e30 0x7fe7f40692e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000c00 tx=0x7fe80c00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:51.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:51.983+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fe808051ac0 con 0x7fe81009ac60 2023-03-27T10:10:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.171+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe810074300 con 0x7fe81009ac60 2023-03-27T10:10:52.762 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.764+0000 7fe805ffb700 1 -- 172.21.15.172:0/1737258305 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8080550e0 con 0x7fe81009ac60 2023-03-27T10:10:52.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.768+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe7f4066e30 msgr2=0x7fe7f40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:52.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.768+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe7f4066e30 0x7fe7f40692e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000c00 tx=0x7fe80c00a000 comp rx=0 tx=0).stop 2023-03-27T10:10:52.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.768+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 msgr2=0x7fe8101591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:52.769 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.768+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 0x7fe8101591b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe8100701c0 tx=0x7fe808011ed0 comp rx=0 tx=0).stop 2023-03-27T10:10:52.770 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.770+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 shutdown_connections 2023-03-27T10:10:52.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.770+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe81009ac60 0x7fe8101591b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:52.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.770+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7fc003a70 0x7fe8100c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:52.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.770+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fe7f4066e30 0x7fe7f40692e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:52.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.770+0000 7fe8179ff700 1 --2- 172.21.15.172:0/1737258305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8100c4190 0x7fe810154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:52.771 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.770+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 >> 172.21.15.172:0/1737258305 conn(0x7fe8100cc9b0 msgr2=0x7fe8100abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:52.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.772+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 shutdown_connections 2023-03-27T10:10:52.772 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:52.773+0000 7fe8179ff700 1 -- 172.21.15.172:0/1737258305 wait complete. 2023-03-27T10:10:52.775 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2023-03-27T10:10:52.792 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-27T10:10:52.792 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-27T10:10:52.792 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-27T10:10:52.792 INFO:teuthology.orchestra.run:waiting for 300 2023-03-27T10:10:52.793 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-27T10:10:52.793 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-27T10:10:52.793 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-27T10:10:52.793 INFO:teuthology.orchestra.run:waiting for 300 2023-03-27T10:10:52.794 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-27T10:10:52.794 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-27T10:10:52.794 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-27T10:10:52.794 INFO:teuthology.orchestra.run:waiting for 300 2023-03-27T10:10:52.795 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-27T10:10:52.795 INFO:tasks.ceph.mds.d:Stopping old one... 2023-03-27T10:10:52.795 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-27T10:10:52.795 INFO:teuthology.orchestra.run:waiting for 300 2023-03-27T10:10:52.807 INFO:tasks.ceph.mds.a:Stopped 2023-03-27T10:10:52.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-27T10:10:52.809 INFO:tasks.ceph.mds.c:Stopped 2023-03-27T10:10:52.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-27T10:10:52.810 INFO:tasks.ceph.mds.b:Stopped 2023-03-27T10:10:52.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-27T10:10:52.812 INFO:tasks.ceph.mds.d:Stopped 2023-03-27T10:10:52.812 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-27T10:10:52.852 INFO:tasks.ceph.mds.a:Started 2023-03-27T10:10:52.853 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:52.855 INFO:tasks.ceph.mds.c:Started 2023-03-27T10:10:52.855 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:52.856 INFO:tasks.ceph.mds.b:Started 2023-03-27T10:10:52.856 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:52.857 INFO:tasks.ceph.mds.d:Started 2023-03-27T10:10:52.857 DEBUG:teuthology.parallel:result is None 2023-03-27T10:10:52.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:52.992 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2023-03-27T10:10:52.992 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2023-03-27T10:10:53.002 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-27T10:10:53.021 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-27T10:10:53.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.064+0000 7f71f77ff700 1 Processor -- start 2023-03-27T10:10:53.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.064+0000 7f71f77ff700 1 -- start start 2023-03-27T10:10:53.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f77ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71f015c8f0 0x7f71f006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f77ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71f006be30 0x7f71f006c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f77ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00cb3a0 con 0x7f71f00cd760 2023-03-27T10:10:53.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f77ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f006b9a0 con 0x7f71f015c8f0 2023-03-27T10:10:53.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f77ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f0070220 con 0x7f71f006be30 2023-03-27T10:10:53.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f559b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f71f00cd760 0x7f71f00cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47752/0 (socket says 172.21.15.172:47752) 2023-03-27T10:10:53.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f559b700 1 -- 172.21.15.172:0/323390033 learned_addr learned my addr 172.21.15.172:0/323390033 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:53.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.065+0000 7f71f4d9a700 1 --2- 172.21.15.172:0/323390033 >> v2:172.21.15.172:3300/0 conn(0x7f71f015c8f0 0x7f71f006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71e7fff700 1 -- 172.21.15.172:0/323390033 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330703943 0 0) 0x7f71f00cb3a0 con 0x7f71f00cd760 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71e7fff700 1 -- 172.21.15.172:0/323390033 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc0035b0 con 0x7f71f00cd760 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71f4d9a700 1 -- 172.21.15.172:0/323390033 >> v2:172.21.15.191:3300/0 conn(0x7f71f006be30 msgr2=0x7f71f006c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71f4d9a700 1 --2- 172.21.15.172:0/323390033 >> v2:172.21.15.191:3300/0 conn(0x7f71f006be30 0x7f71f006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71f4d9a700 1 -- 172.21.15.172:0/323390033 >> v1:172.21.15.172:6789/0 conn(0x7f71f00cd760 legacy=0x7f71f00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71f4d9a700 1 -- 172.21.15.172:0/323390033 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00d07b0 con 0x7f71f015c8f0 2023-03-27T10:10:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71f4d9a700 1 --2- 172.21.15.172:0/323390033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f015c8f0 0x7f71f006f710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71f0070860 tx=0x7f71e0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f4d1c45e1f8eec server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71e7fff700 1 -- 172.21.15.172:0/323390033 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011830 con 0x7f71f015c8f0 2023-03-27T10:10:53.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71e7fff700 1 -- 172.21.15.172:0/323390033 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0011990 con 0x7f71f015c8f0 2023-03-27T10:10:53.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.066+0000 7f71e7fff700 1 -- 172.21.15.172:0/323390033 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011d20 con 0x7f71f015c8f0 2023-03-27T10:10:53.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 -- 172.21.15.172:0/323390033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f015c8f0 msgr2=0x7f71f006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 --2- 172.21.15.172:0/323390033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f015c8f0 0x7f71f006f710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71f0070860 tx=0x7f71e0009b20 comp rx=0 tx=0).stop 2023-03-27T10:10:53.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 -- 172.21.15.172:0/323390033 shutdown_connections 2023-03-27T10:10:53.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 --2- 172.21.15.172:0/323390033 >> v2:172.21.15.191:3300/0 conn(0x7f71f006be30 0x7f71f006c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 --2- 172.21.15.172:0/323390033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f015c8f0 0x7f71f006f710 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 -- 172.21.15.172:0/323390033 >> 172.21.15.172:0/323390033 conn(0x7f71f006dd60 msgr2=0x7f71f006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:53.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 -- 172.21.15.172:0/323390033 shutdown_connections 2023-03-27T10:10:53.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.067+0000 7f71f77ff700 1 -- 172.21.15.172:0/323390033 wait complete. 2023-03-27T10:10:53.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.069+0000 7f71f77ff700 1 Processor -- start 2023-03-27T10:10:53.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.069+0000 7f71f77ff700 1 -- start start 2023-03-27T10:10:53.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f77ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 0x7f71f0157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f77ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f00cd760 0x7f71f00cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f77ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71f015c8f0 0x7f71f00cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f77ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00ae250 con 0x7f71f006be30 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f77ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0158580 con 0x7f71f00cd760 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f77ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00b61d0 con 0x7f71f015c8f0 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 0x7f71f0157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 0x7f71f0157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43836/0 (socket says 172.21.15.172:43836) 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 -- 172.21.15.172:0/2795166476 learned_addr learned my addr 172.21.15.172:0/2795166476 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:53.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f5d9c700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71f015c8f0 0x7f71f00cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f4d9a700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f00cd760 0x7f71f00cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 -- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71f015c8f0 msgr2=0x7f71f00cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71f015c8f0 0x7f71f00cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 -- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f00cd760 msgr2=0x7f71f00cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f00cd760 0x7f71f00cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.070+0000 7f71f559b700 1 -- 172.21.15.172:0/2795166476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00094a0 con 0x7f71f006be30 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.071+0000 7f71f559b700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 0x7f71f0157a30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c4d0 tx=0x7f71ec00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.071+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00cea0 con 0x7f71f006be30 2023-03-27T10:10:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.071+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec005d70 con 0x7f71f006be30 2023-03-27T10:10:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.071+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f006b350 con 0x7f71f006be30 2023-03-27T10:10:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.071+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0072f0 con 0x7f71f006be30 2023-03-27T10:10:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.071+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f00d0a90 con 0x7f71f006be30 2023-03-27T10:10:53.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.072+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f006b630 con 0x7f71f006be30 2023-03-27T10:10:53.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.073+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f71ec019030 con 0x7f71f006be30 2023-03-27T10:10:53.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.074+0000 7f71e5ffb700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f71d4066e30 0x7f71d40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.074+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f71ec083260 con 0x7f71f006be30 2023-03-27T10:10:53.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.074+0000 7f71f4d9a700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f71d4066e30 0x7f71d40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.075+0000 7f71f4d9a700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f71d4066e30 0x7f71d40692e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71f015ccc0 tx=0x7f71e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.078+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f71ec0507c0 con 0x7f71f006be30 2023-03-27T10:10:53.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.268+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f0074290 con 0x7f71f006be30 2023-03-27T10:10:53.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.269+0000 7f71e5ffb700 1 -- 172.21.15.172:0/2795166476 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14446 (secure 0 0 0) 0x7f71ec053de0 con 0x7f71f006be30 2023-03-27T10:10:53.268 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:53.268 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":33,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:53.035360+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/4073767112":"2023-03-28T10:10:49.253015+0000","172.21.15.172:6833/4073767112":"2023-03-28T10:10:49.253015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:53.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.271+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f71d4066e30 msgr2=0x7f71d40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.271+0000 7f71f77ff700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f71d4066e30 0x7f71d40692e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71f015ccc0 tx=0x7f71e0008030 comp rx=0 tx=0).stop 2023-03-27T10:10:53.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.271+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 msgr2=0x7f71f0157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.271+0000 7f71f77ff700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 0x7f71f0157a30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c4d0 tx=0x7f71ec00c7e0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 shutdown_connections 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71f015c8f0 0x7f71f00cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f006be30 0x7f71f0157a30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f71d4066e30 0x7f71d40692e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 --2- 172.21.15.172:0/2795166476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71f00cd760 0x7f71f00cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 >> 172.21.15.172:0/2795166476 conn(0x7f71f006dd60 msgr2=0x7f71f0159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:53.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 shutdown_connections 2023-03-27T10:10:53.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.272+0000 7f71f77ff700 1 -- 172.21.15.172:0/2795166476 wait complete. 2023-03-27T10:10:53.288 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:53.288 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:53.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.477+0000 7f698bdff700 1 Processor -- start 2023-03-27T10:10:53.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.477+0000 7f698bdff700 1 -- start start 2023-03-27T10:10:53.476 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698bdff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f69840b1700 0x7f69840d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698bdff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69840b2020 0x7f69840d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698bdff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840d0880 con 0x7f69840d02c0 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698bdff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840cd680 con 0x7f69840b2020 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698bdff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840cd960 con 0x7f69840b1700 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69840b2020 0x7f69840d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69840b2020 0x7f69840d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43852/0 (socket says 172.21.15.172:43852) 2023-03-27T10:10:53.477 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 -- 172.21.15.172:0/423675756 learned_addr learned my addr 172.21.15.172:0/423675756 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:53.478 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f6989b9b700 1 --2- 172.21.15.172:0/423675756 >> v2:172.21.15.191:3300/0 conn(0x7f69840b1700 0x7f69840d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.479 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 -- 172.21.15.172:0/423675756 >> v2:172.21.15.191:3300/0 conn(0x7f69840b1700 msgr2=0x7f69840d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:53.479 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 --2- 172.21.15.172:0/423675756 >> v2:172.21.15.191:3300/0 conn(0x7f69840b1700 0x7f69840d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.479 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 -- 172.21.15.172:0/423675756 >> v1:172.21.15.191:6789/0 conn(0x7f69840d02c0 legacy=0x7f6984160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:53.479 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 -- 172.21.15.172:0/423675756 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840cdc40 con 0x7f69840b2020 2023-03-27T10:10:53.479 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f698a39c700 1 --2- 172.21.15.172:0/423675756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840d1030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f698408b220 tx=0x7f697c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323953c25a6f748a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f6988b99700 1 -- 172.21.15.172:0/423675756 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00e070 con 0x7f69840b2020 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f6988b99700 1 -- 172.21.15.172:0/423675756 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c003a20 con 0x7f69840b2020 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.478+0000 7f6988b99700 1 -- 172.21.15.172:0/423675756 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c003dd0 con 0x7f69840b2020 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 -- 172.21.15.172:0/423675756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 msgr2=0x7f69840d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 --2- 172.21.15.172:0/423675756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840d1030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f698408b220 tx=0x7f697c00b330 comp rx=0 tx=0).stop 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 -- 172.21.15.172:0/423675756 shutdown_connections 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 --2- 172.21.15.172:0/423675756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840d1030 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 --2- 172.21.15.172:0/423675756 >> v2:172.21.15.191:3300/0 conn(0x7f69840b1700 0x7f69840d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 -- 172.21.15.172:0/423675756 >> 172.21.15.172:0/423675756 conn(0x7f698409c260 msgr2=0x7f69840d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:53.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 -- 172.21.15.172:0/423675756 shutdown_connections 2023-03-27T10:10:53.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.479+0000 7f698bdff700 1 -- 172.21.15.172:0/423675756 wait complete. 2023-03-27T10:10:53.482 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.481+0000 7f698bdff700 1 Processor -- start 2023-03-27T10:10:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.481+0000 7f698bdff700 1 -- start start 2023-03-27T10:10:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698bdff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69840b1700 0x7f69841e8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698bdff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698bdff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69840d02c0 0x7f69840afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698bdff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c9980 con 0x7f69840b2020 2023-03-27T10:10:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698bdff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69841e91d0 con 0x7f69840b1700 2023-03-27T10:10:53.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698bdff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c8d70 con 0x7f69840d02c0 2023-03-27T10:10:53.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43868/0 (socket says 172.21.15.172:43868) 2023-03-27T10:10:53.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 -- 172.21.15.172:0/2830719277 learned_addr learned my addr 172.21.15.172:0/2830719277 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:53.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f6989b9b700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69840b1700 0x7f69841e8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698a39c700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69840d02c0 0x7f69840afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 -- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69840d02c0 msgr2=0x7f69840afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69840d02c0 0x7f69840afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 -- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69840b1700 msgr2=0x7f69841e8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69840b1700 0x7f69841e8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698939a700 1 -- 172.21.15.172:0/2830719277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009b30 con 0x7f69840b2020 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f6989b9b700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69840b1700 0x7f69841e8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:53.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.482+0000 7f698a39c700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69840d02c0 0x7f69840afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:53.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.483+0000 7f698939a700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840c6d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f697400b4a0 tx=0x7f697400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.483+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974011830 con 0x7f69840b2020 2023-03-27T10:10:53.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.483+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974011990 con 0x7f69840b2020 2023-03-27T10:10:53.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.483+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974011d40 con 0x7f69840b2020 2023-03-27T10:10:53.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.483+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69840cf450 con 0x7f69840b2020 2023-03-27T10:10:53.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.483+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69840cdf20 con 0x7f69840b2020 2023-03-27T10:10:53.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.484+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69840afb50 con 0x7f69840b2020 2023-03-27T10:10:53.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.485+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f697400f050 con 0x7f69840b2020 2023-03-27T10:10:53.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.485+0000 7f697a7fc700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6968066e30 0x7f69680692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.486+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6974083b90 con 0x7f69840b2020 2023-03-27T10:10:53.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.486+0000 7f6989b9b700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6968066e30 0x7f69680692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.488 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.487+0000 7f6989b9b700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6968066e30 0x7f69680692e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6980009820 tx=0x7f6980008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.489 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.490+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f69740510f0 con 0x7f69840b2020 2023-03-27T10:10:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.676+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f698406b2c0 con 0x7f69840b2020 2023-03-27T10:10:53.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.676+0000 7f697a7fc700 1 -- 172.21.15.172:0/2830719277 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6974015020 con 0x7f69840b2020 2023-03-27T10:10:53.676 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:53.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6968066e30 msgr2=0x7f69680692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6968066e30 0x7f69680692e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6980009820 tx=0x7f6980008040 comp rx=0 tx=0).stop 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 msgr2=0x7f69840c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840c6d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f697400b4a0 tx=0x7f697400b860 comp rx=0 tx=0).stop 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 shutdown_connections 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69840d02c0 0x7f69840afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6968066e30 0x7f69680692e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69840b1700 0x7f69841e8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 --2- 172.21.15.172:0/2830719277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69840b2020 0x7f69840c6d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 >> 172.21.15.172:0/2830719277 conn(0x7f698409c260 msgr2=0x7f698406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:53.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 shutdown_connections 2023-03-27T10:10:53.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.679+0000 7f698bdff700 1 -- 172.21.15.172:0/2830719277 wait complete. 2023-03-27T10:10:53.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:53.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.887+0000 7fa84cfff700 1 Processor -- start 2023-03-27T10:10:53.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.888+0000 7fa84cfff700 1 -- start start 2023-03-27T10:10:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84cfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b1700 0x7fa8480d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84cfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8480d02c0 0x7fa8480d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84cfff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa8480b2020 0x7fa848160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84cfff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480d0880 con 0x7fa8480d02c0 2023-03-27T10:10:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84cfff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480cd680 con 0x7fa8480b2020 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84cfff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480cd960 con 0x7fa8480b1700 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8480d02c0 0x7fa8480d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8480d02c0 0x7fa8480d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43882/0 (socket says 172.21.15.172:43882) 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 -- 172.21.15.172:0/2896318722 learned_addr learned my addr 172.21.15.172:0/2896318722 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa84659c700 1 --2- 172.21.15.172:0/2896318722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b1700 0x7fa8480d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa846d9d700 1 --2- 172.21.15.172:0/2896318722 >> v2:172.21.15.191:3300/0 conn(0x7fa8480b2020 0x7fa848160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 -- 172.21.15.172:0/2896318722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b1700 msgr2=0x7fa8480d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:53.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 --2- 172.21.15.172:0/2896318722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b1700 0x7fa8480d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 -- 172.21.15.172:0/2896318722 >> v2:172.21.15.191:3300/0 conn(0x7fa8480b2020 msgr2=0x7fa848160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:53.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 --2- 172.21.15.172:0/2896318722 >> v2:172.21.15.191:3300/0 conn(0x7fa8480b2020 0x7fa848160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.889+0000 7fa83ffff700 1 -- 172.21.15.172:0/2896318722 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480cdc40 con 0x7fa8480d02c0 2023-03-27T10:10:53.892 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.890+0000 7fa83ffff700 1 --2- 172.21.15.172:0/2896318722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8480d1030 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa8481615b0 tx=0x7fa830009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9351bd25e96d81a4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.894 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.890+0000 7fa845d9b700 1 -- 172.21.15.172:0/2896318722 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830011830 con 0x7fa8480d02c0 2023-03-27T10:10:53.894 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.890+0000 7fa845d9b700 1 -- 172.21.15.172:0/2896318722 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830011990 con 0x7fa8480d02c0 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.890+0000 7fa845d9b700 1 -- 172.21.15.172:0/2896318722 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830011d20 con 0x7fa8480d02c0 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.890+0000 7fa84cfff700 1 -- 172.21.15.172:0/2896318722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 msgr2=0x7fa8480d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.890+0000 7fa84cfff700 1 --2- 172.21.15.172:0/2896318722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8480d1030 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa8481615b0 tx=0x7fa830009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 -- 172.21.15.172:0/2896318722 shutdown_connections 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 --2- 172.21.15.172:0/2896318722 >> v2:172.21.15.191:3300/0 conn(0x7fa8480b2020 0x7fa848160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 --2- 172.21.15.172:0/2896318722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b1700 0x7fa8480d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.895 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 --2- 172.21.15.172:0/2896318722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8480d1030 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.896 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 -- 172.21.15.172:0/2896318722 >> 172.21.15.172:0/2896318722 conn(0x7fa84809c260 msgr2=0x7fa8480d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:53.896 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 -- 172.21.15.172:0/2896318722 shutdown_connections 2023-03-27T10:10:53.896 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.891+0000 7fa84cfff700 1 -- 172.21.15.172:0/2896318722 wait complete. 2023-03-27T10:10:53.896 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.892+0000 7fa84cfff700 1 Processor -- start 2023-03-27T10:10:53.896 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.892+0000 7fa84cfff700 1 -- start start 2023-03-27T10:10:53.896 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.893+0000 7fa84cfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 0x7fa848151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.893+0000 7fa84cfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b2020 0x7fa84815f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.893+0000 7fa84cfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8481f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.893+0000 7fa84cfff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480b7fa0 con 0x7fa8480d02c0 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.893+0000 7fa84cfff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848151950 con 0x7fa8480b1700 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.893+0000 7fa84cfff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84815cfb0 con 0x7fa8480b2020 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa846d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8481f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 0x7fa848151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 0x7fa848151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:50750/0 (socket says 172.21.15.172:50750) 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 -- 172.21.15.172:0/1679841251 learned_addr learned my addr 172.21.15.172:0/1679841251 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa83ffff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b2020 0x7fa84815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 -- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b2020 msgr2=0x7fa84815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b2020 0x7fa84815f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 -- 172.21.15.172:0/1679841251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 msgr2=0x7fa8481f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8481f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:53.898 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 -- 172.21.15.172:0/1679841251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830009550 con 0x7fa8480b1700 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa846d9d700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8481f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.894+0000 7fa84659c700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 0x7fa848151410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e870 tx=0x7fa83800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.895+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838005a20 con 0x7fa8480b1700 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.895+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838005b80 con 0x7fa8480b1700 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.895+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480afb50 con 0x7fa8480b1700 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.895+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838013680 con 0x7fa8480b1700 2023-03-27T10:10:53.899 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.895+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480cdf20 con 0x7fa8480b1700 2023-03-27T10:10:53.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.896+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8480d2c50 con 0x7fa8480b1700 2023-03-27T10:10:53.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.897+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fa838022070 con 0x7fa8480b1700 2023-03-27T10:10:53.900 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.897+0000 7fa83effd700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa828066e30 0x7fa8280692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:53.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.898+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa838083ea0 con 0x7fa8480b1700 2023-03-27T10:10:53.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.898+0000 7fa83ffff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa828066e30 0x7fa8280692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:53.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.898+0000 7fa83ffff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa828066e30 0x7fa8280692e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa830009c10 tx=0x7fa83001d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:53.901 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:53.902+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fa8380513a0 con 0x7fa8480b1700 2023-03-27T10:10:54.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.092+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa848074300 con 0x7fa8480b1700 2023-03-27T10:10:54.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.093+0000 7fa83effd700 1 -- 172.21.15.172:0/1679841251 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8380549c0 con 0x7fa8480b1700 2023-03-27T10:10:54.093 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:54.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa828066e30 msgr2=0x7fa8280692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa828066e30 0x7fa8280692e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa830009c10 tx=0x7fa83001d040 comp rx=0 tx=0).stop 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 msgr2=0x7fa848151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 0x7fa848151410 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa83800e870 tx=0x7fa83800eb80 comp rx=0 tx=0).stop 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 shutdown_connections 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8480d02c0 0x7fa8481f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa828066e30 0x7fa8280692e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8480b1700 0x7fa848151410 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.096 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 --2- 172.21.15.172:0/1679841251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8480b2020 0x7fa84815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 >> 172.21.15.172:0/1679841251 conn(0x7fa84809c260 msgr2=0x7fa84806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 shutdown_connections 2023-03-27T10:10:54.097 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.096+0000 7fa84cfff700 1 -- 172.21.15.172:0/1679841251 wait complete. 2023-03-27T10:10:54.113 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-27T10:10:54.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.300+0000 7f36c11ff700 1 Processor -- start 2023-03-27T10:10:54.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.301+0000 7f36c11ff700 1 -- start start 2023-03-27T10:10:54.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.302+0000 7f36c11ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc15a240 0x7f36bc0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.302+0000 7f36c11ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36bc0d3a30 0x7f36bc0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.302+0000 7f36c11ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f36bc1604b0 0x7f36bc160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.302+0000 7f36c11ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc161200 con 0x7f36bc0d3a30 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.302+0000 7f36c11ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0d29d0 con 0x7f36bc1604b0 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.302+0000 7f36c11ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc15a610 con 0x7f36bc15a240 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36bc0d3a30 0x7f36bc0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36bc0d3a30 0x7f36bc0d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43890/0 (socket says 172.21.15.172:43890) 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 -- 172.21.15.172:0/2897325612 learned_addr learned my addr 172.21.15.172:0/2897325612 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36bb59e700 1 --2- 172.21.15.172:0/2897325612 >> v2:172.21.15.191:3300/0 conn(0x7f36bc1604b0 0x7f36bc160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36bad9d700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc15a240 0x7f36bc0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 -- 172.21.15.172:0/2897325612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc15a240 msgr2=0x7f36bc0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:54.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc15a240 0x7f36bc0d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 -- 172.21.15.172:0/2897325612 >> v2:172.21.15.191:3300/0 conn(0x7f36bc1604b0 msgr2=0x7f36bc160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:54.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 --2- 172.21.15.172:0/2897325612 >> v2:172.21.15.191:3300/0 conn(0x7f36bc1604b0 0x7f36bc160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 -- 172.21.15.172:0/2897325612 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0d2c70 con 0x7f36bc0d3a30 2023-03-27T10:10:54.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36bad9d700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc15a240 0x7f36bc0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.303+0000 7f36b3fff700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0d1000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36bc08c1b0 tx=0x7f36a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c70ed0a81f3508c server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36ba59c700 1 -- 172.21.15.172:0/2897325612 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4011830 con 0x7f36bc0d3a30 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36ba59c700 1 -- 172.21.15.172:0/2897325612 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4011990 con 0x7f36bc0d3a30 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36ba59c700 1 -- 172.21.15.172:0/2897325612 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4011d20 con 0x7f36bc0d3a30 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 -- 172.21.15.172:0/2897325612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc0d3a30 msgr2=0x7f36bc0d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0d1000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36bc08c1b0 tx=0x7f36a4009bd0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 -- 172.21.15.172:0/2897325612 shutdown_connections 2023-03-27T10:10:54.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 --2- 172.21.15.172:0/2897325612 >> v2:172.21.15.191:3300/0 conn(0x7f36bc1604b0 0x7f36bc160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc15a240 0x7f36bc0d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 --2- 172.21.15.172:0/2897325612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0d1000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 -- 172.21.15.172:0/2897325612 >> 172.21.15.172:0/2897325612 conn(0x7f36bc0721f0 msgr2=0x7f36bc09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 -- 172.21.15.172:0/2897325612 shutdown_connections 2023-03-27T10:10:54.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.304+0000 7f36c11ff700 1 -- 172.21.15.172:0/2897325612 wait complete. 2023-03-27T10:10:54.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.306+0000 7f36c11ff700 1 Processor -- start 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.306+0000 7f36c11ff700 1 -- start start 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36c11ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36c11ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 0x7f36bc153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36c11ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc1604b0 0x7f36bc1f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36c11ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c9cf0 con 0x7f36bc15a240 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36c11ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0b2c60 con 0x7f36bc0d3a30 2023-03-27T10:10:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36c11ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc153ff0 con 0x7f36bc1604b0 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 0x7f36bc153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36b3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 0x7f36bc153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43900/0 (socket says 172.21.15.172:43900) 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36b3fff700 1 -- 172.21.15.172:0/103017338 learned_addr learned my addr 172.21.15.172:0/103017338 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36bad9d700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.307+0000 7f36bb59e700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc1604b0 0x7f36bc1f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b3fff700 1 -- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc1604b0 msgr2=0x7f36bc1f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b3fff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc1604b0 0x7f36bc1f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b3fff700 1 -- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36bc0d3a30 msgr2=0x7f36bc0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:54.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b3fff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:54.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b3fff700 1 -- 172.21.15.172:0/103017338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009550 con 0x7f36bc15a240 2023-03-27T10:10:54.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36bb59e700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc1604b0 0x7f36bc1f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:54.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b3fff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 0x7f36bc153ab0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000c00 tx=0x7f36a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:54.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4004300 con 0x7f36bc15a240 2023-03-27T10:10:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a401f070 con 0x7f36bc15a240 2023-03-27T10:10:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc0d3230 con 0x7f36bc15a240 2023-03-27T10:10:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40036a0 con 0x7f36bc15a240 2023-03-27T10:10:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.308+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc0d2f50 con 0x7f36bc15a240 2023-03-27T10:10:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.309+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc0d3510 con 0x7f36bc15a240 2023-03-27T10:10:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.310+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f36a402a020 con 0x7f36bc15a240 2023-03-27T10:10:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.311+0000 7f36b37fe700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f369c066e30 0x7f369c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.311+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f36a40853b0 con 0x7f36bc15a240 2023-03-27T10:10:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.312+0000 7f36bad9d700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f369c066e30 0x7f369c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.312+0000 7f36bad9d700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f369c066e30 0x7f369c0692e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0045f0 tx=0x7f36ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:54.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.315+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f36a4052910 con 0x7f36bc15a240 2023-03-27T10:10:54.517 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:54.517+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f36bc074300 con 0x7f36bc15a240 2023-03-27T10:10:55.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.056+0000 7f36b37fe700 1 -- 172.21.15.172:0/103017338 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f36a4015080 con 0x7f36bc15a240 2023-03-27T10:10:55.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f369c066e30 msgr2=0x7f369c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f369c066e30 0x7f369c0692e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0045f0 tx=0x7f36ac008040 comp rx=0 tx=0).stop 2023-03-27T10:10:55.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 msgr2=0x7f36bc153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 0x7f36bc153ab0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000c00 tx=0x7f36a4004750 comp rx=0 tx=0).stop 2023-03-27T10:10:55.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 shutdown_connections 2023-03-27T10:10:55.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36bc1604b0 0x7f36bc1f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f369c066e30 0x7f369c0692e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36bc0d3a30 0x7f36bc0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 --2- 172.21.15.172:0/103017338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36bc15a240 0x7f36bc153ab0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 >> 172.21.15.172:0/103017338 conn(0x7f36bc0721f0 msgr2=0x7f36bc160910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:55.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 shutdown_connections 2023-03-27T10:10:55.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.059+0000 7f36c11ff700 1 -- 172.21.15.172:0/103017338 wait complete. 2023-03-27T10:10:55.063 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2023-03-27T10:10:55.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-27T10:10:55.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.264+0000 7f1f9dbff700 1 Processor -- start 2023-03-27T10:10:55.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.264+0000 7f1f9dbff700 1 -- start start 2023-03-27T10:10:55.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f9dbff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f980d0b90 0x7f1f980ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f9dbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9815ca20 0x7f1f980d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.271 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f9dbff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f980d14a0 con 0x7f1f980cd610 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f9dbff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f980cebc0 con 0x7f1f980d0b90 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f9dbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ceea0 con 0x7f1f9815ca20 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f97fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1f980cd610 0x7f1f980cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47766/0 (socket says 172.21.15.172:47766) 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f97fff700 1 -- 172.21.15.172:0/3655016236 learned_addr learned my addr 172.21.15.172:0/3655016236 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f977fe700 1 --2- 172.21.15.172:0/3655016236 >> v2:172.21.15.191:3300/0 conn(0x7f1f980d0b90 0x7f1f980ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.265+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9815ca20 0x7f1f980d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154846866 0 0) 0x7f1f980d14a0 con 0x7f1f980cd610 2023-03-27T10:10:55.272 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f840035b0 con 0x7f1f980cd610 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023529147 0 0) 0x7f1f840035b0 con 0x7f1f980cd610 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9815ca20 msgr2=0x7f1f980d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f9815ca20 0x7f1f980d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 >> v2:172.21.15.191:3300/0 conn(0x7f1f980d0b90 msgr2=0x7f1f980ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 --2- 172.21.15.172:0/3655016236 >> v2:172.21.15.191:3300/0 conn(0x7f1f980d0b90 0x7f1f980ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980cf180 con 0x7f1f980cd610 2023-03-27T10:10:55.273 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7f1f900019f0 con 0x7f1f980cd610 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 >> v1:172.21.15.172:6789/0 conn(0x7f1f980cd610 legacy=0x7f1f980cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f84003a70 0x7f1f84003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f84004850 0x7f1f84004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f8400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980cebc0 con 0x7f1f84005200 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ceea0 con 0x7f1f84004850 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8400bf50 con 0x7f1f84003a70 2023-03-27T10:10:55.274 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f97fff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f8400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f977fe700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f84003a70 0x7f1f84003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.266+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f84004850 0x7f1f84004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f97fff700 1 -- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f84003a70 msgr2=0x7f1f84003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f97fff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f84003a70 0x7f1f84003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f97fff700 1 -- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f84004850 msgr2=0x7f1f84004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f97fff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f84004850 0x7f1f84004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f97fff700 1 -- 172.21.15.172:0/3655016236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840035b0 con 0x7f1f84005200 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f84004850 0x7f1f84004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f97fff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f8400ba10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000a890 tx=0x7f1f84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44190d0281218ce server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012600 con 0x7f1f84005200 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90012780 con 0x7f1f84005200 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.267+0000 7f1f96ffd700 1 -- 172.21.15.172:0/3655016236 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012b30 con 0x7f1f84005200 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f9dbff700 1 -- 172.21.15.172:0/3655016236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 msgr2=0x7f1f8400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/3655016236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f8400ba10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000a890 tx=0x7f1f84005880 comp rx=0 tx=0).stop 2023-03-27T10:10:55.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f97fff700 1 -- 172.21.15.172:0/3655016236 reap_dead start 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f9dbff700 1 -- 172.21.15.172:0/3655016236 shutdown_connections 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f9dbff700 1 -- 172.21.15.172:0/3655016236 >> 172.21.15.172:0/3655016236 conn(0x7f1f980721f0 msgr2=0x7f1f9809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f9dbff700 1 -- 172.21.15.172:0/3655016236 shutdown_connections 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.268+0000 7f1f9dbff700 1 -- 172.21.15.172:0/3655016236 wait complete. 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.269+0000 7f1f9dbff700 1 Processor -- start 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 -- start start 2023-03-27T10:10:55.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f980ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9815be50 0x7f1f980ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f98152700 0x7f1f980cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980b8df0 con 0x7f1f84005200 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ca5d0 con 0x7f1f9815be50 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.270+0000 7f1f9dbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980b8830 con 0x7f1f98152700 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f980ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f980ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43922/0 (socket says 172.21.15.172:43922) 2023-03-27T10:10:55.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 -- 172.21.15.172:0/2914432261 learned_addr learned my addr 172.21.15.172:0/2914432261 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9815be50 0x7f1f980ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f97fff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f98152700 0x7f1f980cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 -- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f98152700 msgr2=0x7f1f980cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f98152700 0x7f1f980cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 -- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9815be50 msgr2=0x7f1f980ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9815be50 0x7f1f980ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 -- 172.21.15.172:0/2914432261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980afc50 con 0x7f1f84005200 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9815be50 0x7f1f980ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f97fff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f98152700 0x7f1f980cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.271+0000 7f1f977fe700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f980ccf50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1f88011a70 tx=0x7f1f88011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.272+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800fa00 con 0x7f1f84005200 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.272+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800fb80 con 0x7f1f84005200 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.272+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88014440 con 0x7f1f84005200 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.272+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980cf460 con 0x7f1f84005200 2023-03-27T10:10:55.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.272+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980d2d30 con 0x7f1f84005200 2023-03-27T10:10:55.281 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.273+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f98074290 con 0x7f1f84005200 2023-03-27T10:10:55.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.274+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f1f880145a0 con 0x7f1f84005200 2023-03-27T10:10:55.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.275+0000 7f1f94ff9700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1f78066e30 0x7f1f780692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.275+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1f88084810 con 0x7f1f84005200 2023-03-27T10:10:55.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.275+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1f78066e30 0x7f1f780692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.276+0000 7f1f8ffff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1f78066e30 0x7f1f780692e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f980b4e30 tx=0x7f1f80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:55.282 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.280+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f1f88051e50 con 0x7f1f84005200 2023-03-27T10:10:55.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.539+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1f980ccda0 con 0x7f1f84005200 2023-03-27T10:10:55.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.539+0000 7f1f94ff9700 1 -- 172.21.15.172:0/2914432261 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1f88022020 con 0x7f1f84005200 2023-03-27T10:10:55.539 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:55.539 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-03-27T10:10:55.539 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2023-03-27T10:10:55.539 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFkv41ICBAA1b5XrjcgRt2diuwr9OR/pg==", 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2023-03-27T10:10:55.540 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFkNismHRAAuGXMmtI6LzmG1Tx/ZkzXjw==", 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.541 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.542 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2023-03-27T10:10:55.542 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2023-03-27T10:10:55.542 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.542 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.542 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFkIHKgEhAAudffD5gEjBdW6cQIzyqi/A==", 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2023-03-27T10:10:55.543 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFk+xmnJxAAqXzUAg5y76wpMbgCcVGh0g==", 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.544 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2023-03-27T10:10:55.545 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2023-03-27T10:10:55.545 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.545 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.546 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.546 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.546 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA0ayFkyO5vHhAAVJ+ks5faLh3fGhC2GQl6Sw==", 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.547 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA3ayFkOl9dIRAAwOqqdoVcFYZcv71u57C7wQ==", 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.548 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6ayFk8rOjIxAABd44C0iZreRV7uilU0w6eg==", 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.549 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA9ayFkBToVJhAAyKRWJfeSYLmcfF3WdVBDWA==", 2023-03-27T10:10:55.550 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2023-03-27T10:10:55.551 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBDayFkUUItOBAAX3DOko3aJ7px9DnYDIKdRQ==", 2023-03-27T10:10:55.552 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.552 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.552 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.552 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.552 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBGayFkwOb3ORAAeZWII9RlgF5055utHJ216Q==", 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.553 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.554 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.554 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.554 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2023-03-27T10:10:55.554 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBKayFkeqpjABAAo9444OW4f2P6wovgr5Kcvg==", 2023-03-27T10:10:55.554 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.555 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2023-03-27T10:10:55.556 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNayFkuvBDBBAA2iOL6HvTDkB6gXlbrYNnbg==", 2023-03-27T10:10:55.556 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.556 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2023-03-27T10:10:55.556 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2023-03-27T10:10:55.557 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.557 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.557 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.557 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.558 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2023-03-27T10:10:55.558 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFkti8HMRAA7AeQdNDyHy9eMUqsjDFmag==", 2023-03-27T10:10:55.558 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.559 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.559 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2023-03-27T10:10:55.559 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2023-03-27T10:10:55.559 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2023-03-27T10:10:55.560 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.560 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.560 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.560 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2023-03-27T10:10:55.561 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAxayFkEhj/AhAAivUXiPFYB+TySkhSKO4rLw==", 2023-03-27T10:10:55.561 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.561 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.561 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2023-03-27T10:10:55.562 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2023-03-27T10:10:55.562 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2023-03-27T10:10:55.562 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.563 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.563 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.563 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2023-03-27T10:10:55.563 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFk5erDNxAAsDyN7lh2PRAm2jq/AfA0Zw==", 2023-03-27T10:10:55.563 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAxayFk2N3GCRAAzIxcbaxKGEW2EfnmhwLE+w==", 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2023-03-27T10:10:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA==", 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2023-03-27T10:10:55.566 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-mds", 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBUayFkWPJjLxAA/oUJHK+I7UkSHg7bMGz1YA==", 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.567 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-mds" 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-mgr", 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBUayFk1/tjLxAAjQYHgm8m3QsqMyGHuYhHzQ==", 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-mgr" 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-osd", 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBUayFkPAVkLxAAFbFd/13+GKG13szPDYTEVg==", 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.569 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-osd" 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-rbd", 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBUayFk2A1kLxAAUFnwEWkNdCBJETxTG7uRFA==", 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.570 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-rbd" 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBUayFkcxZkLxAAahtfN40pB9n8xJ6fc3fDaA==", 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-03-27T10:10:55.571 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-rgw", 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBUayFkPR9kLxAAczub5JKKc1ebQTPOw7mplQ==", 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-rgw" 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.573 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2023-03-27T10:10:55.573 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAwayFkhLhZARAA5ldUw+C1bq6aeI5S5B3A6A==", 2023-03-27T10:10:55.573 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.573 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2023-03-27T10:10:55.573 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQAvayFkJsZWNRAA7x7p80Lfd08hy867qxXypQ==", 2023-03-27T10:10:55.574 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2023-03-27T10:10:55.575 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-03-27T10:10:55.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1f78066e30 msgr2=0x7f1f780692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1f78066e30 0x7f1f780692e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f980b4e30 tx=0x7f1f80008040 comp rx=0 tx=0).stop 2023-03-27T10:10:55.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 msgr2=0x7f1f980ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f980ccf50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1f88011a70 tx=0x7f1f88011e30 comp rx=0 tx=0).stop 2023-03-27T10:10:55.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 shutdown_connections 2023-03-27T10:10:55.577 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f98152700 0x7f1f980cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f84005200 0x7f1f980ccf50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1f78066e30 0x7f1f780692e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 --2- 172.21.15.172:0/2914432261 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f9815be50 0x7f1f980ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 >> 172.21.15.172:0/2914432261 conn(0x7f1f980721f0 msgr2=0x7f1f9809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:55.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 shutdown_connections 2023-03-27T10:10:55.578 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.542+0000 7f1f9dbff700 1 -- 172.21.15.172:0/2914432261 wait complete. 2023-03-27T10:10:55.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-03-27T10:10:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.764+0000 7f0ee77ff700 1 Processor -- start 2023-03-27T10:10:55.764 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.764+0000 7f0ee77ff700 1 -- start start 2023-03-27T10:10:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.765+0000 7f0ee77ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ee00cd5e0 0x7f0ee006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.765+0000 7f0ee77ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee006fa10 0x7f0ee00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.765+0000 7f0ee77ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee00ce8a0 con 0x7f0ee0159070 2023-03-27T10:10:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.765+0000 7f0ee77ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee006c9f0 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.765+0000 7f0ee77ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00cda80 con 0x7f0ee006fa10 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ee00cd5e0 0x7f0ee006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ee00cd5e0 0x7f0ee006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43934/0 (socket says 172.21.15.172:43934) 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/548432981 learned_addr learned my addr 172.21.15.172:0/548432981 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee5d9c700 1 --2- 172.21.15.172:0/548432981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee006fa10 0x7f0ee00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/548432981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee006fa10 msgr2=0x7f0ee00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 --2- 172.21.15.172:0/548432981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee006fa10 0x7f0ee00caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.767 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/548432981 >> v1:172.21.15.191:6789/0 conn(0x7f0ee0159070 legacy=0x7f0ee00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.766+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/548432981 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00c9180 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.768 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee4d9a700 1 --2- 172.21.15.172:0/548432981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee006c4b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000bb90 tx=0x7f0ed000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a2f5603cad0c34 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:55.776 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ed7fff700 1 -- 172.21.15.172:0/548432981 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed000dc20 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.776 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ed7fff700 1 -- 172.21.15.172:0/548432981 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed000dd80 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.776 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ed7fff700 1 -- 172.21.15.172:0/548432981 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0017630 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.776 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 -- 172.21.15.172:0/548432981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 msgr2=0x7f0ee006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/548432981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee006c4b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000bb90 tx=0x7f0ed000bea0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 -- 172.21.15.172:0/548432981 shutdown_connections 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/548432981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee006fa10 0x7f0ee00caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/548432981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee006c4b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 -- 172.21.15.172:0/548432981 >> 172.21.15.172:0/548432981 conn(0x7f0ee006a1a0 msgr2=0x7f0ee006a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 -- 172.21.15.172:0/548432981 shutdown_connections 2023-03-27T10:10:55.777 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.767+0000 7f0ee77ff700 1 -- 172.21.15.172:0/548432981 wait complete. 2023-03-27T10:10:55.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.769+0000 7f0ee77ff700 1 Processor -- start 2023-03-27T10:10:55.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.769+0000 7f0ee77ff700 1 -- start start 2023-03-27T10:10:55.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee77ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee006fa10 0x7f0ee01e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee77ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee00c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee77ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee0159070 0x7f0ee00c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee77ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00c8a90 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee77ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01f2bd0 con 0x7f0ee006fa10 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee77ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01e7880 con 0x7f0ee0159070 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee4d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee00c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee4d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee00c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43950/0 (socket says 172.21.15.172:43950) 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.770+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/4293311579 learned_addr learned my addr 172.21.15.172:0/4293311579 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee5d9c700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee0159070 0x7f0ee00c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee559b700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee006fa10 0x7f0ee01e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee0159070 msgr2=0x7f0ee00c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee4d9a700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee0159070 0x7f0ee00c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee006fa10 msgr2=0x7f0ee01e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee4d9a700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee006fa10 0x7f0ee01e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee4d9a700 1 -- 172.21.15.172:0/4293311579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed000b7f0 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee4d9a700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee00c4670 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0019040 tx=0x7f0ed0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:55.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0004050 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed00041d0 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee00c93d0 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0004580 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.771+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee00cca40 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.772+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee00c96b0 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.773+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0ed001d030 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.775+0000 7f0ed5ffb700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0ec4066e30 0x7f0ec40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:55.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.775+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ed0085660 con 0x7f0ee00cd5e0 2023-03-27T10:10:55.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.775+0000 7f0ee559b700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0ec4066e30 0x7f0ec40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:55.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.776+0000 7f0ee559b700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0ec4066e30 0x7f0ec40692e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c5230 tx=0x7f0edc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:55.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:55.779+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f0ed0052bf0 con 0x7f0ee00cd5e0 2023-03-27T10:10:56.043 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.044+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f0ee00c96b0 con 0x7f0ee00cd5e0 2023-03-27T10:10:56.047 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.048+0000 7f0ed5ffb700 1 -- 172.21.15.172:0/4293311579 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0ed0056210 con 0x7f0ee00cd5e0 2023-03-27T10:10:56.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0ec4066e30 msgr2=0x7f0ec40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0ec4066e30 0x7f0ec40692e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c5230 tx=0x7f0edc009040 comp rx=0 tx=0).stop 2023-03-27T10:10:56.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 msgr2=0x7f0ee00c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee00c4670 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0019040 tx=0x7f0ed0004750 comp rx=0 tx=0).stop 2023-03-27T10:10:56.050 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 shutdown_connections 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ee0159070 0x7f0ee00c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0ec4066e30 0x7f0ec40692e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ee006fa10 0x7f0ee01e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 --2- 172.21.15.172:0/4293311579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee00cd5e0 0x7f0ee00c4670 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.050+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 >> 172.21.15.172:0/4293311579 conn(0x7f0ee006a1a0 msgr2=0x7f0ee0071120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.051+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 shutdown_connections 2023-03-27T10:10:56.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.051+0000 7f0ee77ff700 1 -- 172.21.15.172:0/4293311579 wait complete. 2023-03-27T10:10:56.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-03-27T10:10:56.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.252+0000 7ff16c3ff700 1 Processor -- start 2023-03-27T10:10:56.252 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.253+0000 7ff16c3ff700 1 -- start start 2023-03-27T10:10:56.253 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16c3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff1640d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16c3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1640b2020 0x7ff1640d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16c3ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1640d0880 con 0x7ff1640d02c0 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16c3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1640cd680 con 0x7ff1640b2020 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16c3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640cd960 con 0x7ff1640b1700 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16a99c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1640b2020 0x7ff1640d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16a19b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff1640d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.254 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16a99c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1640b2020 0x7ff1640d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:40580/0 (socket says 172.21.15.172:40580) 2023-03-27T10:10:56.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16a19b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff1640d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56806/0 (socket says 172.21.15.172:56806) 2023-03-27T10:10:56.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16a99c700 1 -- 172.21.15.172:0/3286341070 learned_addr learned my addr 172.21.15.172:0/3286341070 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:56.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.254+0000 7ff16999a700 1 --1- 172.21.15.172:0/3286341070 >> v1:172.21.15.191:6789/0 conn(0x7ff1640d02c0 0x7ff164160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.172:41504/0 (socket says 172.21.15.172:41504) 2023-03-27T10:10:56.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff16a19b700 1 -- 172.21.15.172:0/3286341070 >> v2:172.21.15.191:3300/0 conn(0x7ff1640b2020 msgr2=0x7ff1640d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:56.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff16a19b700 1 --2- 172.21.15.172:0/3286341070 >> v2:172.21.15.191:3300/0 conn(0x7ff1640b2020 0x7ff1640d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff16a19b700 1 -- 172.21.15.172:0/3286341070 >> v1:172.21.15.191:6789/0 conn(0x7ff1640d02c0 legacy=0x7ff164160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff16a19b700 1 -- 172.21.15.172:0/3286341070 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1640cdc40 con 0x7ff1640b1700 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff16a19b700 1 --2- 172.21.15.172:0/3286341070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff1640d0af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff160009820 tx=0x7ff160009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1509a03e81c8a4cc server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff169199700 1 -- 172.21.15.172:0/3286341070 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160005e30 con 0x7ff1640b1700 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff169199700 1 -- 172.21.15.172:0/3286341070 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160006030 con 0x7ff1640b1700 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.255+0000 7ff169199700 1 -- 172.21.15.172:0/3286341070 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600063c0 con 0x7ff1640b1700 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 -- 172.21.15.172:0/3286341070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 msgr2=0x7ff1640d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/3286341070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff1640d0af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff160009820 tx=0x7ff160009b30 comp rx=0 tx=0).stop 2023-03-27T10:10:56.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 -- 172.21.15.172:0/3286341070 shutdown_connections 2023-03-27T10:10:56.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/3286341070 >> v2:172.21.15.191:3300/0 conn(0x7ff1640b2020 0x7ff1640d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/3286341070 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff1640d0af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 -- 172.21.15.172:0/3286341070 >> 172.21.15.172:0/3286341070 conn(0x7ff16409c260 msgr2=0x7ff1640d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:56.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 -- 172.21.15.172:0/3286341070 shutdown_connections 2023-03-27T10:10:56.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.256+0000 7ff16c3ff700 1 -- 172.21.15.172:0/3286341070 wait complete. 2023-03-27T10:10:56.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.258+0000 7ff16c3ff700 1 Processor -- start 2023-03-27T10:10:56.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.258+0000 7ff16c3ff700 1 -- start start 2023-03-27T10:10:56.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16c3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff16414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16c3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 0x7ff1640d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16c3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1640d02c0 0x7ff1640d3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16c3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640cace0 con 0x7ff1640b2020 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16c3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16414d540 con 0x7ff1640d02c0 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16c3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16414d820 con 0x7ff1640b1700 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 0x7ff1640d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 0x7ff1640d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35938/0 (socket says 172.21.15.172:35938) 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 -- 172.21.15.172:0/2179266866 learned_addr learned my addr 172.21.15.172:0/2179266866 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16a99c700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1640d02c0 0x7ff1640d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16a19b700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff16414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 -- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 msgr2=0x7ff16414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff16414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 -- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1640d02c0 msgr2=0x7ff1640d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1640d02c0 0x7ff1640d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16999a700 1 -- 172.21.15.172:0/2179266866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160009430 con 0x7ff1640b2020 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.259+0000 7ff16a99c700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1640d02c0 0x7ff1640d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:56.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.260+0000 7ff16999a700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 0x7ff1640d2c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c520 tx=0x7ff15400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:56.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.260+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154005cb0 con 0x7ff1640b2020 2023-03-27T10:10:56.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.260+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154005e10 con 0x7ff1640b2020 2023-03-27T10:10:56.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.260+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540072d0 con 0x7ff1640b2020 2023-03-27T10:10:56.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.260+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1640cf450 con 0x7ff1640b2020 2023-03-27T10:10:56.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.260+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1640cdf20 con 0x7ff1640b2020 2023-03-27T10:10:56.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.261+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1640afb50 con 0x7ff1640b2020 2023-03-27T10:10:56.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.262+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff154019030 con 0x7ff1640b2020 2023-03-27T10:10:56.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.263+0000 7ff15affd700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff148066e30 0x7ff1480692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.263+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff1540830b0 con 0x7ff1640b2020 2023-03-27T10:10:56.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.263+0000 7ff16a19b700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff148066e30 0x7ff1480692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.264+0000 7ff16a19b700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff148066e30 0x7ff1480692e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff160000c00 tx=0x7ff160008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:56.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.267+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff15404b4f0 con 0x7ff1640b2020 2023-03-27T10:10:56.529 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.530+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff1640d29c0 con 0x7ff1640b2020 2023-03-27T10:10:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.535+0000 7ff15affd700 1 -- 172.21.15.172:0/2179266866 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff1540170a0 con 0x7ff1640b2020 2023-03-27T10:10:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.537+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff148066e30 msgr2=0x7ff1480692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.537+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff148066e30 0x7ff1480692e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff160000c00 tx=0x7ff160008070 comp rx=0 tx=0).stop 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.537+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 msgr2=0x7ff1640d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.537+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 0x7ff1640d2c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff15400c520 tx=0x7ff15400c830 comp rx=0 tx=0).stop 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 shutdown_connections 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff148066e30 0x7ff1480692e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1640d02c0 0x7ff1640d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1640b1700 0x7ff16414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 --2- 172.21.15.172:0/2179266866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1640b2020 0x7ff1640d2c00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 >> 172.21.15.172:0/2179266866 conn(0x7ff16409c260 msgr2=0x7ff16406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 shutdown_connections 2023-03-27T10:10:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.538+0000 7ff16c3ff700 1 -- 172.21.15.172:0/2179266866 wait complete. 2023-03-27T10:10:56.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-03-27T10:10:56.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.738+0000 7fcd3dfff700 1 Processor -- start 2023-03-27T10:10:56.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.739+0000 7fcd3dfff700 1 -- start start 2023-03-27T10:10:56.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd3dfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd3dfff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 0x7fcd380d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd3dfff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380d0880 con 0x7fcd380b2020 2023-03-27T10:10:56.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd3dfff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380cd680 con 0x7fcd380d02c0 2023-03-27T10:10:56.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd3dfff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380cd960 con 0x7fcd380b1700 2023-03-27T10:10:56.741 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd377fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.741 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd2ffff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 0x7fcd380d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd2ffff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 0x7fcd380d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:40610/0 (socket says 172.21.15.172:40610) 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd377fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.172:56820/0 (socket says 172.21.15.172:56820) 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.740+0000 7fcd2ffff700 1 -- 172.21.15.172:0/874938547 learned_addr learned my addr 172.21.15.172:0/874938547 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd377fe700 1 -- 172.21.15.172:0/874938547 >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 msgr2=0x7fcd380d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd377fe700 1 --2- 172.21.15.172:0/874938547 >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 0x7fcd380d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd377fe700 1 -- 172.21.15.172:0/874938547 >> v1:172.21.15.191:6789/0 conn(0x7fcd380b2020 legacy=0x7fcd38160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd377fe700 1 -- 172.21.15.172:0/874938547 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380cdc40 con 0x7fcd380b1700 2023-03-27T10:10:56.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd2ffff700 1 --2- 172.21.15.172:0/874938547 >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 0x7fcd380d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd377fe700 1 --2- 172.21.15.172:0/874938547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380d0af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009820 tx=0x7fcd28009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e71b8c11e6be452 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd36ffd700 1 -- 172.21.15.172:0/874938547 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28005e30 con 0x7fcd380b1700 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd36ffd700 1 -- 172.21.15.172:0/874938547 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28006030 con 0x7fcd380b1700 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.741+0000 7fcd36ffd700 1 -- 172.21.15.172:0/874938547 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280063c0 con 0x7fcd380b1700 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 -- 172.21.15.172:0/874938547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 msgr2=0x7fcd380d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/874938547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380d0af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009820 tx=0x7fcd28009b30 comp rx=0 tx=0).stop 2023-03-27T10:10:56.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 -- 172.21.15.172:0/874938547 shutdown_connections 2023-03-27T10:10:56.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/874938547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380d0af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/874938547 >> v2:172.21.15.191:3300/0 conn(0x7fcd380d02c0 0x7fcd380d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 -- 172.21.15.172:0/874938547 >> 172.21.15.172:0/874938547 conn(0x7fcd3809c260 msgr2=0x7fcd380d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:56.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 -- 172.21.15.172:0/874938547 shutdown_connections 2023-03-27T10:10:56.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.742+0000 7fcd3dfff700 1 -- 172.21.15.172:0/874938547 wait complete. 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.744+0000 7fcd3dfff700 1 Processor -- start 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.744+0000 7fcd3dfff700 1 -- start start 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd3dfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd3dfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 0x7fcd381503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd3dfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd380d02c0 0x7fcd38150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd3dfff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380cb480 con 0x7fcd380b2020 2023-03-27T10:10:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd3dfff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380cb150 con 0x7fcd380d02c0 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd3dfff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3815dbc0 con 0x7fcd380b1700 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 0x7fcd381503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 0x7fcd381503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35940/0 (socket says 172.21.15.172:35940) 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 -- 172.21.15.172:0/1568023349 learned_addr learned my addr 172.21.15.172:0/1568023349 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd377fe700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd37fff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd380d02c0 0x7fcd38150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 -- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 msgr2=0x7fcd380b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 -- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd380d02c0 msgr2=0x7fcd38150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd380d02c0 0x7fcd38150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd2ffff700 1 -- 172.21.15.172:0/1568023349 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009550 con 0x7fcd380b2020 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.745+0000 7fcd37fff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd380d02c0 0x7fcd38150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.746+0000 7fcd2ffff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 0x7fcd381503d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000ebe0 tx=0x7fcd20009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.746+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2000c8b0 con 0x7fcd380b2020 2023-03-27T10:10:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.746+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2000ca10 con 0x7fcd380b2020 2023-03-27T10:10:56.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.746+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2000cd80 con 0x7fcd380b2020 2023-03-27T10:10:56.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.746+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd28009430 con 0x7fcd380b2020 2023-03-27T10:10:56.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.746+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd380cf450 con 0x7fcd380b2020 2023-03-27T10:10:56.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.747+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd380cdf20 con 0x7fcd380b2020 2023-03-27T10:10:56.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.748+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fcd20019030 con 0x7fcd380b2020 2023-03-27T10:10:56.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.749+0000 7fcd34ff9700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcd18066e30 0x7fcd180692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:56.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.749+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcd20083eb0 con 0x7fcd380b2020 2023-03-27T10:10:56.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.749+0000 7fcd377fe700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcd18066e30 0x7fcd180692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:56.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.750+0000 7fcd377fe700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcd18066e30 0x7fcd180692e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd28000c00 tx=0x7fcd28008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:56.753+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fcd20051530 con 0x7fcd380b2020 2023-03-27T10:10:57.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.015+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fcd380afb50 con 0x7fcd380b2020 2023-03-27T10:10:57.018 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.019+0000 7fcd34ff9700 1 -- 172.21.15.172:0/1568023349 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcd20054b50 con 0x7fcd380b2020 2023-03-27T10:10:57.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.021+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcd18066e30 msgr2=0x7fcd180692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.021+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcd18066e30 0x7fcd180692e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd28000c00 tx=0x7fcd28008070 comp rx=0 tx=0).stop 2023-03-27T10:10:57.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.021+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 msgr2=0x7fcd381503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.021 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.021+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 0x7fcd381503d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000ebe0 tx=0x7fcd20009e70 comp rx=0 tx=0).stop 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 shutdown_connections 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcd18066e30 0x7fcd180692e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd380d02c0 0x7fcd38150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd380b1700 0x7fcd380b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 --2- 172.21.15.172:0/1568023349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd380b2020 0x7fcd381503d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 >> 172.21.15.172:0/1568023349 conn(0x7fcd3809c260 msgr2=0x7fcd3806aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 shutdown_connections 2023-03-27T10:10:57.023 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.022+0000 7fcd3dfff700 1 -- 172.21.15.172:0/1568023349 wait complete. 2023-03-27T10:10:57.038 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-03-27T10:10:57.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.223+0000 7fcfebdff700 1 Processor -- start 2023-03-27T10:10:57.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.223+0000 7fcfebdff700 1 -- start start 2023-03-27T10:10:57.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfebdff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcfe40d1200 0x7fcfe40ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfebdff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcfe40d02c0 0x7fcfe40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfebdff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe40d0880 con 0x7fcfe40b1700 2023-03-27T10:10:57.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfebdff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40cd680 con 0x7fcfe40d02c0 2023-03-27T10:10:57.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfebdff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40cd960 con 0x7fcfe40d1200 2023-03-27T10:10:57.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcfe40d02c0 0x7fcfe40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcfe40d02c0 0x7fcfe40ce980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35950/0 (socket says 172.21.15.172:35950) 2023-03-27T10:10:57.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 -- 172.21.15.172:0/1996004613 learned_addr learned my addr 172.21.15.172:0/1996004613 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:57.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfe939a700 1 --2- 172.21.15.172:0/1996004613 >> v2:172.21.15.191:3300/0 conn(0x7fcfe40d1200 0x7fcfe40ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 -- 172.21.15.172:0/1996004613 >> v2:172.21.15.191:3300/0 conn(0x7fcfe40d1200 msgr2=0x7fcfe40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:57.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 --2- 172.21.15.172:0/1996004613 >> v2:172.21.15.191:3300/0 conn(0x7fcfe40d1200 0x7fcfe40ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 -- 172.21.15.172:0/1996004613 >> v1:172.21.15.191:6789/0 conn(0x7fcfe40b1700 legacy=0x7fcfe40d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.225+0000 7fcfea39c700 1 -- 172.21.15.172:0/1996004613 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40cdc40 con 0x7fcfe40d02c0 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.226+0000 7fcfea39c700 1 --2- 172.21.15.172:0/1996004613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe40ce980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40c9f80 tx=0x7fcfdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca06ac99d070b11 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.226+0000 7fcfe8b99700 1 -- 172.21.15.172:0/1996004613 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00e070 con 0x7fcfe40d02c0 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.226+0000 7fcfe8b99700 1 -- 172.21.15.172:0/1996004613 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc00b910 con 0x7fcfe40d02c0 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.226+0000 7fcfe8b99700 1 -- 172.21.15.172:0/1996004613 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00bcc0 con 0x7fcfe40d02c0 2023-03-27T10:10:57.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.226+0000 7fcfebdff700 1 -- 172.21.15.172:0/1996004613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 msgr2=0x7fcfe40ce980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.232 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.226+0000 7fcfebdff700 1 --2- 172.21.15.172:0/1996004613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe40ce980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40c9f80 tx=0x7fcfdc00b330 comp rx=0 tx=0).stop 2023-03-27T10:10:57.232 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.227+0000 7fcfebdff700 1 -- 172.21.15.172:0/1996004613 shutdown_connections 2023-03-27T10:10:57.232 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.227+0000 7fcfebdff700 1 --2- 172.21.15.172:0/1996004613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe40ce980 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.232 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.227+0000 7fcfebdff700 1 --2- 172.21.15.172:0/1996004613 >> v2:172.21.15.191:3300/0 conn(0x7fcfe40d1200 0x7fcfe40ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.232 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.227+0000 7fcfebdff700 1 -- 172.21.15.172:0/1996004613 >> 172.21.15.172:0/1996004613 conn(0x7fcfe409c260 msgr2=0x7fcfe40d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:57.232 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.227+0000 7fcfebdff700 1 -- 172.21.15.172:0/1996004613 shutdown_connections 2023-03-27T10:10:57.233 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.227+0000 7fcfebdff700 1 -- 172.21.15.172:0/1996004613 wait complete. 2023-03-27T10:10:57.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.228+0000 7fcfebdff700 1 Processor -- start 2023-03-27T10:10:57.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.228+0000 7fcfebdff700 1 -- start start 2023-03-27T10:10:57.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.229+0000 7fcfebdff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfe40b1700 0x7fcfe415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.229+0000 7fcfebdff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.229+0000 7fcfebdff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfe40d1200 0x7fcfe4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.236 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.229+0000 7fcfebdff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40b1ad0 con 0x7fcfe40d02c0 2023-03-27T10:10:57.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.229+0000 7fcfebdff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40ccdc0 con 0x7fcfe40b1700 2023-03-27T10:10:57.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.229+0000 7fcfebdff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40b1d20 con 0x7fcfe40d1200 2023-03-27T10:10:57.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe415dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35956/0 (socket says 172.21.15.172:35956) 2023-03-27T10:10:57.237 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 -- 172.21.15.172:0/3096288398 learned_addr learned my addr 172.21.15.172:0/3096288398 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:57.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe9b9b700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfe40b1700 0x7fcfe415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfea39c700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfe40d1200 0x7fcfe4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 -- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfe40d1200 msgr2=0x7fcfe4150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.238 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfe40d1200 0x7fcfe4150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 -- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfe40b1700 msgr2=0x7fcfe415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfe40b1700 0x7fcfe415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.239 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 -- 172.21.15.172:0/3096288398 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009b30 con 0x7fcfe40d02c0 2023-03-27T10:10:57.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe9b9b700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfe40b1700 0x7fcfe415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:57.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfea39c700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfe40d1200 0x7fcfe4150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:57.240 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfe939a700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe415dce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400e9b0 tx=0x7fcfd400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:57.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.230+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400c7f0 con 0x7fcfe40d02c0 2023-03-27T10:10:57.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.231+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd400c950 con 0x7fcfe40d02c0 2023-03-27T10:10:57.241 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.231+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe40afb50 con 0x7fcfe40d02c0 2023-03-27T10:10:57.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.231+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400ccc0 con 0x7fcfe40d02c0 2023-03-27T10:10:57.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.231+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40cdf20 con 0x7fcfe40d02c0 2023-03-27T10:10:57.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.232+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe40d2c50 con 0x7fcfe40d02c0 2023-03-27T10:10:57.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.233+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fcfd4019030 con 0x7fcfe40d02c0 2023-03-27T10:10:57.242 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.233+0000 7fcfda7fc700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcfc8066e30 0x7fcfc80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.233+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcfd4083f10 con 0x7fcfe40d02c0 2023-03-27T10:10:57.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.234+0000 7fcfe9b9b700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcfc8066e30 0x7fcfc80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.243 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.235+0000 7fcfe9b9b700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcfc8066e30 0x7fcfc80692e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000fb0 tx=0x7fcfe0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:57.244 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.237+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fcfd4051440 con 0x7fcfe40d02c0 2023-03-27T10:10:57.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.499+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fcfe4074300 con 0x7fcfe40d02c0 2023-03-27T10:10:57.502 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.503+0000 7fcfda7fc700 1 -- 172.21.15.172:0/3096288398 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcfd4054a60 con 0x7fcfe40d02c0 2023-03-27T10:10:57.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcfc8066e30 msgr2=0x7fcfc80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.505 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcfc8066e30 0x7fcfc80692e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000fb0 tx=0x7fcfe0009040 comp rx=0 tx=0).stop 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 msgr2=0x7fcfe415dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe415dce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400e9b0 tx=0x7fcfd400ed70 comp rx=0 tx=0).stop 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 shutdown_connections 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfe40d1200 0x7fcfe4150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fcfc8066e30 0x7fcfc80692e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfe40b1700 0x7fcfe415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.506 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 --2- 172.21.15.172:0/3096288398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe40d02c0 0x7fcfe415dce0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 >> 172.21.15.172:0/3096288398 conn(0x7fcfe409c260 msgr2=0x7fcfe406bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:57.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 shutdown_connections 2023-03-27T10:10:57.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.506+0000 7fcfebdff700 1 -- 172.21.15.172:0/3096288398 wait complete. 2023-03-27T10:10:57.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-03-27T10:10:57.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.708+0000 7f6dd73ff700 1 Processor -- start 2023-03-27T10:10:57.708 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.708+0000 7f6dd73ff700 1 -- start start 2023-03-27T10:10:57.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd73ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6dd00ce270 0x7f6dd00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.712 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd73ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd006b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd73ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00cb940 con 0x7f6dd015c620 2023-03-27T10:10:57.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd73ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00ce6e0 con 0x7f6dd00ce270 2023-03-27T10:10:57.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd73ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd006bc70 con 0x7f6dd006b2b0 2023-03-27T10:10:57.713 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd499a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6dd00ce270 0x7f6dd00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd499a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6dd00ce270 0x7f6dd00cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35966/0 (socket says 172.21.15.172:35966) 2023-03-27T10:10:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.709+0000 7f6dd499a700 1 -- 172.21.15.172:0/2863616348 learned_addr learned my addr 172.21.15.172:0/2863616348 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dd599c700 1 --2- 172.21.15.172:0/2863616348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd006b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dd499a700 1 -- 172.21.15.172:0/2863616348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 msgr2=0x7f6dd006b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dd499a700 1 --2- 172.21.15.172:0/2863616348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd006b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dd499a700 1 -- 172.21.15.172:0/2863616348 >> v1:172.21.15.191:6789/0 conn(0x7f6dd015c620 legacy=0x7f6dd00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dd499a700 1 -- 172.21.15.172:0/2863616348 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00cc780 con 0x7f6dd00ce270 2023-03-27T10:10:57.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dd499a700 1 --2- 172.21.15.172:0/2863616348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd00ce270 0x7f6dd00cb400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00098f0 tx=0x7f6dc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bbace5a5bc7624 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:57.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dc7fff700 1 -- 172.21.15.172:0/2863616348 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000b8a0 con 0x7f6dd00ce270 2023-03-27T10:10:57.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dc7fff700 1 -- 172.21.15.172:0/2863616348 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc000ba00 con 0x7f6dd00ce270 2023-03-27T10:10:57.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.710+0000 7f6dc7fff700 1 -- 172.21.15.172:0/2863616348 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000bd90 con 0x7f6dd00ce270 2023-03-27T10:10:57.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 -- 172.21.15.172:0/2863616348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd00ce270 msgr2=0x7f6dd00cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/2863616348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd00ce270 0x7f6dd00cb400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00098f0 tx=0x7f6dc0009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:57.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 -- 172.21.15.172:0/2863616348 shutdown_connections 2023-03-27T10:10:57.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/2863616348 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd006b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/2863616348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd00ce270 0x7f6dd00cb400 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 -- 172.21.15.172:0/2863616348 >> 172.21.15.172:0/2863616348 conn(0x7f6dd0072230 msgr2=0x7f6dd006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:57.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 -- 172.21.15.172:0/2863616348 shutdown_connections 2023-03-27T10:10:57.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.711+0000 7f6dd73ff700 1 -- 172.21.15.172:0/2863616348 wait complete. 2023-03-27T10:10:57.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.713+0000 7f6dd73ff700 1 Processor -- start 2023-03-27T10:10:57.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.714+0000 7f6dd73ff700 1 -- start start 2023-03-27T10:10:57.724 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd73ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd0155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.724 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd73ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd00ce270 0x7f6dd006e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.724 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd73ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 0x7f6dd006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd73ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00c7260 con 0x7f6dd015c620 2023-03-27T10:10:57.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd73ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0156390 con 0x7f6dd00ce270 2023-03-27T10:10:57.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd73ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00c49b0 con 0x7f6dd006b2b0 2023-03-27T10:10:57.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 0x7f6dd006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 0x7f6dd006e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35978/0 (socket says 172.21.15.172:35978) 2023-03-27T10:10:57.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 -- 172.21.15.172:0/1588864020 learned_addr learned my addr 172.21.15.172:0/1588864020 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:57.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd499a700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd00ce270 0x7f6dd006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd519b700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd0155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 -- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 msgr2=0x7f6dd0155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd0155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 -- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd00ce270 msgr2=0x7f6dd006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.727 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd00ce270 0x7f6dd006e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.715+0000 7f6dd599c700 1 -- 172.21.15.172:0/1588864020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0009550 con 0x7f6dd015c620 2023-03-27T10:10:57.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.716+0000 7f6dd599c700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 0x7f6dd006e890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8007e40 tx=0x7f6dc800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:57.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.716+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800eea0 con 0x7f6dd015c620 2023-03-27T10:10:57.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.716+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8014420 con 0x7f6dd015c620 2023-03-27T10:10:57.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.716+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd00cbb70 con 0x7f6dd015c620 2023-03-27T10:10:57.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.716+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80147b0 con 0x7f6dd015c620 2023-03-27T10:10:57.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.716+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd015c9f0 con 0x7f6dd015c620 2023-03-27T10:10:57.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.717+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd00cbe50 con 0x7f6dd015c620 2023-03-27T10:10:57.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.718+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f6dc8012050 con 0x7f6dd015c620 2023-03-27T10:10:57.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.719+0000 7f6dc5ffb700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6db4066e30 0x7f6db40692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:57.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.719+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6dc8084670 con 0x7f6dd015c620 2023-03-27T10:10:57.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.719+0000 7f6dd519b700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6db4066e30 0x7f6db40692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:57.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.720+0000 7f6dd519b700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6db4066e30 0x7f6db40692e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc000fb0 tx=0x7f6dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:57.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.723+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f6dc8051c00 con 0x7f6dd015c620 2023-03-27T10:10:57.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.982+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6dd00ceed0 con 0x7f6dd015c620 2023-03-27T10:10:57.986 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.987+0000 7f6dc5ffb700 1 -- 172.21.15.172:0/1588864020 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6dc8055220 con 0x7f6dd015c620 2023-03-27T10:10:57.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6db4066e30 msgr2=0x7f6db40692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6db4066e30 0x7f6db40692e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc000fb0 tx=0x7f6dcc009040 comp rx=0 tx=0).stop 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 msgr2=0x7f6dd006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 0x7f6dd006e890 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8007e40 tx=0x7f6dc800e3c0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 shutdown_connections 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6dd015c620 0x7f6dd006e890 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6dd006b2b0 0x7f6dd0155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6db4066e30 0x7f6db40692e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 --2- 172.21.15.172:0/1588864020 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6dd00ce270 0x7f6dd006e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:57.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 >> 172.21.15.172:0/1588864020 conn(0x7f6dd0072230 msgr2=0x7f6dd00b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:57.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 shutdown_connections 2023-03-27T10:10:57.990 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:57.989+0000 7f6dd73ff700 1 -- 172.21.15.172:0/1588864020 wait complete. 2023-03-27T10:10:58.005 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-03-27T10:10:58.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.192+0000 7fed0f5ff700 1 Processor -- start 2023-03-27T10:10:58.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.192+0000 7fed0f5ff700 1 -- start start 2023-03-27T10:10:58.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0f5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fed0806ab40 0x7fed0815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0f5ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed08160980 con 0x7fed0806da00 2023-03-27T10:10:58.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0f5ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed081463e0 con 0x7fed08072400 2023-03-27T10:10:58.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0f5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed081611a0 con 0x7fed0806ab40 2023-03-27T10:10:58.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0d39b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fed0806da00 0x7fed0806ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54408/0 (socket says 172.21.15.172:54408) 2023-03-27T10:10:58.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0d39b700 1 -- 172.21.15.172:0/3938648474 learned_addr learned my addr 172.21.15.172:0/3938648474 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:58.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0db9c700 1 --2- 172.21.15.172:0/3938648474 >> v2:172.21.15.172:3300/0 conn(0x7fed0806ab40 0x7fed0815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fecfffff700 1 -- 172.21.15.172:0/3938648474 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142953370 0 0) 0x7fed08160980 con 0x7fed0806da00 2023-03-27T10:10:58.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fecfffff700 1 -- 172.21.15.172:0/3938648474 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf40035b0 con 0x7fed0806da00 2023-03-27T10:10:58.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0db9c700 1 -- 172.21.15.172:0/3938648474 >> v1:172.21.15.191:6789/0 conn(0x7fed08072400 legacy=0x7fed08160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0db9c700 1 -- 172.21.15.172:0/3938648474 >> v1:172.21.15.172:6789/0 conn(0x7fed0806da00 legacy=0x7fed0806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.194+0000 7fed0db9c700 1 -- 172.21.15.172:0/3938648474 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08160be0 con 0x7fed0806ab40 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0db9c700 1 --2- 172.21.15.172:0/3938648474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815e050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed00009d90 tx=0x7fed0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a109ed80a18dc03 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fecfffff700 1 -- 172.21.15.172:0/3938648474 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0000e070 con 0x7fed0806ab40 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fecfffff700 1 -- 172.21.15.172:0/3938648474 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0000bb20 con 0x7fed0806ab40 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fecfffff700 1 -- 172.21.15.172:0/3938648474 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00012430 con 0x7fed0806ab40 2023-03-27T10:10:58.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3938648474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 msgr2=0x7fed0815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3938648474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815e050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed00009d90 tx=0x7fed0000b330 comp rx=0 tx=0).stop 2023-03-27T10:10:58.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3938648474 shutdown_connections 2023-03-27T10:10:58.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3938648474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815e050 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3938648474 >> 172.21.15.172:0/3938648474 conn(0x7fed080b1010 msgr2=0x7fed080b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:58.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.195+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3938648474 shutdown_connections 2023-03-27T10:10:58.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.196+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3938648474 wait complete. 2023-03-27T10:10:58.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.197+0000 7fed0f5ff700 1 Processor -- start 2023-03-27T10:10:58.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.197+0000 7fed0f5ff700 1 -- start start 2023-03-27T10:10:58.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0f5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0f5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fed0806da00 0x7fed08144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0f5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed08072400 0x7fed080ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0f5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080cc1b0 con 0x7fed0806ab40 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0f5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed080cc490 con 0x7fed08072400 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0f5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed080cc770 con 0x7fed0806da00 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0d39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0d39b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35998/0 (socket says 172.21.15.172:35998) 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.198+0000 7fed0d39b700 1 -- 172.21.15.172:0/3503128745 learned_addr learned my addr 172.21.15.172:0/3503128745 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0db9c700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed08072400 0x7fed080ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0cb9a700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fed0806da00 0x7fed08144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0d39b700 1 -- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fed0806da00 msgr2=0x7fed08144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0d39b700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fed0806da00 0x7fed08144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0d39b700 1 -- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed08072400 msgr2=0x7fed080ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0d39b700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed08072400 0x7fed080ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0d39b700 1 -- 172.21.15.172:0/3503128745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00009a70 con 0x7fed0806ab40 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0db9c700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed08072400 0x7fed080ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:58.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0d39b700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815bf40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c700 tx=0x7fed0400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:58.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04005d70 con 0x7fed0806ab40 2023-03-27T10:10:58.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed040070d0 con 0x7fed0806ab40 2023-03-27T10:10:58.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0806a340 con 0x7fed0806ab40 2023-03-27T10:10:58.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04007460 con 0x7fed0806ab40 2023-03-27T10:10:58.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.199+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed08160ec0 con 0x7fed0806ab40 2023-03-27T10:10:58.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.200+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0806a620 con 0x7fed0806ab40 2023-03-27T10:10:58.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.201+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fed04019030 con 0x7fed0806ab40 2023-03-27T10:10:58.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.202+0000 7fecfdffb700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fecec066e30 0x7fecec0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.202+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fed04083560 con 0x7fed0806ab40 2023-03-27T10:10:58.203 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.203+0000 7fed0cb9a700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fecec066e30 0x7fecec0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.204 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.204+0000 7fed0cb9a700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fecec066e30 0x7fecec0692e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed080d01e0 tx=0x7fecf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:58.205 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.206+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fed04050a70 con 0x7fed0806ab40 2023-03-27T10:10:58.467 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.468+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fed08074300 con 0x7fed0806ab40 2023-03-27T10:10:58.471 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.472+0000 7fecfdffb700 1 -- 172.21.15.172:0/3503128745 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fed040170a0 con 0x7fed0806ab40 2023-03-27T10:10:58.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.474+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fecec066e30 msgr2=0x7fecec0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.474+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fecec066e30 0x7fecec0692e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed080d01e0 tx=0x7fecf8009040 comp rx=0 tx=0).stop 2023-03-27T10:10:58.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.474+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 msgr2=0x7fed0815bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.474+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815bf40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c700 tx=0x7fed0400cac0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.474 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 shutdown_connections 2023-03-27T10:10:58.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fecec066e30 0x7fecec0692e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed08072400 0x7fed080ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed0806ab40 0x7fed0815bf40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 --2- 172.21.15.172:0/3503128745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fed0806da00 0x7fed08144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.475 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 >> 172.21.15.172:0/3503128745 conn(0x7fed080b1010 msgr2=0x7fed080ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:58.476 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 shutdown_connections 2023-03-27T10:10:58.476 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.475+0000 7fed0f5ff700 1 -- 172.21.15.172:0/3503128745 wait complete. 2023-03-27T10:10:58.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:10:58.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.676+0000 7f0d7e3ff700 1 Processor -- start 2023-03-27T10:10:58.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.676+0000 7f0d7e3ff700 1 -- start start 2023-03-27T10:10:58.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.677+0000 7f0d7e3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0d780cd610 0x7f0d780ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d7e3ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780cebc0 con 0x7f0d780d0b90 2023-03-27T10:10:58.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d7e3ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780ceea0 con 0x7f0d7815ca20 2023-03-27T10:10:58.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d7e3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780cf180 con 0x7f0d780cd610 2023-03-27T10:10:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d77fff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0d780d0b90 0x7f0d780d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54422/0 (socket says 172.21.15.172:54422) 2023-03-27T10:10:58.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d77fff700 1 -- 172.21.15.172:0/2254028826 learned_addr learned my addr 172.21.15.172:0/2254028826 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:58.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2254028826 >> v2:172.21.15.191:3300/0 conn(0x7f0d780cd610 0x7f0d780ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204214992 0 0) 0x7f0d780cebc0 con 0x7f0d780d0b90 2023-03-27T10:10:58.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d600035b0 con 0x7f0d780d0b90 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605720892 0 0) 0x7f0d600035b0 con 0x7f0d780d0b90 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 >> v2:172.21.15.191:3300/0 conn(0x7f0d780cd610 msgr2=0x7f0d780ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 --2- 172.21.15.172:0/2254028826 >> v2:172.21.15.191:3300/0 conn(0x7f0d780cd610 0x7f0d780ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 >> v1:172.21.15.191:6789/0 conn(0x7f0d7815ca20 legacy=0x7f0d780b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.678+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780cf460 con 0x7f0d780d0b90 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7f0d680017f0 con 0x7f0d780d0b90 2023-03-27T10:10:58.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 >> v1:172.21.15.172:6789/0 conn(0x7f0d780d0b90 legacy=0x7f0d780d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d60003a70 0x7f0d60003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60004850 0x7f0d60004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d60005200 0x7f0d6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780cf180 con 0x7f0d60005200 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6000c0e0 con 0x7f0d60003a70 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6000c2a0 con 0x7f0d60004850 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d60005200 0x7f0d6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.682 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d77fff700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d60003a70 0x7f0d60003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d777fe700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60004850 0x7f0d60004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60004850 msgr2=0x7f0d60004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60004850 0x7f0d60004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d60003a70 msgr2=0x7f0d60003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d60003a70 0x7f0d60003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2254028826 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600035b0 con 0x7f0d60005200 2023-03-27T10:10:58.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d77fff700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d60003a70 0x7f0d60003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.679+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2254028826 reap_dead start 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d60005200 0x7f0d6000ba10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009fc0 tx=0x7f0d60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975729c9d996d92c server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70003a20 con 0x7f0d60005200 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7000f040 con 0x7f0d60005200 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d76ffd700 1 -- 172.21.15.172:0/2254028826 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70003de0 con 0x7f0d60005200 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2254028826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d60005200 msgr2=0x7f0d6000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d60005200 0x7f0d6000ba10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009fc0 tx=0x7f0d60005880 comp rx=0 tx=0).stop 2023-03-27T10:10:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2254028826 shutdown_connections 2023-03-27T10:10:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2254028826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d60005200 0x7f0d6000ba10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2254028826 >> 172.21.15.172:0/2254028826 conn(0x7f0d780721f0 msgr2=0x7f0d7809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2254028826 shutdown_connections 2023-03-27T10:10:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.680+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2254028826 wait complete. 2023-03-27T10:10:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.682+0000 7f0d7e3ff700 1 Processor -- start 2023-03-27T10:10:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.682+0000 7f0d7e3ff700 1 -- start start 2023-03-27T10:10:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.683+0000 7f0d7e3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60005200 0x7f0d7806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.683+0000 7f0d7e3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d78142420 0x7f0d780b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.683+0000 7f0d7e3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 0x7f0d780b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.683+0000 7f0d7e3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b5430 con 0x7f0d78142890 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.683+0000 7f0d7e3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7806bb30 con 0x7f0d78142420 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.683+0000 7f0d7e3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7806b550 con 0x7f0d60005200 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 0x7f0d780b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 0x7f0d780b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36008/0 (socket says 172.21.15.172:36008) 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2031614895 learned_addr learned my addr 172.21.15.172:0/2031614895 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:58.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d77fff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60005200 0x7f0d7806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d777fe700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d78142420 0x7f0d780b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60005200 msgr2=0x7f0d7806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60005200 0x7f0d7806bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d78142420 msgr2=0x7f0d780b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d78142420 0x7f0d780b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 -- 172.21.15.172:0/2031614895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780d2d30 con 0x7f0d78142890 2023-03-27T10:10:58.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d77fff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60005200 0x7f0d7806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d777fe700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d78142420 0x7f0d780b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d7c99c700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 0x7f0d780b4ef0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000ef30 tx=0x7f0d70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70003e90 con 0x7f0d78142890 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d70004230 con 0x7f0d78142890 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.684+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700045e0 con 0x7f0d78142890 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.685+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780afc50 con 0x7f0d78142890 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.685+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780ce500 con 0x7f0d78142890 2023-03-27T10:10:58.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.686+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d78074290 con 0x7f0d78142890 2023-03-27T10:10:58.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.687+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f0d70004740 con 0x7f0d78142890 2023-03-27T10:10:58.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.688+0000 7f0d74ff9700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0d64066e30 0x7f0d640692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:58.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.688+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d700852f0 con 0x7f0d78142890 2023-03-27T10:10:58.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.688+0000 7f0d77fff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0d64066e30 0x7f0d640692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:58.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.689+0000 7f0d77fff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0d64066e30 0x7f0d640692e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:58.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.692+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f0d70052970 con 0x7f0d78142890 2023-03-27T10:10:58.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.883+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d7806bc70 con 0x7f0d78142890 2023-03-27T10:10:58.883 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.884+0000 7f0d74ff9700 1 -- 172.21.15.172:0/2031614895 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14315 (secure 0 0 0) 0x7f0d70018020 con 0x7f0d78142890 2023-03-27T10:10:58.883 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:10:58.884 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":34,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:10:55.050752+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:10:58.885 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0d64066e30 msgr2=0x7f0d640692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0d64066e30 0x7f0d640692e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d68009040 comp rx=0 tx=0).stop 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 msgr2=0x7f0d780b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 0x7f0d780b4ef0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000ef30 tx=0x7f0d70009750 comp rx=0 tx=0).stop 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 shutdown_connections 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d78142890 0x7f0d780b4ef0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0d60005200 0x7f0d7806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.886 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f0d64066e30 0x7f0d640692e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 --2- 172.21.15.172:0/2031614895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0d78142420 0x7f0d780b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:58.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 >> 172.21.15.172:0/2031614895 conn(0x7f0d780721f0 msgr2=0x7f0d7809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:58.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 shutdown_connections 2023-03-27T10:10:58.887 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:58.886+0000 7f0d7e3ff700 1 -- 172.21.15.172:0/2031614895 wait complete. 2023-03-27T10:10:58.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-03-27T10:09:39.328496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-03-27T10:09:44.548058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-27T10:10:58.903 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-27T10:10:59.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.093+0000 7f2277dff700 1 Processor -- start 2023-03-27T10:10:59.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.093+0000 7f2277dff700 1 -- start start 2023-03-27T10:10:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.094+0000 7f2277dff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f22700d02c0 0x7f22700ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.094+0000 7f2277dff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700d0880 con 0x7f22700b1700 2023-03-27T10:10:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.094+0000 7f2277dff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700cd680 con 0x7f22700d1200 2023-03-27T10:10:59.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.094+0000 7f2277dff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700cd960 con 0x7f22700d02c0 2023-03-27T10:10:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.094+0000 7f2275b9b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f22700b1700 0x7f22700d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54436/0 (socket says 172.21.15.172:54436) 2023-03-27T10:10:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.094+0000 7f2275b9b700 1 -- 172.21.15.172:0/661942544 learned_addr learned my addr 172.21.15.172:0/661942544 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:10:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f227639c700 1 --2- 172.21.15.172:0/661942544 >> v2:172.21.15.191:3300/0 conn(0x7f22700d02c0 0x7f22700ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866373244 0 0) 0x7f22700d0880 con 0x7f22700b1700 2023-03-27T10:10:59.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c0035b0 con 0x7f22700b1700 2023-03-27T10:10:59.098 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1487688980 0 0) 0x7f225c0035b0 con 0x7f22700b1700 2023-03-27T10:10:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 >> v2:172.21.15.191:3300/0 conn(0x7f22700d02c0 msgr2=0x7f22700ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 --2- 172.21.15.172:0/661942544 >> v2:172.21.15.191:3300/0 conn(0x7f22700d02c0 0x7f22700ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 >> v1:172.21.15.191:6789/0 conn(0x7f22700d1200 legacy=0x7f22700ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.099 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700cdc40 con 0x7f22700b1700 2023-03-27T10:10:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7f226c0017f0 con 0x7f22700b1700 2023-03-27T10:10:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 >> v1:172.21.15.172:6789/0 conn(0x7f22700b1700 legacy=0x7f22700d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.100 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f225c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f225c004850 0x7f225c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f225c005200 0x7f225c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.101 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700cd960 con 0x7f225c003a00 2023-03-27T10:10:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c00c110 con 0x7f225c004850 2023-03-27T10:10:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.095+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c00c2d0 con 0x7f225c005200 2023-03-27T10:10:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f225c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f227539a700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f225c004850 0x7f225c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f227639c700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f225c005200 0x7f225c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 -- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f225c005200 msgr2=0x7f225c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:59.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f225c005200 0x7f225c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 -- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f225c004850 msgr2=0x7f225c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f225c004850 0x7f225c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 -- 172.21.15.172:0/661942544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0035b0 con 0x7f225c003a00 2023-03-27T10:10:59.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f227539a700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f225c004850 0x7f225c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f227639c700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f225c005200 0x7f225c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f227639c700 1 -- 172.21.15.172:0/661942544 reap_dead start 2023-03-27T10:10:59.105 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2275b9b700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f225c003e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c240 tx=0x7f225c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad1b84091ecfd6 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c007c00 con 0x7f225c003a00 2023-03-27T10:10:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c00ce00 con 0x7f225c003a00 2023-03-27T10:10:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.096+0000 7f2274b99700 1 -- 172.21.15.172:0/661942544 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c007310 con 0x7f225c003a00 2023-03-27T10:10:59.106 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 -- 172.21.15.172:0/661942544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 msgr2=0x7f225c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f225c003e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c240 tx=0x7f225c005880 comp rx=0 tx=0).stop 2023-03-27T10:10:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 -- 172.21.15.172:0/661942544 shutdown_connections 2023-03-27T10:10:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 --2- 172.21.15.172:0/661942544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f225c003e10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 -- 172.21.15.172:0/661942544 >> 172.21.15.172:0/661942544 conn(0x7f227009c260 msgr2=0x7f22700d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 -- 172.21.15.172:0/661942544 shutdown_connections 2023-03-27T10:10:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.097+0000 7f2277dff700 1 -- 172.21.15.172:0/661942544 wait complete. 2023-03-27T10:10:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.099+0000 7f2277dff700 1 Processor -- start 2023-03-27T10:10:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.099+0000 7f2277dff700 1 -- start start 2023-03-27T10:10:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2277dff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f22700cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2277dff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22700c9ff0 0x7f227006ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2277dff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f227006b3d0 0x7f2270143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2277dff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700b8c30 con 0x7f225c003a00 2023-03-27T10:10:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2277dff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227006b840 con 0x7f227006b3d0 2023-03-27T10:10:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2277dff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700cbc80 con 0x7f22700c9ff0 2023-03-27T10:10:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f22700cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f22700cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36020/0 (socket says 172.21.15.172:36020) 2023-03-27T10:10:59.116 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 -- 172.21.15.172:0/3554612546 learned_addr learned my addr 172.21.15.172:0/3554612546 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:59.116 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f227639c700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f227006b3d0 0x7f2270143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.116 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f227539a700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22700c9ff0 0x7f227006ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 -- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22700c9ff0 msgr2=0x7f227006ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22700c9ff0 0x7f227006ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 -- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f227006b3d0 msgr2=0x7f2270143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f227006b3d0 0x7f2270143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f2275b9b700 1 -- 172.21.15.172:0/3554612546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700afb50 con 0x7f225c003a00 2023-03-27T10:10:59.117 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.100+0000 7f227639c700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f227006b3d0 0x7f2270143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:10:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.101+0000 7f2275b9b700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f22700cca40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f226c000ef0 tx=0x7f22700cd570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.101+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0015b0 con 0x7f225c003a00 2023-03-27T10:10:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.101+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c001730 con 0x7f225c003a00 2023-03-27T10:10:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.101+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22700cdf20 con 0x7f225c003a00 2023-03-27T10:10:59.118 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.101+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c005a70 con 0x7f225c003a00 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.101+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700d2c50 con 0x7f225c003a00 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.102+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2270074300 con 0x7f225c003a00 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.103+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f226c010070 con 0x7f225c003a00 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.104+0000 7f22667fc700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2254066e30 0x7f22540692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.104+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f226c084a50 con 0x7f225c003a00 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.104+0000 7f227539a700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2254066e30 0x7f22540692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.119 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.105+0000 7f227539a700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2254066e30 0x7f22540692e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f227015bc80 tx=0x7f2260009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.120 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.108+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f226c0520d0 con 0x7f225c003a00 2023-03-27T10:10:59.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.298+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f227008c6e0 con 0x7f225c003a00 2023-03-27T10:10:59.298 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.299+0000 7f22667fc700 1 -- 172.21.15.172:0/3554612546 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f226c0210a0 con 0x7f225c003a00 2023-03-27T10:10:59.299 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-03-27T10:10:59.300 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2254066e30 msgr2=0x7f22540692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2254066e30 0x7f22540692e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f227015bc80 tx=0x7f2260009040 comp rx=0 tx=0).stop 2023-03-27T10:10:59.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 msgr2=0x7f22700cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f22700cca40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f226c000ef0 tx=0x7f22700cd570 comp rx=0 tx=0).stop 2023-03-27T10:10:59.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 shutdown_connections 2023-03-27T10:10:59.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2254066e30 0x7f22540692e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.301 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f227006b3d0 0x7f2270143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f225c003a00 0x7f22700cca40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 --2- 172.21.15.172:0/3554612546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f22700c9ff0 0x7f227006ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 >> 172.21.15.172:0/3554612546 conn(0x7f227009c260 msgr2=0x7f227006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:59.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 shutdown_connections 2023-03-27T10:10:59.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.301+0000 7f2277dff700 1 -- 172.21.15.172:0/3554612546 wait complete. 2023-03-27T10:10:59.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-27T10:10:59.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.507+0000 7fc7eebff700 1 Processor -- start 2023-03-27T10:10:59.507 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.507+0000 7fc7eebff700 1 -- start start 2023-03-27T10:10:59.511 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.508+0000 7fc7eebff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7e815a240 0x7fc7e80d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.508+0000 7fc7eebff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e80d3a30 0x7fc7e80d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.508+0000 7fc7eebff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e80d29d0 con 0x7fc7e81604b0 2023-03-27T10:10:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.508+0000 7fc7eebff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e8161020 con 0x7fc7e815a240 2023-03-27T10:10:59.512 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.508+0000 7fc7eebff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e8161200 con 0x7fc7e80d3a30 2023-03-27T10:10:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.508+0000 7fc7ec99b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7e815a240 0x7fc7e80d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7e815a240 0x7fc7e80d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36026/0 (socket says 172.21.15.172:36026) 2023-03-27T10:10:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 -- 172.21.15.172:0/3324897975 learned_addr learned my addr 172.21.15.172:0/3324897975 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7e7fff700 1 --2- 172.21.15.172:0/3324897975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e80d3a30 0x7fc7e80d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.513 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 -- 172.21.15.172:0/3324897975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e80d3a30 msgr2=0x7fc7e80d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:59.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 --2- 172.21.15.172:0/3324897975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e80d3a30 0x7fc7e80d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 -- 172.21.15.172:0/3324897975 >> v1:172.21.15.191:6789/0 conn(0x7fc7e81604b0 legacy=0x7fc7e8160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 -- 172.21.15.172:0/3324897975 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e815a610 con 0x7fc7e815a240 2023-03-27T10:10:59.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7ec99b700 1 --2- 172.21.15.172:0/3324897975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e815a240 0x7fc7e80d0ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0098f0 tx=0x7fc7dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f6457a8abf841a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.509+0000 7fc7e77fe700 1 -- 172.21.15.172:0/3324897975 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00b8a0 con 0x7fc7e815a240 2023-03-27T10:10:59.514 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7e77fe700 1 -- 172.21.15.172:0/3324897975 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00ba00 con 0x7fc7e815a240 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7e77fe700 1 -- 172.21.15.172:0/3324897975 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00bd90 con 0x7fc7e815a240 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 -- 172.21.15.172:0/3324897975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e815a240 msgr2=0x7fc7e80d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 --2- 172.21.15.172:0/3324897975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e815a240 0x7fc7e80d0ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0098f0 tx=0x7fc7dc009c00 comp rx=0 tx=0).stop 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 -- 172.21.15.172:0/3324897975 shutdown_connections 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 --2- 172.21.15.172:0/3324897975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e815a240 0x7fc7e80d0ac0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 --2- 172.21.15.172:0/3324897975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e80d3a30 0x7fc7e80d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.515 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 -- 172.21.15.172:0/3324897975 >> 172.21.15.172:0/3324897975 conn(0x7fc7e80721f0 msgr2=0x7fc7e809c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:59.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 -- 172.21.15.172:0/3324897975 shutdown_connections 2023-03-27T10:10:59.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.510+0000 7fc7eebff700 1 -- 172.21.15.172:0/3324897975 wait complete. 2023-03-27T10:10:59.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.512+0000 7fc7eebff700 1 Processor -- start 2023-03-27T10:10:59.516 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.512+0000 7fc7eebff700 1 -- start start 2023-03-27T10:10:59.518 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7eebff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 0x7fc7e815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7eebff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e815a240 0x7fc7e80b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7eebff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7e81604b0 0x7fc7e80c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7eebff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80b3170 con 0x7fc7e80d3a30 2023-03-27T10:10:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7eebff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e815cd40 con 0x7fc7e81604b0 2023-03-27T10:10:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7eebff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80b2560 con 0x7fc7e815a240 2023-03-27T10:10:59.519 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 0x7fc7e815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 0x7fc7e815c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36034/0 (socket says 172.21.15.172:36034) 2023-03-27T10:10:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 -- 172.21.15.172:0/912377406 learned_addr learned my addr 172.21.15.172:0/912377406 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 -- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e815a240 msgr2=0x7fc7e80b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e815a240 0x7fc7e80b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 -- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7e81604b0 msgr2=0x7fc7e80c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.520 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7e81604b0 0x7fc7e80c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.513+0000 7fc7ec99b700 1 -- 172.21.15.172:0/912377406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009550 con 0x7fc7e80d3a30 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.514+0000 7fc7ec99b700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 0x7fc7e815c800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc000c00 tx=0x7fc7dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.514+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc004480 con 0x7fc7e80d3a30 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.514+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc01f070 con 0x7fc7e80d3a30 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.514+0000 7fc7eebff700 1 -- 172.21.15.172:0/912377406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e80d2f50 con 0x7fc7e80d3a30 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.514+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0038a0 con 0x7fc7e80d3a30 2023-03-27T10:10:59.521 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.514+0000 7fc7eebff700 1 -- 172.21.15.172:0/912377406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e80d2c70 con 0x7fc7e80d3a30 2023-03-27T10:10:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.515+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e80d3230 con 0x7fc7e80d3a30 2023-03-27T10:10:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.516+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fc7dc02a020 con 0x7fc7e80d3a30 2023-03-27T10:10:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.517+0000 7fc7e57fa700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc7cc066e30 0x7fc7cc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.517+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7dc0856c0 con 0x7fc7e80d3a30 2023-03-27T10:10:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.517+0000 7fc7e7fff700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc7cc066e30 0x7fc7cc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.518+0000 7fc7e7fff700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc7cc066e30 0x7fc7cc0692e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80cf1e0 tx=0x7fc7d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.523 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.521+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fc7dc052c50 con 0x7fc7e80d3a30 2023-03-27T10:10:59.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.711+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7e8074300 con 0x7fc7e80d3a30 2023-03-27T10:10:59.711 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.712+0000 7fc7e57fa700 1 -- 172.21.15.172:0/912377406 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7dc056270 con 0x7fc7e80d3a30 2023-03-27T10:10:59.712 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 8 2023-03-27T10:10:59.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc7cc066e30 msgr2=0x7fc7cc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc7cc066e30 0x7fc7cc0692e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80cf1e0 tx=0x7fc7d4008040 comp rx=0 tx=0).stop 2023-03-27T10:10:59.714 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 msgr2=0x7fc7e815c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 0x7fc7e815c800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc000c00 tx=0x7fc7dc004750 comp rx=0 tx=0).stop 2023-03-27T10:10:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 shutdown_connections 2023-03-27T10:10:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fc7cc066e30 0x7fc7cc0692e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7e81604b0 0x7fc7e80c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e80d3a30 0x7fc7e815c800 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 --2- 172.21.15.172:0/912377406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7e815a240 0x7fc7e80b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 >> 172.21.15.172:0/912377406 conn(0x7fc7e80721f0 msgr2=0x7fc7e80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:59.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 shutdown_connections 2023-03-27T10:10:59.716 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.714+0000 7fc7d2ffd700 1 -- 172.21.15.172:0/912377406 wait complete. 2023-03-27T10:10:59.731 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-27T10:10:59.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.915+0000 7f282c9ff700 1 Processor -- start 2023-03-27T10:10:59.915 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.916+0000 7f282c9ff700 1 -- start start 2023-03-27T10:10:59.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.917+0000 7f282c9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f282815c6f0 0x7f28280cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.917+0000 7f282c9ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 0x7f2828160b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.916 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.917+0000 7f282c9ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2828160390 con 0x7f2828161040 2023-03-27T10:10:59.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.917+0000 7f282c9ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28280cb360 con 0x7f2828065e30 2023-03-27T10:10:59.917 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.917+0000 7f282c9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2828160670 con 0x7f282815c6f0 2023-03-27T10:10:59.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f2825d9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 0x7f2828160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f2825d9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 0x7f2828160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.172:40720/0 (socket says 172.21.15.172:40720) 2023-03-27T10:10:59.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f2825d9b700 1 -- 172.21.15.172:0/2553666179 learned_addr learned my addr 172.21.15.172:0/2553666179 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:59.919 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f282815c6f0 0x7f28280cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282559a700 1 -- 172.21.15.172:0/2553666179 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579999121 0 0) 0x7f2828160390 con 0x7f2828161040 2023-03-27T10:10:59.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282559a700 1 -- 172.21.15.172:0/2553666179 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28100035b0 con 0x7f2828161040 2023-03-27T10:10:59.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282659c700 1 -- 172.21.15.172:0/2553666179 >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 msgr2=0x7f2828160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:10:59.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282659c700 1 --2- 172.21.15.172:0/2553666179 >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 0x7f2828160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.921 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282659c700 1 -- 172.21.15.172:0/2553666179 >> v1:172.21.15.191:6789/0 conn(0x7f2828161040 legacy=0x7f28280b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282659c700 1 -- 172.21.15.172:0/2553666179 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280cb570 con 0x7f282815c6f0 2023-03-27T10:10:59.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f2825d9b700 1 --2- 172.21.15.172:0/2553666179 >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 0x7f2828160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-27T10:10:59.922 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.918+0000 7f282659c700 1 --2- 172.21.15.172:0/2553666179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f282815c6f0 0x7f28280cae20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2818009840 tx=0x7f2818009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff6d3835b959b9c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.923 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282559a700 1 -- 172.21.15.172:0/2553666179 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818011830 con 0x7f282815c6f0 2023-03-27T10:10:59.923 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282559a700 1 -- 172.21.15.172:0/2553666179 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818011990 con 0x7f282815c6f0 2023-03-27T10:10:59.923 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282559a700 1 -- 172.21.15.172:0/2553666179 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818011d20 con 0x7f282815c6f0 2023-03-27T10:10:59.923 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 -- 172.21.15.172:0/2553666179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f282815c6f0 msgr2=0x7f28280cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.924 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 --2- 172.21.15.172:0/2553666179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f282815c6f0 0x7f28280cae20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2818009840 tx=0x7f2818009b50 comp rx=0 tx=0).stop 2023-03-27T10:10:59.924 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 -- 172.21.15.172:0/2553666179 shutdown_connections 2023-03-27T10:10:59.924 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 --2- 172.21.15.172:0/2553666179 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f282815c6f0 0x7f28280cae20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.924 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 --2- 172.21.15.172:0/2553666179 >> v2:172.21.15.191:3300/0 conn(0x7f2828065e30 0x7f2828160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 -- 172.21.15.172:0/2553666179 >> 172.21.15.172:0/2553666179 conn(0x7f28280cbf30 msgr2=0x7f28280cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:10:59.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 -- 172.21.15.172:0/2553666179 shutdown_connections 2023-03-27T10:10:59.925 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.919+0000 7f282c9ff700 1 -- 172.21.15.172:0/2553666179 wait complete. 2023-03-27T10:10:59.928 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.921+0000 7f282c9ff700 1 Processor -- start 2023-03-27T10:10:59.928 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.921+0000 7f282c9ff700 1 -- start start 2023-03-27T10:10:59.928 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f282c9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2828065e30 0x7f28280b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.929 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f282c9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 0x7f282815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.929 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f282c9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2828161040 0x7f282815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.929 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f282c9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282815f8a0 con 0x7f282815c6f0 2023-03-27T10:10:59.930 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f282c9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282815f5c0 con 0x7f2828065e30 2023-03-27T10:10:59.930 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f282c9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28280b2380 con 0x7f2828161040 2023-03-27T10:10:59.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.922+0000 7f2825d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 0x7f282815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 0x7f282815ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36050/0 (socket says 172.21.15.172:36050) 2023-03-27T10:10:59.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 -- 172.21.15.172:0/422156899 learned_addr learned my addr 172.21.15.172:0/422156899 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:10:59.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f282659c700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2828065e30 0x7f28280b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2826d9d700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2828161040 0x7f282815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.931 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 -- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2828161040 msgr2=0x7f282815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2828161040 0x7f282815efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 -- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2828065e30 msgr2=0x7f28280b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2828065e30 0x7f28280b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 -- 172.21.15.172:0/422156899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c009550 con 0x7f282815c6f0 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2825d9b700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 0x7f282815ea70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f281c00e9b0 tx=0x7f281c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00c850 con 0x7f282815c6f0 2023-03-27T10:10:59.932 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00c9b0 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00cd20 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.923+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28180094a0 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.924+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28280cbb30 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.925+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28280cb850 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.926+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f281c019030 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.926+0000 7f2816ffd700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2808066e30 0x7f28080692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.927+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f281c083f70 con 0x7f282815c6f0 2023-03-27T10:10:59.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.927+0000 7f282659c700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2808066e30 0x7f28080692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:10:59.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.928+0000 7f282659c700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2808066e30 0x7f28080692e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2818000c00 tx=0x7f281801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:10:59.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:10:59.931+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f281c051500 con 0x7f282815c6f0 2023-03-27T10:11:00.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.122+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28280662a0 con 0x7f282815c6f0 2023-03-27T10:11:00.122 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.123+0000 7f2816ffd700 1 -- 172.21.15.172:0/422156899 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f281c054b20 con 0x7f282815c6f0 2023-03-27T10:11:00.123 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:00.123 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2023-03-27T10:11:00.123 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: { 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 2, 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": "rbd" 2023-03-27T10:11:00.124 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-03-27T10:11:00.125 INFO:teuthology.orchestra.run.smithi172.stdout:] 2023-03-27T10:11:00.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2808066e30 msgr2=0x7f28080692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2808066e30 0x7f28080692e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2818000c00 tx=0x7f281801c040 comp rx=0 tx=0).stop 2023-03-27T10:11:00.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 msgr2=0x7f282815ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 0x7f282815ea70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f281c00e9b0 tx=0x7f281c00ed70 comp rx=0 tx=0).stop 2023-03-27T10:11:00.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 shutdown_connections 2023-03-27T10:11:00.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2828161040 0x7f282815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f2808066e30 0x7f28080692e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2828065e30 0x7f28280b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 --2- 172.21.15.172:0/422156899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f282815c6f0 0x7f282815ea70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 >> 172.21.15.172:0/422156899 conn(0x7f28280cbf30 msgr2=0x7f28280acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:00.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 shutdown_connections 2023-03-27T10:11:00.128 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.125+0000 7f282c9ff700 1 -- 172.21.15.172:0/422156899 wait complete. 2023-03-27T10:11:00.142 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-27T10:11:00.142 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-27T10:11:00.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.331+0000 7f6833fff700 1 Processor -- start 2023-03-27T10:11:00.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.331+0000 7f6833fff700 1 -- start start 2023-03-27T10:11:00.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.332+0000 7f6833fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:00.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.332+0000 7f6833fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0ce9f0 con 0x7f682c0b2dc0 2023-03-27T10:11:00.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f6833fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c15cd90 con 0x7f682c15c9c0 2023-03-27T10:11:00.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f6833fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0cdde0 con 0x7f682c0cd590 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f683259c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f682c0b2dc0 0x7f682c0d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54438/0 (socket says 172.21.15.172:54438) 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f683259c700 1 -- 172.21.15.172:0/1107915109 learned_addr learned my addr 172.21.15.172:0/1107915109 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f683159a700 1 --2- 172.21.15.172:0/1107915109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285610143 0 0) 0x7f682c0ce9f0 con 0x7f682c0b2dc0 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68180035b0 con 0x7f682c0b2dc0 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983683112 0 0) 0x7f682c15cd90 con 0x7f682c15c9c0 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f682c0ce9f0 con 0x7f682c15c9c0 2023-03-27T10:11:00.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f683159a700 1 -- 172.21.15.172:0/1107915109 >> v1:172.21.15.191:6789/0 conn(0x7f682c15c9c0 legacy=0x7f682c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.335 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f683159a700 1 -- 172.21.15.172:0/1107915109 >> v1:172.21.15.172:6789/0 conn(0x7f682c0b2dc0 legacy=0x7f682c0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.335 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.333+0000 7f683159a700 1 -- 172.21.15.172:0/1107915109 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0ce0c0 con 0x7f682c0cd590 2023-03-27T10:11:00.336 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.334+0000 7f683159a700 1 --2- 172.21.15.172:0/1107915109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c0b2880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f681c009870 tx=0x7f681c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=137b479d3748a1aa server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:00.336 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.334+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c011830 con 0x7f682c0cd590 2023-03-27T10:11:00.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.334+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c011990 con 0x7f682c0cd590 2023-03-27T10:11:00.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.334+0000 7f6830d99700 1 -- 172.21.15.172:0/1107915109 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c011d00 con 0x7f682c0cd590 2023-03-27T10:11:00.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 -- 172.21.15.172:0/1107915109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 msgr2=0x7f682c0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 --2- 172.21.15.172:0/1107915109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c0b2880 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f681c009870 tx=0x7f681c009b80 comp rx=0 tx=0).stop 2023-03-27T10:11:00.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 -- 172.21.15.172:0/1107915109 shutdown_connections 2023-03-27T10:11:00.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 --2- 172.21.15.172:0/1107915109 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c0b2880 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 -- 172.21.15.172:0/1107915109 >> 172.21.15.172:0/1107915109 conn(0x7f682c0721f0 msgr2=0x7f682c09c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:00.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 -- 172.21.15.172:0/1107915109 shutdown_connections 2023-03-27T10:11:00.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.335+0000 7f6833fff700 1 -- 172.21.15.172:0/1107915109 wait complete. 2023-03-27T10:11:00.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.336+0000 7f6833fff700 1 Processor -- start 2023-03-27T10:11:00.338 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.336+0000 7f6833fff700 1 -- start start 2023-03-27T10:11:00.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.337+0000 7f6833fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0b2dc0 0x7f682c14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:00.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.337+0000 7f6833fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c06b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:00.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.337+0000 7f6833fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 0x7f682c06b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:00.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.337+0000 7f6833fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c150d60 con 0x7f682c15c9c0 2023-03-27T10:11:00.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.337+0000 7f6833fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c1e81f0 con 0x7f682c0b2dc0 2023-03-27T10:11:00.340 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.337+0000 7f6833fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c15a3c0 con 0x7f682c0cd590 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 0x7f682c06b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 0x7f682c06b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36056/0 (socket says 172.21.15.172:36056) 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 -- 172.21.15.172:0/740102614 learned_addr learned my addr 172.21.15.172:0/740102614 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f6831d9b700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0b2dc0 0x7f682c14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683159a700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c06b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 -- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 msgr2=0x7f682c06b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.341 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c06b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 -- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0b2dc0 msgr2=0x7f682c14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0b2dc0 0x7f682c14d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 -- 172.21.15.172:0/740102614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c0094a0 con 0x7f682c15c9c0 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f683259c700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 0x7f682c06b8a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f682400caa0 tx=0x7f682400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.338+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400a9e0 con 0x7f682c15c9c0 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.339+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682400ab40 con 0x7f682c15c9c0 2023-03-27T10:11:00.342 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.339+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0ce680 con 0x7f682c15c9c0 2023-03-27T10:11:00.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.339+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824012400 con 0x7f682c15c9c0 2023-03-27T10:11:00.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.339+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c0ce3a0 con 0x7f682c15c9c0 2023-03-27T10:11:00.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.340+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c0cda00 con 0x7f682c15c9c0 2023-03-27T10:11:00.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.341+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f6824019030 con 0x7f682c15c9c0 2023-03-27T10:11:00.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.342+0000 7f68227fc700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e30 0x7f68100692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:00.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.342+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6824083a10 con 0x7f682c15c9c0 2023-03-27T10:11:00.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.342+0000 7f6831d9b700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e30 0x7f68100692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:00.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.343+0000 7f6831d9b700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e30 0x7f68100692e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:00.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.346+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f6824051060 con 0x7f682c15c9c0 2023-03-27T10:11:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:00.534+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f682c074290 con 0x7f682c15c9c0 2023-03-27T10:11:01.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.086+0000 7f68227fc700 1 -- 172.21.15.172:0/740102614 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6824054680 con 0x7f682c15c9c0 2023-03-27T10:11:01.092 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e30 msgr2=0x7f68100692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:01.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e30 0x7f68100692e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009040 comp rx=0 tx=0).stop 2023-03-27T10:11:01.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 msgr2=0x7f682c06b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:01.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 0x7f682c06b8a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f682400caa0 tx=0x7f682400cdb0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 shutdown_connections 2023-03-27T10:11:01.093 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682c15c9c0 0x7f682c06b8a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f6810066e30 0x7f68100692e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f682c0b2dc0 0x7f682c14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 --2- 172.21.15.172:0/740102614 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f682c0cd590 0x7f682c06b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.093+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 >> 172.21.15.172:0/740102614 conn(0x7f682c0721f0 msgr2=0x7f682c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:01.094 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.094+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 shutdown_connections 2023-03-27T10:11:01.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.094+0000 7f6833fff700 1 -- 172.21.15.172:0/740102614 wait complete. 2023-03-27T10:11:01.095 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2023-03-27T10:11:01.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-27T10:11:01.302 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.303+0000 7f505bbff700 1 Processor -- start 2023-03-27T10:11:01.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.303+0000 7f505bbff700 1 -- start start 2023-03-27T10:11:01.303 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505bbff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f505415c520 0x7f50540d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:01.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505bbff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f50540d1000 0x7f50540cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:01.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505bbff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50540cdbf0 con 0x7f50540cfd50 2023-03-27T10:11:01.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505bbff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50540d2e80 con 0x7f505415c520 2023-03-27T10:11:01.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505bbff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50540d1430 con 0x7f50540d1000 2023-03-27T10:11:01.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505999b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f505415c520 0x7f50540d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:01.304 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505999b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f505415c520 0x7f50540d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36072/0 (socket says 172.21.15.172:36072) 2023-03-27T10:11:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.304+0000 7f505999b700 1 -- 172.21.15.172:0/2837880671 learned_addr learned my addr 172.21.15.172:0/2837880671 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:01.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f505919a700 1 --2- 172.21.15.172:0/2837880671 >> v2:172.21.15.191:3300/0 conn(0x7f50540d1000 0x7f50540cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:01.306 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f505999b700 1 -- 172.21.15.172:0/2837880671 >> v2:172.21.15.191:3300/0 conn(0x7f50540d1000 msgr2=0x7f50540cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:01.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f505999b700 1 --2- 172.21.15.172:0/2837880671 >> v2:172.21.15.191:3300/0 conn(0x7f50540d1000 0x7f50540cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f505999b700 1 -- 172.21.15.172:0/2837880671 >> v1:172.21.15.191:6789/0 conn(0x7f50540cfd50 legacy=0x7f5054160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:01.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f505999b700 1 -- 172.21.15.172:0/2837880671 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540d01a0 con 0x7f505415c520 2023-03-27T10:11:01.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f505999b700 1 --2- 172.21.15.172:0/2837880671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505415c520 0x7f50540d0ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50540b8fa0 tx=0x7f5050009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f631048c3f8304c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:01.307 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f5058999700 1 -- 172.21.15.172:0/2837880671 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5050004230 con 0x7f505415c520 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f5058999700 1 -- 172.21.15.172:0/2837880671 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5050004390 con 0x7f505415c520 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.305+0000 7f5058999700 1 -- 172.21.15.172:0/2837880671 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50500036a0 con 0x7f505415c520 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 -- 172.21.15.172:0/2837880671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505415c520 msgr2=0x7f50540d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 --2- 172.21.15.172:0/2837880671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505415c520 0x7f50540d0ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50540b8fa0 tx=0x7f5050009bd0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 -- 172.21.15.172:0/2837880671 shutdown_connections 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 --2- 172.21.15.172:0/2837880671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f505415c520 0x7f50540d0ac0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 --2- 172.21.15.172:0/2837880671 >> v2:172.21.15.191:3300/0 conn(0x7f50540d1000 0x7f50540cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.308 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 -- 172.21.15.172:0/2837880671 >> 172.21.15.172:0/2837880671 conn(0x7f50540721f0 msgr2=0x7f505409c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:01.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 -- 172.21.15.172:0/2837880671 shutdown_connections 2023-03-27T10:11:01.309 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.306+0000 7f505bbff700 1 -- 172.21.15.172:0/2837880671 wait complete. 2023-03-27T10:11:01.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.308+0000 7f505bbff700 1 Processor -- start 2023-03-27T10:11:01.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.308+0000 7f505bbff700 1 -- start start 2023-03-27T10:11:01.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505bbff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50540cfd50 0x7f50541513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:01.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505bbff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 0x7f50540b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:01.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505bbff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f505415c520 0x7f50540b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:01.311 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505bbff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5054151920 con 0x7f50540d1000 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505bbff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50541f6760 con 0x7f505415c520 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505bbff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50540b1ec0 con 0x7f50540cfd50 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 0x7f50540b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 0x7f50540b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36084/0 (socket says 172.21.15.172:36084) 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 -- 172.21.15.172:0/3687593449 learned_addr learned my addr 172.21.15.172:0/3687593449 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505999b700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50540cfd50 0x7f50541513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:01.312 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505a19c700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f505415c520 0x7f50540b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 -- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50540cfd50 msgr2=0x7f50541513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50540cfd50 0x7f50541513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 -- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f505415c520 msgr2=0x7f50540b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f505415c520 0x7f50540b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.309+0000 7f505919a700 1 -- 172.21.15.172:0/3687593449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050009550 con 0x7f50540d1000 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f505a19c700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f505415c520 0x7f50540b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f505919a700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 0x7f50540b3a90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f504400e810 tx=0x7f504400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:01.313 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044013610 con 0x7f50540d1000 2023-03-27T10:11:01.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5044013770 con 0x7f50540d1000 2023-03-27T10:11:01.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044013b20 con 0x7f50540d1000 2023-03-27T10:11:01.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50540d0420 con 0x7f50540d1000 2023-03-27T10:11:01.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.310+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50540cd5e0 con 0x7f50540d1000 2023-03-27T10:11:01.314 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.311+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50540cd880 con 0x7f50540d1000 2023-03-27T10:11:01.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.312+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f5044023070 con 0x7f50540d1000 2023-03-27T10:11:01.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.313+0000 7f504a7fc700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5038066e30 0x7f50380692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:01.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.313+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5044083c80 con 0x7f50540d1000 2023-03-27T10:11:01.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.314+0000 7f505999b700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5038066e30 0x7f50380692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:01.315 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.315+0000 7f505999b700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5038066e30 0x7f50380692e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5050009130 tx=0x7f5050008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:01.317 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.318+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f5044051110 con 0x7f50540d1000 2023-03-27T10:11:01.508 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:01.509+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5054074300 con 0x7f50540d1000 2023-03-27T10:11:02.095 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.095+0000 7f504a7fc700 1 -- 172.21.15.172:0/3687593449 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5044054730 con 0x7f50540d1000 2023-03-27T10:11:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.101+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5038066e30 msgr2=0x7f50380692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.101+0000 7f505bbff700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5038066e30 0x7f50380692e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5050009130 tx=0x7f5050008030 comp rx=0 tx=0).stop 2023-03-27T10:11:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.101+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 msgr2=0x7f50540b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.101+0000 7f505bbff700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 0x7f50540b3a90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f504400e810 tx=0x7f504400eb20 comp rx=0 tx=0).stop 2023-03-27T10:11:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.102+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 shutdown_connections 2023-03-27T10:11:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.102+0000 7f505bbff700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f5038066e30 0x7f50380692e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.102+0000 7f505bbff700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f505415c520 0x7f50540b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.102+0000 7f505bbff700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50540cfd50 0x7f50541513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.102+0000 7f505bbff700 1 --2- 172.21.15.172:0/3687593449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50540d1000 0x7f50540b3a90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.102+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 >> 172.21.15.172:0/3687593449 conn(0x7f50540721f0 msgr2=0x7f50540b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.107+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 shutdown_connections 2023-03-27T10:11:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.108+0000 7f505bbff700 1 -- 172.21.15.172:0/3687593449 wait complete. 2023-03-27T10:11:02.118 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2023-03-27T10:11:02.132 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-27T10:11:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.322+0000 7f51f0bff700 1 Processor -- start 2023-03-27T10:11:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.322+0000 7f51f0bff700 1 -- start start 2023-03-27T10:11:02.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.323+0000 7f51f0bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f51ec15a240 0x7f51ec0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.323 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51f0bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0d29d0 con 0x7f51ec160bc0 2023-03-27T10:11:02.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51f0bff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec15a610 con 0x7f51ec0d3a30 2023-03-27T10:11:02.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51f0bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec161200 con 0x7f51ec15a240 2023-03-27T10:11:02.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51ead9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f51ec160bc0 0x7f51ec0cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54444/0 (socket says 172.21.15.172:54444) 2023-03-27T10:11:02.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51ead9d700 1 -- 172.21.15.172:0/1069573801 learned_addr learned my addr 172.21.15.172:0/1069573801 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:02.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51ea59c700 1 --2- 172.21.15.172:0/1069573801 >> v2:172.21.15.191:3300/0 conn(0x7f51ec15a240 0x7f51ec0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51e9d9b700 1 -- 172.21.15.172:0/1069573801 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395097034 0 0) 0x7f51ec0d29d0 con 0x7f51ec160bc0 2023-03-27T10:11:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.324+0000 7f51e9d9b700 1 -- 172.21.15.172:0/1069573801 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d80035b0 con 0x7f51ec160bc0 2023-03-27T10:11:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51ea59c700 1 -- 172.21.15.172:0/1069573801 >> v1:172.21.15.191:6789/0 conn(0x7f51ec0d3a30 legacy=0x7f51ec1604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51ea59c700 1 -- 172.21.15.172:0/1069573801 >> v1:172.21.15.172:6789/0 conn(0x7f51ec160bc0 legacy=0x7f51ec0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51ea59c700 1 -- 172.21.15.172:0/1069573801 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0d2c70 con 0x7f51ec15a240 2023-03-27T10:11:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51ea59c700 1 --2- 172.21.15.172:0/1069573801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec15a240 0x7f51ec0d0ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009840 tx=0x7f51dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839d924ead6cc8bd server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51e9d9b700 1 -- 172.21.15.172:0/1069573801 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc011830 con 0x7f51ec15a240 2023-03-27T10:11:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51e9d9b700 1 -- 172.21.15.172:0/1069573801 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc011990 con 0x7f51ec15a240 2023-03-27T10:11:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.325+0000 7f51e9d9b700 1 -- 172.21.15.172:0/1069573801 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc011d00 con 0x7f51ec15a240 2023-03-27T10:11:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 -- 172.21.15.172:0/1069573801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec15a240 msgr2=0x7f51ec0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 --2- 172.21.15.172:0/1069573801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec15a240 0x7f51ec0d0ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009840 tx=0x7f51dc009b50 comp rx=0 tx=0).stop 2023-03-27T10:11:02.328 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 -- 172.21.15.172:0/1069573801 shutdown_connections 2023-03-27T10:11:02.328 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 --2- 172.21.15.172:0/1069573801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec15a240 0x7f51ec0d0ac0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.328 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 -- 172.21.15.172:0/1069573801 >> 172.21.15.172:0/1069573801 conn(0x7f51ec0721f0 msgr2=0x7f51ec09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:02.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 -- 172.21.15.172:0/1069573801 shutdown_connections 2023-03-27T10:11:02.329 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.326+0000 7f51f0bff700 1 -- 172.21.15.172:0/1069573801 wait complete. 2023-03-27T10:11:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.327+0000 7f51f0bff700 1 Processor -- start 2023-03-27T10:11:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 -- start start 2023-03-27T10:11:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51ec0d3a30 0x7f51ec1f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 0x7f51ec15f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec160bc0 0x7f51ec1f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15c6b0 con 0x7f51ec15a240 2023-03-27T10:11:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15fbc0 con 0x7f51ec160bc0 2023-03-27T10:11:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.328+0000 7f51f0bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15ba30 con 0x7f51ec0d3a30 2023-03-27T10:11:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 0x7f51ec15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 0x7f51ec15f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36094/0 (socket says 172.21.15.172:36094) 2023-03-27T10:11:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51ea59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51ec0d3a30 0x7f51ec1f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 -- 172.21.15.172:0/3635909220 learned_addr learned my addr 172.21.15.172:0/3635909220 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51ead9d700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec160bc0 0x7f51ec1f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 -- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51ec0d3a30 msgr2=0x7f51ec1f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51ec0d3a30 0x7f51ec1f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 -- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec160bc0 msgr2=0x7f51ec1f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec160bc0 0x7f51ec1f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 -- 172.21.15.172:0/3635909220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0094a0 con 0x7f51ec15a240 2023-03-27T10:11:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.329+0000 7f51e3fff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 0x7f51ec15f680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c4e0 tx=0x7f51d400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.330+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40052d0 con 0x7f51ec15a240 2023-03-27T10:11:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.330+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4005430 con 0x7f51ec15a240 2023-03-27T10:11:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.330+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0d3230 con 0x7f51ec15a240 2023-03-27T10:11:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.330+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40038c0 con 0x7f51ec15a240 2023-03-27T10:11:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.330+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0d2f50 con 0x7f51ec15a240 2023-03-27T10:11:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.331+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec0d3510 con 0x7f51ec15a240 2023-03-27T10:11:02.336 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.332+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f51d4019030 con 0x7f51ec15a240 2023-03-27T10:11:02.336 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.333+0000 7f51e2ffd700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f51cc066e30 0x7f51cc0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.333+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f51d40838a0 con 0x7f51ec15a240 2023-03-27T10:11:02.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.333+0000 7f51ea59c700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f51cc066e30 0x7f51cc0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.334+0000 7f51ea59c700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f51cc066e30 0x7f51cc0692e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51dc000c00 tx=0x7f51dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:02.337 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.336+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f51d4050bc0 con 0x7f51ec15a240 2023-03-27T10:11:02.568 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.568+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f51ec074300 con 0x7f51ec15a240 2023-03-27T10:11:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.575+0000 7f51e2ffd700 1 -- 172.21.15.172:0/3635909220 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51d40170c0 con 0x7f51ec15a240 2023-03-27T10:11:02.579 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.580+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f51cc066e30 msgr2=0x7f51cc0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.580+0000 7f51f0bff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f51cc066e30 0x7f51cc0692e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51dc000c00 tx=0x7f51dc008030 comp rx=0 tx=0).stop 2023-03-27T10:11:02.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.580+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 msgr2=0x7f51ec15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.580 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.580+0000 7f51f0bff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 0x7f51ec15f680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c4e0 tx=0x7f51d400c7f0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.582 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 shutdown_connections 2023-03-27T10:11:02.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f51cc066e30 0x7f51cc0692e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ec160bc0 0x7f51ec1f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51ec0d3a30 0x7f51ec1f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 --2- 172.21.15.172:0/3635909220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ec15a240 0x7f51ec15f680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.583 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 >> 172.21.15.172:0/3635909220 conn(0x7f51ec0721f0 msgr2=0x7f51ec159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:02.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.583+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 shutdown_connections 2023-03-27T10:11:02.584 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.584+0000 7f51f0bff700 1 -- 172.21.15.172:0/3635909220 wait complete. 2023-03-27T10:11:02.603 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 5 and data pool 6 2023-03-27T10:11:02.619 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:11:02.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.804+0000 7fd66e5ff700 1 Processor -- start 2023-03-27T10:11:02.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.804+0000 7fd66e5ff700 1 -- start start 2023-03-27T10:11:02.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66e5ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6680d0b90 0x7fd6680ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66e5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd66815ca20 0x7fd6680d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66e5ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6680d14a0 con 0x7fd6680cd610 2023-03-27T10:11:02.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66e5ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6680cebc0 con 0x7fd6680d0b90 2023-03-27T10:11:02.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66e5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680ceea0 con 0x7fd66815ca20 2023-03-27T10:11:02.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd667fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6680d0b90 0x7fd6680ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66cb9c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd6680cd610 0x7fd6680cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54458/0 (socket says 172.21.15.172:54458) 2023-03-27T10:11:02.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.805+0000 7fd66cb9c700 1 -- 172.21.15.172:0/181490370 learned_addr learned my addr 172.21.15.172:0/181490370 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:02.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd6677fe700 1 --2- 172.21.15.172:0/181490370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd66815ca20 0x7fd6680d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd667fff700 1 -- 172.21.15.172:0/181490370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd66815ca20 msgr2=0x7fd6680d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:02.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd667fff700 1 --2- 172.21.15.172:0/181490370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd66815ca20 0x7fd6680d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd667fff700 1 -- 172.21.15.172:0/181490370 >> v1:172.21.15.172:6789/0 conn(0x7fd6680cd610 legacy=0x7fd6680cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd667fff700 1 -- 172.21.15.172:0/181490370 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6680cf180 con 0x7fd6680d0b90 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd666ffd700 1 -- 172.21.15.172:0/181490370 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380602049 0 0) 0x7fd6680d14a0 con 0x7fd6680cd610 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd667fff700 1 --2- 172.21.15.172:0/181490370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6680d0b90 0x7fd6680ce500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd658009820 tx=0x7fd658009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a08ccbae7513830 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.806+0000 7fd666ffd700 1 -- 172.21.15.172:0/181490370 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658005e30 con 0x7fd6680d0b90 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd666ffd700 1 -- 172.21.15.172:0/181490370 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd658006030 con 0x7fd6680d0b90 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd666ffd700 1 -- 172.21.15.172:0/181490370 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580063c0 con 0x7fd6680d0b90 2023-03-27T10:11:02.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 -- 172.21.15.172:0/181490370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6680d0b90 msgr2=0x7fd6680ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/181490370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6680d0b90 0x7fd6680ce500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd658009820 tx=0x7fd658009b30 comp rx=0 tx=0).stop 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 -- 172.21.15.172:0/181490370 shutdown_connections 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/181490370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6680d0b90 0x7fd6680ce500 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/181490370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd66815ca20 0x7fd6680d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 -- 172.21.15.172:0/181490370 >> 172.21.15.172:0/181490370 conn(0x7fd6680721f0 msgr2=0x7fd66809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 -- 172.21.15.172:0/181490370 shutdown_connections 2023-03-27T10:11:02.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.807+0000 7fd66e5ff700 1 -- 172.21.15.172:0/181490370 wait complete. 2023-03-27T10:11:02.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.809+0000 7fd66e5ff700 1 Processor -- start 2023-03-27T10:11:02.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.809+0000 7fd66e5ff700 1 -- start start 2023-03-27T10:11:02.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66e5ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6680cd610 0x7fd668157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66e5ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6680d0b90 0x7fd6680b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66e5ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 0x7fd66806b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66e5ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680b3d30 con 0x7fd66815ca20 2023-03-27T10:11:02.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66e5ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680ca090 con 0x7fd6680cd610 2023-03-27T10:11:02.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66e5ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd668157b70 con 0x7fd6680d0b90 2023-03-27T10:11:02.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66cb9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 0x7fd66806b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66cb9c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 0x7fd66806b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36110/0 (socket says 172.21.15.172:36110) 2023-03-27T10:11:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd66cb9c700 1 -- 172.21.15.172:0/3744224652 learned_addr learned my addr 172.21.15.172:0/3744224652 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd6677fe700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6680d0b90 0x7fd6680b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.810+0000 7fd667fff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6680cd610 0x7fd668157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66cb9c700 1 -- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6680d0b90 msgr2=0x7fd6680b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66cb9c700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6680d0b90 0x7fd6680b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66cb9c700 1 -- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6680cd610 msgr2=0x7fd668157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:02.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66cb9c700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6680cd610 0x7fd668157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:02.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66cb9c700 1 -- 172.21.15.172:0/3744224652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658009430 con 0x7fd66815ca20 2023-03-27T10:11:02.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66cb9c700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 0x7fd66806b310 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd66000cc70 tx=0x7fd66000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:02.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000aa60 con 0x7fd66815ca20 2023-03-27T10:11:02.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66000abe0 con 0x7fd66815ca20 2023-03-27T10:11:02.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6680afc50 con 0x7fd66815ca20 2023-03-27T10:11:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600070d0 con 0x7fd66815ca20 2023-03-27T10:11:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.811+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6680cf460 con 0x7fd66815ca20 2023-03-27T10:11:02.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.812+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6680d2d30 con 0x7fd66815ca20 2023-03-27T10:11:02.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.813+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fd660010070 con 0x7fd66815ca20 2023-03-27T10:11:02.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.814+0000 7fd664ff9700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd654066e30 0x7fd6540692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:02.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.814+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd660083b10 con 0x7fd66815ca20 2023-03-27T10:11:02.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.815+0000 7fd667fff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd654066e30 0x7fd6540692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:02.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.815+0000 7fd667fff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd654066e30 0x7fd6540692e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd658009b70 tx=0x7fd658008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:02.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:02.818+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fd660050d50 con 0x7fd66815ca20 2023-03-27T10:11:03.007 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.007+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd668074290 con 0x7fd66815ca20 2023-03-27T10:11:03.008 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.009+0000 7fd664ff9700 1 -- 172.21.15.172:0/3744224652 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18040 (secure 0 0 0) 0x7fd660018020 con 0x7fd66815ca20 2023-03-27T10:11:03.009 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:03.009 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":37,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:11:02.570791+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:11:00.572681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-03-27T10:11:01.547602+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:11:03.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd654066e30 msgr2=0x7fd6540692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd654066e30 0x7fd6540692e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd658009b70 tx=0x7fd658008070 comp rx=0 tx=0).stop 2023-03-27T10:11:03.011 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 msgr2=0x7fd66806b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 0x7fd66806b310 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd66000cc70 tx=0x7fd66000cf80 comp rx=0 tx=0).stop 2023-03-27T10:11:03.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 shutdown_connections 2023-03-27T10:11:03.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd66815ca20 0x7fd66806b310 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.012 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fd654066e30 0x7fd6540692e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd6680cd610 0x7fd668157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 --2- 172.21.15.172:0/3744224652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd6680d0b90 0x7fd6680b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 >> 172.21.15.172:0/3744224652 conn(0x7fd6680721f0 msgr2=0x7fd66815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:03.013 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 shutdown_connections 2023-03-27T10:11:03.014 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.011+0000 7fd66e5ff700 1 -- 172.21.15.172:0/3744224652 wait complete. 2023-03-27T10:11:03.029 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:11:03.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.214+0000 7eff2c9ff700 1 Processor -- start 2023-03-27T10:11:03.214 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.214+0000 7eff2c9ff700 1 -- start start 2023-03-27T10:11:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.215+0000 7eff2c9ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7eff2815ca20 0x7eff280ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.215+0000 7eff2c9ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff280cebc0 con 0x7eff280cd610 2023-03-27T10:11:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.215+0000 7eff2c9ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff280ceea0 con 0x7eff280d0b90 2023-03-27T10:11:03.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.215+0000 7eff2c9ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280cf180 con 0x7eff2815ca20 2023-03-27T10:11:03.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff26d9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7eff280cd610 0x7eff280b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54462/0 (socket says 172.21.15.172:54462) 2023-03-27T10:11:03.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff26d9d700 1 -- 172.21.15.172:0/1523396015 learned_addr learned my addr 172.21.15.172:0/1523396015 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:03.217 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff25d9b700 1 --2- 172.21.15.172:0/1523396015 >> v2:172.21.15.191:3300/0 conn(0x7eff2815ca20 0x7eff280ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994012369 0 0) 0x7eff280cebc0 con 0x7eff280cd610 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff100035b0 con 0x7eff280cd610 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3257672756 0 0) 0x7eff100035b0 con 0x7eff280cd610 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 >> v2:172.21.15.191:3300/0 conn(0x7eff2815ca20 msgr2=0x7eff280ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 --2- 172.21.15.172:0/1523396015 >> v2:172.21.15.191:3300/0 conn(0x7eff2815ca20 0x7eff280ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 >> v1:172.21.15.191:6789/0 conn(0x7eff280d0b90 legacy=0x7eff280d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280cf460 con 0x7eff280cd610 2023-03-27T10:11:03.218 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7eff200019f0 con 0x7eff280cd610 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 >> v1:172.21.15.172:6789/0 conn(0x7eff280cd610 legacy=0x7eff280b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff10003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.216+0000 7eff2559a700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff10004850 0x7eff10004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2559a700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff10005200 0x7eff1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280cf180 con 0x7eff10003a70 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1000c0e0 con 0x7eff10005200 2023-03-27T10:11:03.219 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1000c2a0 con 0x7eff10004850 2023-03-27T10:11:03.220 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff10003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.220 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff25d9b700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff10004850 0x7eff10004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.220 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff26d9d700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff10005200 0x7eff1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 -- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff10004850 msgr2=0x7eff10004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:03.222 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff10004850 0x7eff10004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 -- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff10005200 msgr2=0x7eff1000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:03.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff10005200 0x7eff1000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 -- 172.21.15.172:0/1523396015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100035b0 con 0x7eff10003a70 2023-03-27T10:11:03.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff26d9d700 1 -- 172.21.15.172:0/1523396015 reap_dead start 2023-03-27T10:11:03.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.217+0000 7eff2659c700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff10003e80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7eff18001820 tx=0x7eff10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ef6eddc8f5100e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:03.223 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180012e0 con 0x7eff10003a70 2023-03-27T10:11:03.224 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180052d0 con 0x7eff10003a70 2023-03-27T10:11:03.224 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2559a700 1 -- 172.21.15.172:0/1523396015 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180036d0 con 0x7eff10003a70 2023-03-27T10:11:03.224 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 -- 172.21.15.172:0/1523396015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 msgr2=0x7eff10003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.224 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff10003e80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7eff18001820 tx=0x7eff10005880 comp rx=0 tx=0).stop 2023-03-27T10:11:03.224 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 -- 172.21.15.172:0/1523396015 shutdown_connections 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/1523396015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff10003e80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 -- 172.21.15.172:0/1523396015 >> 172.21.15.172:0/1523396015 conn(0x7eff280721f0 msgr2=0x7eff2809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 -- 172.21.15.172:0/1523396015 shutdown_connections 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.218+0000 7eff2c9ff700 1 -- 172.21.15.172:0/1523396015 wait complete. 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.220+0000 7eff2c9ff700 1 Processor -- start 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.220+0000 7eff2c9ff700 1 -- start start 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2c9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff28156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.225 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2c9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff280b4970 0x7eff280d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2c9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff280b4de0 0x7eff280d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2c9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280b24b0 con 0x7eff10003a70 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2c9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280b33f0 con 0x7eff280b4de0 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2c9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280b36d0 con 0x7eff280b4970 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff28156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff28156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36122/0 (socket says 172.21.15.172:36122) 2023-03-27T10:11:03.226 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.221+0000 7eff2659c700 1 -- 172.21.15.172:0/4127110278 learned_addr learned my addr 172.21.15.172:0/4127110278 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:03.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2659c700 1 -- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff280b4970 msgr2=0x7eff280d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff25d9b700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff280b4970 0x7eff280d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff26d9d700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff280b4de0 0x7eff280d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.227 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2659c700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff280b4970 0x7eff280d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2659c700 1 -- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff280b4de0 msgr2=0x7eff280d3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2659c700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff280b4de0 0x7eff280d3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2659c700 1 -- 172.21.15.172:0/4127110278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280d2d30 con 0x7eff10003a70 2023-03-27T10:11:03.228 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff25d9b700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff280b4970 0x7eff280d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff26d9d700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff280b4de0 0x7eff280d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2659c700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff28156600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff18001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180012e0 con 0x7eff10003a70 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180050d0 con 0x7eff10003a70 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1801d420 con 0x7eff10003a70 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.222+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280afc50 con 0x7eff10003a70 2023-03-27T10:11:03.229 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.223+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff280ce500 con 0x7eff10003a70 2023-03-27T10:11:03.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.224+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff280cbff0 con 0x7eff10003a70 2023-03-27T10:11:03.230 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.224+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7eff1802d070 con 0x7eff10003a70 2023-03-27T10:11:03.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.225+0000 7eff16ffd700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff08066e30 0x7eff080692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.225+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff18084b20 con 0x7eff10003a70 2023-03-27T10:11:03.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.226+0000 7eff25d9b700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff08066e30 0x7eff080692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.227+0000 7eff25d9b700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff08066e30 0x7eff080692e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7eff280d3cf0 tx=0x7eff1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:03.231 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.230+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7eff18051d60 con 0x7eff10003a70 2023-03-27T10:11:03.418 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.419+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff28074290 con 0x7eff10003a70 2023-03-27T10:11:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.420+0000 7eff16ffd700 1 -- 172.21.15.172:0/4127110278 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18040 (secure 0 0 0) 0x7eff1802b090 con 0x7eff10003a70 2023-03-27T10:11:03.420 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:03.420 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":37,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:11:02.570791+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:11:00.572681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-03-27T10:11:01.547602+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:11:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff08066e30 msgr2=0x7eff080692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff08066e30 0x7eff080692e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7eff280d3cf0 tx=0x7eff1c008040 comp rx=0 tx=0).stop 2023-03-27T10:11:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 msgr2=0x7eff28156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff28156600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7eff18000c00 tx=0x7eff18001170 comp rx=0 tx=0).stop 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 shutdown_connections 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7eff08066e30 0x7eff080692e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff280b4de0 0x7eff280d3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff10003a70 0x7eff28156600 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 --2- 172.21.15.172:0/4127110278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff280b4970 0x7eff280d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 >> 172.21.15.172:0/4127110278 conn(0x7eff280721f0 msgr2=0x7eff280b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 shutdown_connections 2023-03-27T10:11:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.422+0000 7eff2c9ff700 1 -- 172.21.15.172:0/4127110278 wait complete. 2023-03-27T10:11:03.440 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-27T10:11:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.631+0000 7f62fd9ff700 1 Processor -- start 2023-03-27T10:11:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.631+0000 7f62fd9ff700 1 -- start start 2023-03-27T10:11:03.632 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62fd9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62fd9ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f62f8072400 0x7f62f8160270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62fd9ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62f806ab40 0x7f62f815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62fd9ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f81611a0 con 0x7f62f806ab40 2023-03-27T10:11:03.633 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62fd9ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f81463e0 con 0x7f62f8072400 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62fd9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f806e310 con 0x7f62f806da00 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62f77fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62f806ab40 0x7f62f815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62f77fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62f806ab40 0x7f62f815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36130/0 (socket says 172.21.15.172:36130) 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.632+0000 7f62f77fe700 1 -- 172.21.15.172:0/3008330098 learned_addr learned my addr 172.21.15.172:0/3008330098 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62effff700 1 --2- 172.21.15.172:0/3008330098 >> v2:172.21.15.191:3300/0 conn(0x7f62f8072400 0x7f62f8160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f6ffd700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f77fe700 1 -- 172.21.15.172:0/3008330098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 msgr2=0x7f62f806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f77fe700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f806ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f77fe700 1 -- 172.21.15.172:0/3008330098 >> v2:172.21.15.191:3300/0 conn(0x7f62f8072400 msgr2=0x7f62f8160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f77fe700 1 --2- 172.21.15.172:0/3008330098 >> v2:172.21.15.191:3300/0 conn(0x7f62f8072400 0x7f62f8160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f77fe700 1 -- 172.21.15.172:0/3008330098 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8160be0 con 0x7f62f806ab40 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62effff700 1 --2- 172.21.15.172:0/3008330098 >> v2:172.21.15.191:3300/0 conn(0x7f62f8072400 0x7f62f8160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f6ffd700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f806ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f77fe700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f806ab40 0x7f62f815e050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62f80b54c0 tx=0x7f62f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92018af8fec5006 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:03.635 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f67fc700 1 -- 172.21.15.172:0/3008330098 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000e070 con 0x7f62f806ab40 2023-03-27T10:11:03.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f67fc700 1 -- 172.21.15.172:0/3008330098 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000b9c0 con 0x7f62f806ab40 2023-03-27T10:11:03.636 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.633+0000 7f62f67fc700 1 -- 172.21.15.172:0/3008330098 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000bd70 con 0x7f62f806ab40 2023-03-27T10:11:03.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3008330098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f806ab40 msgr2=0x7f62f815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f806ab40 0x7f62f815e050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f62f80b54c0 tx=0x7f62f000b330 comp rx=0 tx=0).stop 2023-03-27T10:11:03.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3008330098 shutdown_connections 2023-03-27T10:11:03.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f806ab40 0x7f62f815e050 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.638 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3008330098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f806ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3008330098 >> v2:172.21.15.191:3300/0 conn(0x7f62f8072400 0x7f62f8160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3008330098 >> 172.21.15.172:0/3008330098 conn(0x7f62f80b1010 msgr2=0x7f62f80b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3008330098 shutdown_connections 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.634+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3008330098 wait complete. 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.636+0000 7f62fd9ff700 1 Processor -- start 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.636+0000 7f62fd9ff700 1 -- start start 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62fd9ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f806ab40 0x7f62f813ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.639 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62fd9ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f813f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62fd9ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 0x7f62f815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62fd9ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f813efd0 con 0x7f62f8072400 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62fd9ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8138ae0 con 0x7f62f806ab40 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62fd9ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8138dc0 con 0x7f62f806da00 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 0x7f62f815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 0x7f62f815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36136/0 (socket says 172.21.15.172:36136) 2023-03-27T10:11:03.640 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 -- 172.21.15.172:0/3605772431 learned_addr learned my addr 172.21.15.172:0/3605772431 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62effff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f813f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f6ffd700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f806ab40 0x7f62f813ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 -- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 msgr2=0x7f62f813f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f813f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 -- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f806ab40 msgr2=0x7f62f813ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f806ab40 0x7f62f813ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f77fe700 1 -- 172.21.15.172:0/3605772431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009b30 con 0x7f62f8072400 2023-03-27T10:11:03.641 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.637+0000 7f62f6ffd700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f806ab40 0x7f62f813ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:03.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.638+0000 7f62f77fe700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 0x7f62f815bfb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62f80b1c60 tx=0x7f62f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:03.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.638+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00099b0 con 0x7f62f8072400 2023-03-27T10:11:03.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.638+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0004250 con 0x7f62f8072400 2023-03-27T10:11:03.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.638+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f806a340 con 0x7f62f8072400 2023-03-27T10:11:03.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.638+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0004600 con 0x7f62f8072400 2023-03-27T10:11:03.642 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.638+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f8160ec0 con 0x7f62f8072400 2023-03-27T10:11:03.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.639+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f806a620 con 0x7f62f8072400 2023-03-27T10:11:03.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.640+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f62f002c070 con 0x7f62f8072400 2023-03-27T10:11:03.643 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.641+0000 7f62f4ff9700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f62d8066e30 0x7f62d80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:03.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.641+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62f0085980 con 0x7f62f8072400 2023-03-27T10:11:03.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.642+0000 7f62f6ffd700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f62d8066e30 0x7f62d80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:03.644 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.642+0000 7f62f6ffd700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f62d8066e30 0x7f62d80692e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62e8003930 tx=0x7f62e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:03.645 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.645+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f62f0052bc0 con 0x7f62f8072400 2023-03-27T10:11:03.771 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T10:11:03.772+0000 7f3f7ebf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-27T10:11:03.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:03.878+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f62f8074300 con 0x7f62f8072400 2023-03-27T10:11:04.581 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.582+0000 7f62f4ff9700 1 -- 172.21.15.172:0/3605772431 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f62f0020020 con 0x7f62f8072400 2023-03-27T10:11:04.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f62d8066e30 msgr2=0x7f62d80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:04.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f62d8066e30 0x7f62d80692e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62e8003930 tx=0x7f62e8008040 comp rx=0 tx=0).stop 2023-03-27T10:11:04.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 msgr2=0x7f62f815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:04.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 0x7f62f815bfb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62f80b1c60 tx=0x7f62f0004ad0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.585 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 shutdown_connections 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f8072400 0x7f62f815bfb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f62d8066e30 0x7f62d80692e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f806ab40 0x7f62f813ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 --2- 172.21.15.172:0/3605772431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f806da00 0x7f62f813f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 >> 172.21.15.172:0/3605772431 conn(0x7f62f80b1010 msgr2=0x7f62f80b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 shutdown_connections 2023-03-27T10:11:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.585+0000 7f62fd9ff700 1 -- 172.21.15.172:0/3605772431 wait complete. 2023-03-27T10:11:04.605 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-27T10:11:04.606 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-27T10:11:04.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.796+0000 7f2a141ff700 1 Processor -- start 2023-03-27T10:11:04.796 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.796+0000 7f2a141ff700 1 -- start start 2023-03-27T10:11:04.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.797+0000 7f2a141ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c070b10 0x7f2a0c06c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:04.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.797+0000 7f2a141ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a0c165360 0x7f2a0c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:04.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.797+0000 7f2a141ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c071740 con 0x7f2a0c1657d0 2023-03-27T10:11:04.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.797+0000 7f2a141ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c164ed0 con 0x7f2a0c165360 2023-03-27T10:11:04.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.797+0000 7f2a141ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c164ba0 con 0x7f2a0c070b10 2023-03-27T10:11:04.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a0c165360 0x7f2a0c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:04.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a0c165360 0x7f2a0c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36152/0 (socket says 172.21.15.172:36152) 2023-03-27T10:11:04.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 -- 172.21.15.172:0/3776772079 learned_addr learned my addr 172.21.15.172:0/3776772079 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:04.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a11f9b700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c070b10 0x7f2a0c06c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:04.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 -- 172.21.15.172:0/3776772079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c070b10 msgr2=0x7f2a0c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:04.801 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c070b10 0x7f2a0c06c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 -- 172.21.15.172:0/3776772079 >> v1:172.21.15.191:6789/0 conn(0x7f2a0c1657d0 legacy=0x7f2a0c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:04.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 -- 172.21.15.172:0/3776772079 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c071990 con 0x7f2a0c165360 2023-03-27T10:11:04.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a11f9b700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c070b10 0x7f2a0c06c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:11:04.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.798+0000 7f2a1179a700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c165360 0x7f2a0c06fa10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0098f0 tx=0x7f29fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5608d5136397f0fc server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:04.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a10f99700 1 -- 172.21.15.172:0/3776772079 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc004230 con 0x7f2a0c165360 2023-03-27T10:11:04.802 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a10f99700 1 -- 172.21.15.172:0/3776772079 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc004390 con 0x7f2a0c165360 2023-03-27T10:11:04.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a10f99700 1 -- 172.21.15.172:0/3776772079 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0036a0 con 0x7f2a0c165360 2023-03-27T10:11:04.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 -- 172.21.15.172:0/3776772079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c165360 msgr2=0x7f2a0c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:04.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c165360 0x7f2a0c06fa10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0098f0 tx=0x7f29fc009c00 comp rx=0 tx=0).stop 2023-03-27T10:11:04.803 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 -- 172.21.15.172:0/3776772079 shutdown_connections 2023-03-27T10:11:04.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c070b10 0x7f2a0c06c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 --2- 172.21.15.172:0/3776772079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c165360 0x7f2a0c06fa10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 -- 172.21.15.172:0/3776772079 >> 172.21.15.172:0/3776772079 conn(0x7f2a0c06a1a0 msgr2=0x7f2a0c06a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:04.804 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 -- 172.21.15.172:0/3776772079 shutdown_connections 2023-03-27T10:11:04.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.799+0000 7f2a141ff700 1 -- 172.21.15.172:0/3776772079 wait complete. 2023-03-27T10:11:04.810 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.801+0000 7f2a141ff700 1 Processor -- start 2023-03-27T10:11:04.810 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.801+0000 7f2a141ff700 1 -- start start 2023-03-27T10:11:04.810 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a141ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 0x7f2a0c1ec260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:04.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a141ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c165360 0x7f2a0c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:04.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a141ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0c8860 0x7f2a0c1ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:04.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a141ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1eb1c0 con 0x7f2a0c070b10 2023-03-27T10:11:04.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a141ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1eb4a0 con 0x7f2a0c165360 2023-03-27T10:11:04.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a141ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1eb780 con 0x7f2a0c0c8860 2023-03-27T10:11:04.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a11f9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 0x7f2a0c1ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:04.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a11f9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 0x7f2a0c1ec260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36158/0 (socket says 172.21.15.172:36158) 2023-03-27T10:11:04.812 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.802+0000 7f2a11f9b700 1 -- 172.21.15.172:0/592535094 learned_addr learned my addr 172.21.15.172:0/592535094 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:04.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a1179a700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c165360 0x7f2a0c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:04.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a1279c700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0c8860 0x7f2a0c1ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:04.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a11f9b700 1 -- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0c8860 msgr2=0x7f2a0c1ea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:04.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a11f9b700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0c8860 0x7f2a0c1ea8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a11f9b700 1 -- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c165360 msgr2=0x7f2a0c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a11f9b700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c165360 0x7f2a0c159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a11f9b700 1 -- 172.21.15.172:0/592535094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc009550 con 0x7f2a0c070b10 2023-03-27T10:11:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a11f9b700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 0x7f2a0c1ec260 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c750 tx=0x7f2a0800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011800 con 0x7f2a0c070b10 2023-03-27T10:11:04.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08011960 con 0x7f2a0c070b10 2023-03-27T10:11:04.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0c070ee0 con 0x7f2a0c070b10 2023-03-27T10:11:04.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08011cd0 con 0x7f2a0c070b10 2023-03-27T10:11:04.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.803+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c071c70 con 0x7f2a0c070b10 2023-03-27T10:11:04.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.804+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0c071070 con 0x7f2a0c070b10 2023-03-27T10:11:04.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.805+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f2a08020070 con 0x7f2a0c070b10 2023-03-27T10:11:04.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.806+0000 7f2a027fc700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f29f0066e30 0x7f29f00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:04.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.806+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a08084110 con 0x7f2a0c070b10 2023-03-27T10:11:04.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.807+0000 7f2a1179a700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f29f0066e30 0x7f29f00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:04.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.807+0000 7f2a1179a700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f29f0066e30 0x7f29f00692e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009130 tx=0x7f29fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:04.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:04.810+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f2a0c071070 con 0x7f2a0c070b10 2023-03-27T10:11:05.039 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.039+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2a0c071070 con 0x7f2a0c070b10 2023-03-27T10:11:05.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.599+0000 7f2a027fc700 1 -- 172.21.15.172:0/592535094 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a0c071070 con 0x7f2a0c070b10 2023-03-27T10:11:05.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f29f0066e30 msgr2=0x7f29f00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:05.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f29f0066e30 0x7f29f00692e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009130 tx=0x7f29fc008030 comp rx=0 tx=0).stop 2023-03-27T10:11:05.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 msgr2=0x7f2a0c1ec260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:05.602 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 0x7f2a0c1ec260 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c750 tx=0x7f2a0800cb10 comp rx=0 tx=0).stop 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 shutdown_connections 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0c8860 0x7f2a0c1ea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a0c070b10 0x7f2a0c1ec260 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f29f0066e30 0x7f29f00692e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 --2- 172.21.15.172:0/592535094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c165360 0x7f2a0c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 >> 172.21.15.172:0/592535094 conn(0x7f2a0c06a1a0 msgr2=0x7f2a0c163680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 shutdown_connections 2023-03-27T10:11:05.603 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.602+0000 7f2a141ff700 1 -- 172.21.15.172:0/592535094 wait complete. 2023-03-27T10:11:05.620 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-27T10:11:05.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:11:05.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.805+0000 7fa7badff700 1 Processor -- start 2023-03-27T10:11:05.805 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.806+0000 7fa7badff700 1 -- start start 2023-03-27T10:11:05.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7badff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa7b415ca20 0x7fa7b40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:05.806 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7badff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7b40cd610 0x7fa7b40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:05.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7badff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b40cebc0 con 0x7fa7b40d0b90 2023-03-27T10:11:05.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7badff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b40ceea0 con 0x7fa7b40cd610 2023-03-27T10:11:05.807 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7badff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b40cf180 con 0x7fa7b415ca20 2023-03-27T10:11:05.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7b40cd610 0x7fa7b40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:05.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa7b415ca20 0x7fa7b40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:05.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7b40cd610 0x7fa7b40b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36172/0 (socket says 172.21.15.172:36172) 2023-03-27T10:11:05.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 -- 172.21.15.172:0/823758645 learned_addr learned my addr 172.21.15.172:0/823758645 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:05.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 -- 172.21.15.172:0/823758645 >> v2:172.21.15.191:3300/0 conn(0x7fa7b415ca20 msgr2=0x7fa7b40ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:05.808 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 --2- 172.21.15.172:0/823758645 >> v2:172.21.15.191:3300/0 conn(0x7fa7b415ca20 0x7fa7b40ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 -- 172.21.15.172:0/823758645 >> v1:172.21.15.191:6789/0 conn(0x7fa7b40d0b90 legacy=0x7fa7b40d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.807+0000 7fa7b939c700 1 -- 172.21.15.172:0/823758645 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40cf460 con 0x7fa7b40cd610 2023-03-27T10:11:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7b939c700 1 --2- 172.21.15.172:0/823758645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd610 0x7fa7b40b0170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4067930 tx=0x7fa7ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c585fee8abfac9 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7b37fe700 1 -- 172.21.15.172:0/823758645 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00e070 con 0x7fa7b40cd610 2023-03-27T10:11:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7b37fe700 1 -- 172.21.15.172:0/823758645 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00b910 con 0x7fa7b40cd610 2023-03-27T10:11:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7b37fe700 1 -- 172.21.15.172:0/823758645 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00bcc0 con 0x7fa7b40cd610 2023-03-27T10:11:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7badff700 1 -- 172.21.15.172:0/823758645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd610 msgr2=0x7fa7b40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7badff700 1 --2- 172.21.15.172:0/823758645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd610 0x7fa7b40b0170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4067930 tx=0x7fa7ac00b330 comp rx=0 tx=0).stop 2023-03-27T10:11:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.808+0000 7fa7badff700 1 -- 172.21.15.172:0/823758645 shutdown_connections 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.809+0000 7fa7badff700 1 --2- 172.21.15.172:0/823758645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd610 0x7fa7b40b0170 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.809+0000 7fa7badff700 1 --2- 172.21.15.172:0/823758645 >> v2:172.21.15.191:3300/0 conn(0x7fa7b415ca20 0x7fa7b40ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.809+0000 7fa7badff700 1 -- 172.21.15.172:0/823758645 >> 172.21.15.172:0/823758645 conn(0x7fa7b40721f0 msgr2=0x7fa7b409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.809+0000 7fa7badff700 1 -- 172.21.15.172:0/823758645 shutdown_connections 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.809+0000 7fa7badff700 1 -- 172.21.15.172:0/823758645 wait complete. 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.810+0000 7fa7badff700 1 Processor -- start 2023-03-27T10:11:05.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.810+0000 7fa7badff700 1 -- start start 2023-03-27T10:11:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.811+0000 7fa7badff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7b40cd610 0x7fa7b4157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.811+0000 7fa7badff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 0x7fa7b40c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.811+0000 7fa7badff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7b415ca20 0x7fa7b406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.811+0000 7fa7badff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b4158410 con 0x7fa7b40d0b90 2023-03-27T10:11:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.811+0000 7fa7badff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40cb650 con 0x7fa7b40cd610 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.811+0000 7fa7badff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40cb930 con 0x7fa7b415ca20 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 0x7fa7b40c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 0x7fa7b40c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36180/0 (socket says 172.21.15.172:36180) 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 -- 172.21.15.172:0/2360842661 learned_addr learned my addr 172.21.15.172:0/2360842661 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b8b9b700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7b40cd610 0x7fa7b4157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b939c700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7b415ca20 0x7fa7b406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 -- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7b415ca20 msgr2=0x7fa7b406bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7b415ca20 0x7fa7b406bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 -- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7b40cd610 msgr2=0x7fa7b4157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7b40cd610 0x7fa7b4157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 -- 172.21.15.172:0/2360842661 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac009b30 con 0x7fa7b40d0b90 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b939c700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7b415ca20 0x7fa7b406bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.812+0000 7fa7b3fff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 0x7fa7b40c8fe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000e870 tx=0x7fa7a000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:05.818 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.813+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0009590 con 0x7fa7b40d0b90 2023-03-27T10:11:05.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.813+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a0013680 con 0x7fa7b40d0b90 2023-03-27T10:11:05.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.813+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00139f0 con 0x7fa7b40d0b90 2023-03-27T10:11:05.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.813+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b40d2d30 con 0x7fa7b40d0b90 2023-03-27T10:11:05.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.813+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b40afc50 con 0x7fa7b40d0b90 2023-03-27T10:11:05.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.814+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b40b06b0 con 0x7fa7b40d0b90 2023-03-27T10:11:05.819 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.815+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fa7a0019030 con 0x7fa7b40d0b90 2023-03-27T10:11:05.820 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.816+0000 7fa7b17fa700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa798066e60 0x7fa798069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:05.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.816+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7a0084100 con 0x7fa7b40d0b90 2023-03-27T10:11:05.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.816+0000 7fa7b8b9b700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa798066e60 0x7fa798069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:05.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.817+0000 7fa7b8b9b700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa798066e60 0x7fa798069310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8000fb0 tx=0x7fa7a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:05.821 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:05.820+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fa7a0051250 con 0x7fa7b40d0b90 2023-03-27T10:11:06.051 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.052+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7b4074290 con 0x7fa7b40d0b90 2023-03-27T10:11:06.052 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.052+0000 7fa7b17fa700 1 -- 172.21.15.172:0/2360842661 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4621 (secure 0 0 0) 0x7fa7a0017090 con 0x7fa7b40d0b90 2023-03-27T10:11:06.052 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:06.052 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/582352933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":582352933},{"type":"v1","addr":"172.21.15.172:6834","nonce":582352933}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3004564680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3004564680},{"type":"v1","addr":"172.21.15.191:6835","nonce":3004564680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/288487287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":288487287},{"type":"v1","addr":"172.21.15.191:6837","nonce":288487287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:11:02.571096+0000","modified":"2023-03-27T10:11:05.598205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/352432093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":352432093},{"type":"v1","addr":"172.21.15.172:6835","nonce":352432093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-27T10:11:06.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa798066e60 msgr2=0x7fa798069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa798066e60 0x7fa798069310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8000fb0 tx=0x7fa7a8009040 comp rx=0 tx=0).stop 2023-03-27T10:11:06.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 msgr2=0x7fa7b40c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 0x7fa7b40c8fe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000e870 tx=0x7fa7a000eb80 comp rx=0 tx=0).stop 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 shutdown_connections 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa7b415ca20 0x7fa7b406bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa798066e60 0x7fa798069310 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7b40cd610 0x7fa7b4157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 --2- 172.21.15.172:0/2360842661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40d0b90 0x7fa7b40c8fe0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.055 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 >> 172.21.15.172:0/2360842661 conn(0x7fa7b40721f0 msgr2=0x7fa7b409c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:06.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 shutdown_connections 2023-03-27T10:11:06.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.055+0000 7fa7badff700 1 -- 172.21.15.172:0/2360842661 wait complete. 2023-03-27T10:11:06.056 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 16 2023-03-27T10:11:06.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-27T10:11:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.256+0000 7ff9c41ff700 1 Processor -- start 2023-03-27T10:11:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.256+0000 7ff9c41ff700 1 -- start start 2023-03-27T10:11:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.257+0000 7ff9c41ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9bc0d0b90 0x7ff9bc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.257+0000 7ff9c41ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff9bc15ca20 0x7ff9bc0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.257+0000 7ff9c41ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc0cd610 0x7ff9bc0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.257+0000 7ff9c41ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc0d14a0 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.257+0000 7ff9c41ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc0cebc0 con 0x7ff9bc15ca20 2023-03-27T10:11:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.257+0000 7ff9c41ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ceea0 con 0x7ff9bc0cd610 2023-03-27T10:11:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9bc0d0b90 0x7ff9bc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9bc0d0b90 0x7ff9bc0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45870/0 (socket says 172.21.15.172:45870) 2023-03-27T10:11:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 -- 172.21.15.172:0/1003313637 learned_addr learned my addr 172.21.15.172:0/1003313637 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c279c700 1 --2- 172.21.15.172:0/1003313637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc0cd610 0x7ff9bc0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c179a700 1 --2- 172.21.15.172:0/1003313637 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc15ca20 0x7ff9bc0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 -- 172.21.15.172:0/1003313637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc0cd610 msgr2=0x7ff9bc0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 --2- 172.21.15.172:0/1003313637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc0cd610 0x7ff9bc0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 -- 172.21.15.172:0/1003313637 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc15ca20 msgr2=0x7ff9bc0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 --2- 172.21.15.172:0/1003313637 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc15ca20 0x7ff9bc0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 -- 172.21.15.172:0/1003313637 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0cf180 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c1f9b700 1 --2- 172.21.15.172:0/1003313637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0ce500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc067930 tx=0x7ff9b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c3d9d84f18d323 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c0f99700 1 -- 172.21.15.172:0/1003313637 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8005e30 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.258+0000 7ff9c0f99700 1 -- 172.21.15.172:0/1003313637 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8004030 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c0f99700 1 -- 172.21.15.172:0/1003313637 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80043e0 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 -- 172.21.15.172:0/1003313637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 msgr2=0x7ff9bc0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/1003313637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0ce500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc067930 tx=0x7ff9b8009bd0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 -- 172.21.15.172:0/1003313637 shutdown_connections 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/1003313637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc0cd610 0x7ff9bc0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/1003313637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0ce500 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/1003313637 >> v2:172.21.15.191:3300/0 conn(0x7ff9bc15ca20 0x7ff9bc0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 -- 172.21.15.172:0/1003313637 >> 172.21.15.172:0/1003313637 conn(0x7ff9bc0721f0 msgr2=0x7ff9bc09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 -- 172.21.15.172:0/1003313637 shutdown_connections 2023-03-27T10:11:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.259+0000 7ff9c41ff700 1 -- 172.21.15.172:0/1003313637 wait complete. 2023-03-27T10:11:06.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.261+0000 7ff9c41ff700 1 Processor -- start 2023-03-27T10:11:06.264 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.261+0000 7ff9c41ff700 1 -- start start 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c41ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0cd610 0x7ff9bc0b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c41ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c41ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc15ca20 0x7ff9bc14dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c41ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0b1a20 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c41ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ccef0 con 0x7ff9bc0cd610 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c41ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc14e2d0 con 0x7ff9bc15ca20 2023-03-27T10:11:06.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c179a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c179a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45872/0 (socket says 172.21.15.172:45872) 2023-03-27T10:11:06.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c179a700 1 -- 172.21.15.172:0/2512618155 learned_addr learned my addr 172.21.15.172:0/2512618155 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:06.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c1f9b700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0cd610 0x7ff9bc0b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.262+0000 7ff9c279c700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc15ca20 0x7ff9bc14dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c179a700 1 -- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc15ca20 msgr2=0x7ff9bc14dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c179a700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc15ca20 0x7ff9bc14dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c179a700 1 -- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0cd610 msgr2=0x7ff9bc0b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c179a700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0cd610 0x7ff9bc0b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c179a700 1 -- 172.21.15.172:0/2512618155 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8009500 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c179a700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0cc9b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00e870 tx=0x7ff9ac00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac009590 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac013680 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc0afc50 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0139f0 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.263+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc0cf460 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.264+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0d2d30 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.265+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff9ac019030 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.269 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.266+0000 7ff9b27fc700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff9a0066e30 0x7ff9a00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.266+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9ac083f60 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.267+0000 7ff9c1f9b700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff9a0066e30 0x7ff9a00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.267+0000 7ff9c1f9b700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff9a0066e30 0x7ff9a00692e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8000c00 tx=0x7ff9b8008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.270+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff9ac0511a0 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.461 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.462+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9bc074290 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.462 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.463+0000 7ff9b27fc700 1 -- 172.21.15.172:0/2512618155 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18027 (secure 0 0 0) 0x7ff9ac0547c0 con 0x7ff9bc0d0b90 2023-03-27T10:11:06.463 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:06.463 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":38,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","created":"2023-03-27T10:09:24.794626+0000","modified":"2023-03-27T10:11:03.573581+0000","last_up_change":"2023-03-27T10:09:38.333373+0000","last_in_change":"2023-03-27T10:09:28.238841+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-03-27T10:09:39.328496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-03-27T10:09:44.548058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-03-27T10:11:00.572681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-03-27T10:11:01.547602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96dedca0-521a-412e-b4c8-a61859522ba1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":110158},{"type":"v1","addr":"172.21.15.172:6801","nonce":110158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":110158},{"type":"v1","addr":"172.21.15.172:6803","nonce":110158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":110158},{"type":"v1","addr":"172.21.15.172:6807","nonce":110158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":110158},{"type":"v1","addr":"172.21.15.172:6805","nonce":110158}]},"public_addr":"172.21.15.172:6801/110158","cluster_addr":"172.21.15.172:6803/110158","heartbeat_back_addr":"172.21.15.172:6807/110158","heartbeat_front_addr":"172.21.15.172:6805/110158","state":["exists","up"]},{"osd":1,"uuid":"9b075997-cdc8-48dc-991a-b2806a0906e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":110160},{"type":"v1","addr":"172.21.15.172:6817","nonce":110160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":110160},{"type":"v1","addr":"172.21.15.172:6819","nonce":110160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":110160},{"type":"v1","addr":"172.21.15.172:6823","nonce":110160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":110160},{"type":"v1","addr":"172.21.15.172:6821","nonce":110160}]},"public_addr":"172.21.15.172:6817/110160","cluster_addr":"172.21.15.172:6819/110160","heartbeat_back_addr":"172.21.15.172:6823/110160","heartbeat_front_addr":"172.21.15.172:6821/110160","state":["exists","up"]},{"osd":2,"uuid":"b4faa64b-651e-48f4-8c49-21b64e8d7d7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":110162},{"type":"v1","addr":"172.21.15.172:6825","nonce":110162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":110162},{"type":"v1","addr":"172.21.15.172:6827","nonce":110162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":110162},{"type":"v1","addr":"172.21.15.172:6831","nonce":110162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":110162},{"type":"v1","addr":"172.21.15.172:6829","nonce":110162}]},"public_addr":"172.21.15.172:6825/110162","cluster_addr":"172.21.15.172:6827/110162","heartbeat_back_addr":"172.21.15.172:6831/110162","heartbeat_front_addr":"172.21.15.172:6829/110162","state":["exists","up"]},{"osd":3,"uuid":"2d66b184-a708-4d44-b64f-2eec033be78a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":110161},{"type":"v1","addr":"172.21.15.172:6809","nonce":110161}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":110161},{"type":"v1","addr":"172.21.15.172:6811","nonce":110161}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":110161},{"type":"v1","addr":"172.21.15.172:6815","nonce":110161}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":110161},{"type":"v1","addr":"172.21.15.172:6813","nonce":110161}]},"public_addr":"172.21.15.172:6809/110161","cluster_addr":"172.21.15.172:6811/110161","heartbeat_back_addr":"172.21.15.172:6815/110161","heartbeat_front_addr":"172.21.15.172:6813/110161","state":["exists","up"]},{"osd":4,"uuid":"c32fd432-27ba-44fa-b477-113622563b2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":110409},{"type":"v1","addr":"172.21.15.191:6817","nonce":110409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":110409},{"type":"v1","addr":"172.21.15.191:6819","nonce":110409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6823","nonce":110409},{"type":"v1","addr":"172.21.15.191:6825","nonce":110409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":110409},{"type":"v1","addr":"172.21.15.191:6821","nonce":110409}]},"public_addr":"172.21.15.191:6817/110409","cluster_addr":"172.21.15.191:6819/110409","heartbeat_back_addr":"172.21.15.191:6825/110409","heartbeat_front_addr":"172.21.15.191:6821/110409","state":["exists","up"]},{"osd":5,"uuid":"9b8bf9d0-912b-4a79-960f-01b630c1a8cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":110407},{"type":"v1","addr":"172.21.15.191:6809","nonce":110407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":110407},{"type":"v1","addr":"172.21.15.191:6811","nonce":110407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":110407},{"type":"v1","addr":"172.21.15.191:6815","nonce":110407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":110407},{"type":"v1","addr":"172.21.15.191:6813","nonce":110407}]},"public_addr":"172.21.15.191:6809/110407","cluster_addr":"172.21.15.191:6811/110407","heartbeat_back_addr":"172.21.15.191:6815/110407","heartbeat_front_addr":"172.21.15.191:6813/110407","state":["exists","up"]},{"osd":6,"uuid":"7224502a-7a32-4a31-a2c5-95d3a5abed83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":110408},{"type":"v1","addr":"172.21.15.191:6801","nonce":110408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":110408},{"type":"v1","addr":"172.21.15.191:6803","nonce":110408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":110408},{"type":"v1","addr":"172.21.15.191:6807","nonce":110408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":110408},{"type":"v1","addr":"172.21.15.191:6805","nonce":110408}]},"public_addr":"172.21.15.191:6801/110408","cluster_addr":"172.21.15.191:6803/110408","heartbeat_back_addr":"172.21.15.191:6807/110408","heartbeat_front_addr":"172.21.15.191:6805/110408","state":["exists","up"]},{"osd":7,"uuid":"7402619e-0584-4337-a66e-c95f4fb04e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":110410},{"type":"v1","addr":"172.21.15.191:6824","nonce":110410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":110410},{"type":"v1","addr":"172.21.15.191:6827","nonce":110410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":110410},{"type":"v1","addr":"172.21.15.191:6831","nonce":110410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":110410},{"type":"v1","addr":"172.21.15.191:6829","nonce":110410}]},"public_addr":"172.21.15.191:6824/110410","cluster_addr":"172.21.15.191:6827/110410","heartbeat_back_addr":"172.21.15.191:6831/110410","heartbeat_front_addr":"172.21.15.191:6829/110410","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.764649+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.790988+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.566619+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.559142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.611626+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.580115+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.479197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-27T10:09:33.545497+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-27T10:11:06.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.465+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff9a0066e30 msgr2=0x7ff9a00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.465 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.465+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff9a0066e30 0x7ff9a00692e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8000c00 tx=0x7ff9b8008070 comp rx=0 tx=0).stop 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.465+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 msgr2=0x7ff9bc0cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.465+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0cc9b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00e870 tx=0x7ff9ac00eb80 comp rx=0 tx=0).stop 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 shutdown_connections 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9bc15ca20 0x7ff9bc14dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff9a0066e30 0x7ff9a00692e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9bc0cd610 0x7ff9bc0b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.466 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 --2- 172.21.15.172:0/2512618155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9bc0d0b90 0x7ff9bc0cc9b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.467 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 >> 172.21.15.172:0/2512618155 conn(0x7ff9bc0721f0 msgr2=0x7ff9bc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:06.467 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 shutdown_connections 2023-03-27T10:11:06.467 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.466+0000 7ff9c41ff700 1 -- 172.21.15.172:0/2512618155 wait complete. 2023-03-27T10:11:06.482 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-27T10:11:06.483 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-27T10:11:06.668 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.669+0000 7f635fdff700 1 Processor -- start 2023-03-27T10:11:06.669 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.669+0000 7f635fdff700 1 -- start start 2023-03-27T10:11:06.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635fdff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63580d0b90 0x7f63580ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635fdff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580cebc0 con 0x7f63580cd610 2023-03-27T10:11:06.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635fdff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580ceea0 con 0x7f635815ca20 2023-03-27T10:11:06.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635fdff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63580cf180 con 0x7f63580d0b90 2023-03-27T10:11:06.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635db9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63580d0b90 0x7f63580ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635e39c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f63580cd610 0x7f63580b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60604/0 (socket says 172.21.15.172:60604) 2023-03-27T10:11:06.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.670+0000 7f635e39c700 1 -- 172.21.15.172:0/94503630 learned_addr learned my addr 172.21.15.172:0/94503630 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:06.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635db9b700 1 -- 172.21.15.172:0/94503630 >> v1:172.21.15.191:6789/0 conn(0x7f635815ca20 legacy=0x7f63580d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:06.675 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635db9b700 1 -- 172.21.15.172:0/94503630 >> v1:172.21.15.172:6789/0 conn(0x7f63580cd610 legacy=0x7f63580b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635db9b700 1 -- 172.21.15.172:0/94503630 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580cf460 con 0x7f63580d0b90 2023-03-27T10:11:06.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635db9b700 1 --2- 172.21.15.172:0/94503630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580d0b90 0x7f63580ce500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6354009820 tx=0x7f6354009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dc09c9caa04c30 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:06.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635cb99700 1 -- 172.21.15.172:0/94503630 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354005e30 con 0x7f63580d0b90 2023-03-27T10:11:06.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635cb99700 1 -- 172.21.15.172:0/94503630 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6354004030 con 0x7f63580d0b90 2023-03-27T10:11:06.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635cb99700 1 -- 172.21.15.172:0/94503630 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540043c0 con 0x7f63580d0b90 2023-03-27T10:11:06.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635fdff700 1 -- 172.21.15.172:0/94503630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580d0b90 msgr2=0x7f63580ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.671+0000 7f635fdff700 1 --2- 172.21.15.172:0/94503630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580d0b90 0x7f63580ce500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6354009820 tx=0x7f6354009b30 comp rx=0 tx=0).stop 2023-03-27T10:11:06.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.672+0000 7f635fdff700 1 -- 172.21.15.172:0/94503630 shutdown_connections 2023-03-27T10:11:06.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.672+0000 7f635fdff700 1 --2- 172.21.15.172:0/94503630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580d0b90 0x7f63580ce500 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.672+0000 7f635fdff700 1 -- 172.21.15.172:0/94503630 >> 172.21.15.172:0/94503630 conn(0x7f63580721f0 msgr2=0x7f635809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:06.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.672+0000 7f635fdff700 1 -- 172.21.15.172:0/94503630 shutdown_connections 2023-03-27T10:11:06.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.672+0000 7f635fdff700 1 -- 172.21.15.172:0/94503630 wait complete. 2023-03-27T10:11:06.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.673+0000 7f635fdff700 1 Processor -- start 2023-03-27T10:11:06.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.673+0000 7f635fdff700 1 -- start start 2023-03-27T10:11:06.683 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.674+0000 7f635fdff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 0x7f635815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.674+0000 7f635fdff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63580d0b90 0x7f63580b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.674+0000 7f635fdff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635815ca20 0x7f63580d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.674+0000 7f635fdff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635815ab10 con 0x7f63580cd610 2023-03-27T10:11:06.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.674+0000 7f635fdff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63580cb410 con 0x7f635815ca20 2023-03-27T10:11:06.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.674+0000 7f635fdff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63580caf80 con 0x7f63580d0b90 2023-03-27T10:11:06.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 0x7f635815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 0x7f635815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45894/0 (socket says 172.21.15.172:45894) 2023-03-27T10:11:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 -- 172.21.15.172:0/512597875 learned_addr learned my addr 172.21.15.172:0/512597875 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635e39c700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635815ca20 0x7f63580d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635d39a700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63580d0b90 0x7f63580b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 -- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63580d0b90 msgr2=0x7f63580b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63580d0b90 0x7f63580b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 -- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635815ca20 msgr2=0x7f63580d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635815ca20 0x7f63580d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 -- 172.21.15.172:0/512597875 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354009430 con 0x7f63580cd610 2023-03-27T10:11:06.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f635db9b700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 0x7f635815a5d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6358066a70 tx=0x7f6354004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:06.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.675+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635401c420 con 0x7f63580cd610 2023-03-27T10:11:06.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.676+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635401c5a0 con 0x7f63580cd610 2023-03-27T10:11:06.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.676+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63580d2d30 con 0x7f63580cd610 2023-03-27T10:11:06.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.676+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635401c950 con 0x7f63580cd610 2023-03-27T10:11:06.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.676+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63580afc50 con 0x7f63580cd610 2023-03-27T10:11:06.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.677+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63580b0880 con 0x7f63580cd610 2023-03-27T10:11:06.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.678+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f635402c070 con 0x7f63580cd610 2023-03-27T10:11:06.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.679+0000 7f634e7fc700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f633c066e30 0x7f633c0692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:06.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.679+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6354085550 con 0x7f63580cd610 2023-03-27T10:11:06.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.679+0000 7f635d39a700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f633c066e30 0x7f633c0692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:06.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.680+0000 7f635d39a700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f633c066e30 0x7f633c0692e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63581e30f0 tx=0x7f6348008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:06.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.683+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f6354052790 con 0x7f63580cd610 2023-03-27T10:11:06.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.869+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 --> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63580cb0c0 con 0x7f633c066e30 2023-03-27T10:11:06.879 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.880+0000 7f634e7fc700 1 -- 172.21.15.172:0/512597875 <== mgr.4100 v2:172.21.15.191:6832/109700 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310874 (secure 0 0 0) 0x7f6348009510 con 0x7f633c066e30 2023-03-27T10:11:06.885 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f633c066e30 msgr2=0x7f633c0692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f633c066e30 0x7f633c0692e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63581e30f0 tx=0x7f6348008040 comp rx=0 tx=0).stop 2023-03-27T10:11:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 msgr2=0x7f635815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 0x7f635815a5d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6358066a70 tx=0x7f6354004750 comp rx=0 tx=0).stop 2023-03-27T10:11:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 shutdown_connections 2023-03-27T10:11:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f633c066e30 0x7f633c0692e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f635815ca20 0x7f63580d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cd610 0x7f635815a5d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 --2- 172.21.15.172:0/512597875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63580d0b90 0x7f63580b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:06.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 >> 172.21.15.172:0/512597875 conn(0x7f63580721f0 msgr2=0x7f63580b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:06.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 shutdown_connections 2023-03-27T10:11:06.891 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:06.884+0000 7f635fdff700 1 -- 172.21.15.172:0/512597875 wait complete. 2023-03-27T10:11:06.891 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-03-27T10:11:06.901 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-03-27T10:11:05.294137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69832,"kb_used_data":4488,"kb_used_omap":0,"kb_used_meta":65280,"kb_avail":754904888,"statfs":{"total":773094113280,"available":773022605312,"internally_reserved":0,"allocated":4595712,"data_stored":2561053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66846720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.205538"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594939+0000","last_change":"2023-03-27T10:11:02.585696+0000","last_active":"2023-03-27T10:11:02.594939+0000","last_peered":"2023-03-27T10:11:02.594939+0000","last_clean":"2023-03-27T10:11:02.594939+0000","last_became_active":"2023-03-27T10:11:02.585452+0000","last_became_peered":"2023-03-27T10:11:02.585452+0000","last_unstale":"2023-03-27T10:11:02.594939+0000","last_undegraded":"2023-03-27T10:11:02.594939+0000","last_fullsized":"2023-03-27T10:11:02.594939+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:41:45.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597624+0000","last_change":"2023-03-27T10:11:02.587288+0000","last_active":"2023-03-27T10:11:02.597624+0000","last_peered":"2023-03-27T10:11:02.597624+0000","last_clean":"2023-03-27T10:11:02.597624+0000","last_became_active":"2023-03-27T10:11:02.586999+0000","last_became_peered":"2023-03-27T10:11:02.586999+0000","last_unstale":"2023-03-27T10:11:02.597624+0000","last_undegraded":"2023-03-27T10:11:02.597624+0000","last_fullsized":"2023-03-27T10:11:02.597624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:00:09.866300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603437+0000","last_change":"2023-03-27T10:11:02.601277+0000","last_active":"2023-03-27T10:11:02.603437+0000","last_peered":"2023-03-27T10:11:02.603437+0000","last_clean":"2023-03-27T10:11:02.603437+0000","last_became_active":"2023-03-27T10:11:02.600992+0000","last_became_peered":"2023-03-27T10:11:02.600992+0000","last_unstale":"2023-03-27T10:11:02.603437+0000","last_undegraded":"2023-03-27T10:11:02.603437+0000","last_fullsized":"2023-03-27T10:11:02.603437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:53:11.976085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585272+0000","last_change":"2023-03-27T10:11:02.594058+0000","last_active":"2023-03-27T10:11:03.585272+0000","last_peered":"2023-03-27T10:11:03.585272+0000","last_clean":"2023-03-27T10:11:03.585272+0000","last_became_active":"2023-03-27T10:11:02.593788+0000","last_became_peered":"2023-03-27T10:11:02.593788+0000","last_unstale":"2023-03-27T10:11:03.585272+0000","last_undegraded":"2023-03-27T10:11:03.585272+0000","last_fullsized":"2023-03-27T10:11:03.585272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:35:35.826629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585134+0000","last_change":"2023-03-27T10:11:02.587715+0000","last_active":"2023-03-27T10:11:03.585134+0000","last_peered":"2023-03-27T10:11:03.585134+0000","last_clean":"2023-03-27T10:11:03.585134+0000","last_became_active":"2023-03-27T10:11:02.587435+0000","last_became_peered":"2023-03-27T10:11:02.587435+0000","last_unstale":"2023-03-27T10:11:03.585134+0000","last_undegraded":"2023-03-27T10:11:03.585134+0000","last_fullsized":"2023-03-27T10:11:03.585134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:52.645620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606386+0000","last_change":"2023-03-27T10:11:02.602250+0000","last_active":"2023-03-27T10:11:02.606386+0000","last_peered":"2023-03-27T10:11:02.606386+0000","last_clean":"2023-03-27T10:11:02.606386+0000","last_became_active":"2023-03-27T10:11:02.601972+0000","last_became_peered":"2023-03-27T10:11:02.601972+0000","last_unstale":"2023-03-27T10:11:02.606386+0000","last_undegraded":"2023-03-27T10:11:02.606386+0000","last_fullsized":"2023-03-27T10:11:02.606386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:49:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598082+0000","last_change":"2023-03-27T10:11:02.589339+0000","last_active":"2023-03-27T10:11:02.598082+0000","last_peered":"2023-03-27T10:11:02.598082+0000","last_clean":"2023-03-27T10:11:02.598082+0000","last_became_active":"2023-03-27T10:11:02.588923+0000","last_became_peered":"2023-03-27T10:11:02.588923+0000","last_unstale":"2023-03-27T10:11:02.598082+0000","last_undegraded":"2023-03-27T10:11:02.598082+0000","last_fullsized":"2023-03-27T10:11:02.598082+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:28:39.436788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.595410+0000","last_change":"2023-03-27T10:11:02.586554+0000","last_active":"2023-03-27T10:11:02.595410+0000","last_peered":"2023-03-27T10:11:02.595410+0000","last_clean":"2023-03-27T10:11:02.595410+0000","last_became_active":"2023-03-27T10:11:02.586291+0000","last_became_peered":"2023-03-27T10:11:02.586291+0000","last_unstale":"2023-03-27T10:11:02.595410+0000","last_undegraded":"2023-03-27T10:11:02.595410+0000","last_fullsized":"2023-03-27T10:11:02.595410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:28:39.436788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597519+0000","last_change":"2023-03-27T10:11:02.591897+0000","last_active":"2023-03-27T10:11:02.597519+0000","last_peered":"2023-03-27T10:11:02.597519+0000","last_clean":"2023-03-27T10:11:02.597519+0000","last_became_active":"2023-03-27T10:11:02.591638+0000","last_became_peered":"2023-03-27T10:11:02.591638+0000","last_unstale":"2023-03-27T10:11:02.597519+0000","last_undegraded":"2023-03-27T10:11:02.597519+0000","last_fullsized":"2023-03-27T10:11:02.597519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:49:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602473+0000","last_change":"2023-03-27T10:11:02.594631+0000","last_active":"2023-03-27T10:11:02.602473+0000","last_peered":"2023-03-27T10:11:02.602473+0000","last_clean":"2023-03-27T10:11:02.602473+0000","last_became_active":"2023-03-27T10:11:02.594203+0000","last_became_peered":"2023-03-27T10:11:02.594203+0000","last_unstale":"2023-03-27T10:11:02.602473+0000","last_undegraded":"2023-03-27T10:11:02.602473+0000","last_fullsized":"2023-03-27T10:11:02.602473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:41:45.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606454+0000","last_change":"2023-03-27T10:11:02.597483+0000","last_active":"2023-03-27T10:11:02.606454+0000","last_peered":"2023-03-27T10:11:02.606454+0000","last_clean":"2023-03-27T10:11:02.606454+0000","last_became_active":"2023-03-27T10:11:02.597143+0000","last_became_peered":"2023-03-27T10:11:02.597143+0000","last_unstale":"2023-03-27T10:11:02.606454+0000","last_undegraded":"2023-03-27T10:11:02.606454+0000","last_fullsized":"2023-03-27T10:11:02.606454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:20:18.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.591544+0000","last_change":"2023-03-27T10:11:02.587871+0000","last_active":"2023-03-27T10:11:02.591544+0000","last_peered":"2023-03-27T10:11:02.591544+0000","last_clean":"2023-03-27T10:11:02.591544+0000","last_became_active":"2023-03-27T10:11:02.586997+0000","last_became_peered":"2023-03-27T10:11:02.586997+0000","last_unstale":"2023-03-27T10:11:02.591544+0000","last_undegraded":"2023-03-27T10:11:02.591544+0000","last_fullsized":"2023-03-27T10:11:02.591544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:18.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602620+0000","last_change":"2023-03-27T10:11:02.593892+0000","last_active":"2023-03-27T10:11:02.602620+0000","last_peered":"2023-03-27T10:11:02.602620+0000","last_clean":"2023-03-27T10:11:02.602620+0000","last_became_active":"2023-03-27T10:11:02.593507+0000","last_became_peered":"2023-03-27T10:11:02.593507+0000","last_unstale":"2023-03-27T10:11:02.602620+0000","last_undegraded":"2023-03-27T10:11:02.602620+0000","last_fullsized":"2023-03-27T10:11:02.602620+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604594+0000","last_change":"2023-03-27T10:11:02.595635+0000","last_active":"2023-03-27T10:11:02.604594+0000","last_peered":"2023-03-27T10:11:02.604594+0000","last_clean":"2023-03-27T10:11:02.604594+0000","last_became_active":"2023-03-27T10:11:02.595278+0000","last_became_peered":"2023-03-27T10:11:02.595278+0000","last_unstale":"2023-03-27T10:11:02.604594+0000","last_undegraded":"2023-03-27T10:11:02.604594+0000","last_fullsized":"2023-03-27T10:11:02.604594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598055+0000","last_change":"2023-03-27T10:11:02.589171+0000","last_active":"2023-03-27T10:11:02.598055+0000","last_peered":"2023-03-27T10:11:02.598055+0000","last_clean":"2023-03-27T10:11:02.598055+0000","last_became_active":"2023-03-27T10:11:02.588558+0000","last_became_peered":"2023-03-27T10:11:02.588558+0000","last_unstale":"2023-03-27T10:11:02.598055+0000","last_undegraded":"2023-03-27T10:11:02.598055+0000","last_fullsized":"2023-03-27T10:11:02.598055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:09:37.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.607629+0000","last_change":"2023-03-27T10:11:02.600532+0000","last_active":"2023-03-27T10:11:02.607629+0000","last_peered":"2023-03-27T10:11:02.607629+0000","last_clean":"2023-03-27T10:11:02.607629+0000","last_became_active":"2023-03-27T10:11:02.600255+0000","last_became_peered":"2023-03-27T10:11:02.600255+0000","last_unstale":"2023-03-27T10:11:02.607629+0000","last_undegraded":"2023-03-27T10:11:02.607629+0000","last_fullsized":"2023-03-27T10:11:02.607629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609287+0000","last_change":"2023-03-27T10:11:02.605864+0000","last_active":"2023-03-27T10:11:02.609287+0000","last_peered":"2023-03-27T10:11:02.609287+0000","last_clean":"2023-03-27T10:11:02.609287+0000","last_became_active":"2023-03-27T10:11:02.605580+0000","last_became_peered":"2023-03-27T10:11:02.605580+0000","last_unstale":"2023-03-27T10:11:02.609287+0000","last_undegraded":"2023-03-27T10:11:02.609287+0000","last_fullsized":"2023-03-27T10:11:02.609287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:55:17.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611061+0000","last_change":"2023-03-27T10:11:02.608136+0000","last_active":"2023-03-27T10:11:02.611061+0000","last_peered":"2023-03-27T10:11:02.611061+0000","last_clean":"2023-03-27T10:11:02.611061+0000","last_became_active":"2023-03-27T10:11:02.607876+0000","last_became_peered":"2023-03-27T10:11:02.607876+0000","last_unstale":"2023-03-27T10:11:02.611061+0000","last_undegraded":"2023-03-27T10:11:02.611061+0000","last_fullsized":"2023-03-27T10:11:02.611061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:52.645620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585382+0000","last_change":"2023-03-27T10:11:02.598490+0000","last_active":"2023-03-27T10:11:03.585382+0000","last_peered":"2023-03-27T10:11:03.585382+0000","last_clean":"2023-03-27T10:11:03.585382+0000","last_became_active":"2023-03-27T10:11:02.598229+0000","last_became_peered":"2023-03-27T10:11:02.598229+0000","last_unstale":"2023-03-27T10:11:03.585382+0000","last_undegraded":"2023-03-27T10:11:03.585382+0000","last_fullsized":"2023-03-27T10:11:03.585382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:15.637434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611025+0000","last_change":"2023-03-27T10:11:02.607708+0000","last_active":"2023-03-27T10:11:02.611025+0000","last_peered":"2023-03-27T10:11:02.611025+0000","last_clean":"2023-03-27T10:11:02.611025+0000","last_became_active":"2023-03-27T10:11:02.607430+0000","last_became_peered":"2023-03-27T10:11:02.607430+0000","last_unstale":"2023-03-27T10:11:02.611025+0000","last_undegraded":"2023-03-27T10:11:02.611025+0000","last_fullsized":"2023-03-27T10:11:02.611025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:30:34.349275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606458+0000","last_change":"2023-03-27T10:11:02.599932+0000","last_active":"2023-03-27T10:11:02.606458+0000","last_peered":"2023-03-27T10:11:02.606458+0000","last_clean":"2023-03-27T10:11:02.606458+0000","last_became_active":"2023-03-27T10:11:02.599670+0000","last_became_peered":"2023-03-27T10:11:02.599670+0000","last_unstale":"2023-03-27T10:11:02.606458+0000","last_undegraded":"2023-03-27T10:11:02.606458+0000","last_fullsized":"2023-03-27T10:11:02.606458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:53:13.497786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604549+0000","last_change":"2023-03-27T10:11:02.591217+0000","last_active":"2023-03-27T10:11:02.604549+0000","last_peered":"2023-03-27T10:11:02.604549+0000","last_clean":"2023-03-27T10:11:02.604549+0000","last_became_active":"2023-03-27T10:11:02.590951+0000","last_became_peered":"2023-03-27T10:11:02.590951+0000","last_unstale":"2023-03-27T10:11:02.604549+0000","last_undegraded":"2023-03-27T10:11:02.604549+0000","last_fullsized":"2023-03-27T10:11:02.604549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:55:32.614782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603296+0000","last_change":"2023-03-27T10:11:02.594207+0000","last_active":"2023-03-27T10:11:02.603296+0000","last_peered":"2023-03-27T10:11:02.603296+0000","last_clean":"2023-03-27T10:11:02.603296+0000","last_became_active":"2023-03-27T10:11:02.593789+0000","last_became_peered":"2023-03-27T10:11:02.593789+0000","last_unstale":"2023-03-27T10:11:02.603296+0000","last_undegraded":"2023-03-27T10:11:02.603296+0000","last_fullsized":"2023-03-27T10:11:02.603296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:55:32.614782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.584951+0000","last_change":"2023-03-27T10:11:02.593443+0000","last_active":"2023-03-27T10:11:03.584951+0000","last_peered":"2023-03-27T10:11:03.584951+0000","last_clean":"2023-03-27T10:11:03.584951+0000","last_became_active":"2023-03-27T10:11:02.592861+0000","last_became_peered":"2023-03-27T10:11:02.592861+0000","last_unstale":"2023-03-27T10:11:03.584951+0000","last_undegraded":"2023-03-27T10:11:03.584951+0000","last_fullsized":"2023-03-27T10:11:03.584951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:50.408069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600530+0000","last_change":"2023-03-27T10:11:02.595626+0000","last_active":"2023-03-27T10:11:02.600530+0000","last_peered":"2023-03-27T10:11:02.600530+0000","last_clean":"2023-03-27T10:11:02.600530+0000","last_became_active":"2023-03-27T10:11:02.595341+0000","last_became_peered":"2023-03-27T10:11:02.595341+0000","last_unstale":"2023-03-27T10:11:02.600530+0000","last_undegraded":"2023-03-27T10:11:02.600530+0000","last_fullsized":"2023-03-27T10:11:02.600530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:58:51.735680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608372+0000","last_change":"2023-03-27T10:11:02.604976+0000","last_active":"2023-03-27T10:11:02.608372+0000","last_peered":"2023-03-27T10:11:02.608372+0000","last_clean":"2023-03-27T10:11:02.608372+0000","last_became_active":"2023-03-27T10:11:02.604534+0000","last_became_peered":"2023-03-27T10:11:02.604534+0000","last_unstale":"2023-03-27T10:11:02.608372+0000","last_undegraded":"2023-03-27T10:11:02.608372+0000","last_fullsized":"2023-03-27T10:11:02.608372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:46:46.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.599231+0000","last_change":"2023-03-27T10:11:02.594503+0000","last_active":"2023-03-27T10:11:02.599231+0000","last_peered":"2023-03-27T10:11:02.599231+0000","last_clean":"2023-03-27T10:11:02.599231+0000","last_became_active":"2023-03-27T10:11:02.594090+0000","last_became_peered":"2023-03-27T10:11:02.594090+0000","last_unstale":"2023-03-27T10:11:02.599231+0000","last_undegraded":"2023-03-27T10:11:02.599231+0000","last_fullsized":"2023-03-27T10:11:02.599231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:50.408069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602164+0000","last_change":"2023-03-27T10:11:02.595266+0000","last_active":"2023-03-27T10:11:02.602164+0000","last_peered":"2023-03-27T10:11:02.602164+0000","last_clean":"2023-03-27T10:11:02.602164+0000","last_became_active":"2023-03-27T10:11:02.594995+0000","last_became_peered":"2023-03-27T10:11:02.594995+0000","last_unstale":"2023-03-27T10:11:02.602164+0000","last_undegraded":"2023-03-27T10:11:02.602164+0000","last_fullsized":"2023-03-27T10:11:02.602164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:56.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611015+0000","last_change":"2023-03-27T10:11:02.603858+0000","last_active":"2023-03-27T10:11:02.611015+0000","last_peered":"2023-03-27T10:11:02.611015+0000","last_clean":"2023-03-27T10:11:02.611015+0000","last_became_active":"2023-03-27T10:11:02.603600+0000","last_became_peered":"2023-03-27T10:11:02.603600+0000","last_unstale":"2023-03-27T10:11:02.611015+0000","last_undegraded":"2023-03-27T10:11:02.611015+0000","last_fullsized":"2023-03-27T10:11:02.611015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:30:21.786118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608574+0000","last_change":"2023-03-27T10:11:02.601990+0000","last_active":"2023-03-27T10:11:02.608574+0000","last_peered":"2023-03-27T10:11:02.608574+0000","last_clean":"2023-03-27T10:11:02.608574+0000","last_became_active":"2023-03-27T10:11:02.601716+0000","last_became_peered":"2023-03-27T10:11:02.601716+0000","last_unstale":"2023-03-27T10:11:02.608574+0000","last_undegraded":"2023-03-27T10:11:02.608574+0000","last_fullsized":"2023-03-27T10:11:02.608574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:15.637434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603279+0000","last_change":"2023-03-27T10:11:02.594032+0000","last_active":"2023-03-27T10:11:02.603279+0000","last_peered":"2023-03-27T10:11:02.603279+0000","last_clean":"2023-03-27T10:11:02.603279+0000","last_became_active":"2023-03-27T10:11:02.593500+0000","last_became_peered":"2023-03-27T10:11:02.593500+0000","last_unstale":"2023-03-27T10:11:02.603279+0000","last_undegraded":"2023-03-27T10:11:02.603279+0000","last_fullsized":"2023-03-27T10:11:02.603279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:06:05.348655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603748+0000","last_change":"2023-03-27T10:11:02.596983+0000","last_active":"2023-03-27T10:11:02.603748+0000","last_peered":"2023-03-27T10:11:02.603748+0000","last_clean":"2023-03-27T10:11:02.603748+0000","last_became_active":"2023-03-27T10:11:02.596733+0000","last_became_peered":"2023-03-27T10:11:02.596733+0000","last_unstale":"2023-03-27T10:11:02.603748+0000","last_undegraded":"2023-03-27T10:11:02.603748+0000","last_fullsized":"2023-03-27T10:11:02.603748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:27:27.352911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609251+0000","last_change":"2023-03-27T10:11:02.604551+0000","last_active":"2023-03-27T10:11:02.609251+0000","last_peered":"2023-03-27T10:11:02.609251+0000","last_clean":"2023-03-27T10:11:02.609251+0000","last_became_active":"2023-03-27T10:11:02.604270+0000","last_became_peered":"2023-03-27T10:11:02.604270+0000","last_unstale":"2023-03-27T10:11:02.609251+0000","last_undegraded":"2023-03-27T10:11:02.609251+0000","last_fullsized":"2023-03-27T10:11:02.609251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:41:45.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608298+0000","last_change":"2023-03-27T10:11:02.111789+0000","last_active":"2023-03-27T10:11:02.608298+0000","last_peered":"2023-03-27T10:11:02.608298+0000","last_clean":"2023-03-27T10:11:02.608298+0000","last_became_active":"2023-03-27T10:11:02.111520+0000","last_became_peered":"2023-03-27T10:11:02.111520+0000","last_unstale":"2023-03-27T10:11:02.608298+0000","last_undegraded":"2023-03-27T10:11:02.608298+0000","last_fullsized":"2023-03-27T10:11:02.608298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:02:29.503179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608382+0000","last_change":"2023-03-27T10:11:02.605653+0000","last_active":"2023-03-27T10:11:02.608382+0000","last_peered":"2023-03-27T10:11:02.608382+0000","last_clean":"2023-03-27T10:11:02.608382+0000","last_became_active":"2023-03-27T10:11:02.605369+0000","last_became_peered":"2023-03-27T10:11:02.605369+0000","last_unstale":"2023-03-27T10:11:02.608382+0000","last_undegraded":"2023-03-27T10:11:02.608382+0000","last_fullsized":"2023-03-27T10:11:02.608382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:18.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.593136+0000","last_change":"2023-03-27T10:11:02.113177+0000","last_active":"2023-03-27T10:11:02.593136+0000","last_peered":"2023-03-27T10:11:02.593136+0000","last_clean":"2023-03-27T10:11:02.593136+0000","last_became_active":"2023-03-27T10:11:02.112898+0000","last_became_peered":"2023-03-27T10:11:02.112898+0000","last_unstale":"2023-03-27T10:11:02.593136+0000","last_undegraded":"2023-03-27T10:11:02.593136+0000","last_fullsized":"2023-03-27T10:11:02.593136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:14.630929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604966+0000","last_change":"2023-03-27T10:11:02.595496+0000","last_active":"2023-03-27T10:11:02.604966+0000","last_peered":"2023-03-27T10:11:02.604966+0000","last_clean":"2023-03-27T10:11:02.604966+0000","last_became_active":"2023-03-27T10:11:02.595231+0000","last_became_peered":"2023-03-27T10:11:02.595231+0000","last_unstale":"2023-03-27T10:11:02.604966+0000","last_undegraded":"2023-03-27T10:11:02.604966+0000","last_fullsized":"2023-03-27T10:11:02.604966+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:20:23.393796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.605357+0000","last_change":"2023-03-27T10:11:02.115993+0000","last_active":"2023-03-27T10:11:02.605357+0000","last_peered":"2023-03-27T10:11:02.605357+0000","last_clean":"2023-03-27T10:11:02.605357+0000","last_became_active":"2023-03-27T10:11:02.115716+0000","last_became_peered":"2023-03-27T10:11:02.115716+0000","last_unstale":"2023-03-27T10:11:02.605357+0000","last_undegraded":"2023-03-27T10:11:02.605357+0000","last_fullsized":"2023-03-27T10:11:02.605357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:14.630929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598854+0000","last_change":"2023-03-27T10:11:02.597461+0000","last_active":"2023-03-27T10:11:02.598854+0000","last_peered":"2023-03-27T10:11:02.598854+0000","last_clean":"2023-03-27T10:11:02.598854+0000","last_became_active":"2023-03-27T10:11:02.597192+0000","last_became_peered":"2023-03-27T10:11:02.597192+0000","last_unstale":"2023-03-27T10:11:02.598854+0000","last_undegraded":"2023-03-27T10:11:02.598854+0000","last_fullsized":"2023-03-27T10:11:02.598854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:20:23.393796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604475+0000","last_change":"2023-03-27T10:11:02.110922+0000","last_active":"2023-03-27T10:11:02.604475+0000","last_peered":"2023-03-27T10:11:02.604475+0000","last_clean":"2023-03-27T10:11:02.604475+0000","last_became_active":"2023-03-27T10:11:02.110646+0000","last_became_peered":"2023-03-27T10:11:02.110646+0000","last_unstale":"2023-03-27T10:11:02.604475+0000","last_undegraded":"2023-03-27T10:11:02.604475+0000","last_fullsized":"2023-03-27T10:11:02.604475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:17.923414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600981+0000","last_change":"2023-03-27T10:11:02.596409+0000","last_active":"2023-03-27T10:11:02.600981+0000","last_peered":"2023-03-27T10:11:02.600981+0000","last_clean":"2023-03-27T10:11:02.600981+0000","last_became_active":"2023-03-27T10:11:02.596142+0000","last_became_peered":"2023-03-27T10:11:02.596142+0000","last_unstale":"2023-03-27T10:11:02.600981+0000","last_undegraded":"2023-03-27T10:11:02.600981+0000","last_fullsized":"2023-03-27T10:11:02.600981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:46:46.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609625+0000","last_change":"2023-03-27T10:11:02.114156+0000","last_active":"2023-03-27T10:11:02.609625+0000","last_peered":"2023-03-27T10:11:02.609625+0000","last_clean":"2023-03-27T10:11:02.609625+0000","last_became_active":"2023-03-27T10:11:02.113802+0000","last_became_peered":"2023-03-27T10:11:02.113802+0000","last_unstale":"2023-03-27T10:11:02.609625+0000","last_undegraded":"2023-03-27T10:11:02.609625+0000","last_fullsized":"2023-03-27T10:11:02.609625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:52:01.330209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609569+0000","last_change":"2023-03-27T10:11:02.597657+0000","last_active":"2023-03-27T10:11:02.609569+0000","last_peered":"2023-03-27T10:11:02.609569+0000","last_clean":"2023-03-27T10:11:02.609569+0000","last_became_active":"2023-03-27T10:11:02.597349+0000","last_became_peered":"2023-03-27T10:11:02.597349+0000","last_unstale":"2023-03-27T10:11:02.609569+0000","last_undegraded":"2023-03-27T10:11:02.609569+0000","last_fullsized":"2023-03-27T10:11:02.609569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:46:46.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609283+0000","last_change":"2023-03-27T10:11:02.115879+0000","last_active":"2023-03-27T10:11:02.609283+0000","last_peered":"2023-03-27T10:11:02.609283+0000","last_clean":"2023-03-27T10:11:02.609283+0000","last_became_active":"2023-03-27T10:11:02.115543+0000","last_became_peered":"2023-03-27T10:11:02.115543+0000","last_unstale":"2023-03-27T10:11:02.609283+0000","last_undegraded":"2023-03-27T10:11:02.609283+0000","last_fullsized":"2023-03-27T10:11:02.609283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:46:51.625489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604574+0000","last_change":"2023-03-27T10:11:02.592565+0000","last_active":"2023-03-27T10:11:02.604574+0000","last_peered":"2023-03-27T10:11:02.604574+0000","last_clean":"2023-03-27T10:11:02.604574+0000","last_became_active":"2023-03-27T10:11:02.592320+0000","last_became_peered":"2023-03-27T10:11:02.592320+0000","last_unstale":"2023-03-27T10:11:02.604574+0000","last_undegraded":"2023-03-27T10:11:02.604574+0000","last_fullsized":"2023-03-27T10:11:02.604574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:06:05.348655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.592479+0000","last_change":"2023-03-27T10:11:02.114979+0000","last_active":"2023-03-27T10:11:02.592479+0000","last_peered":"2023-03-27T10:11:02.592479+0000","last_clean":"2023-03-27T10:11:02.592479+0000","last_became_active":"2023-03-27T10:11:02.114728+0000","last_became_peered":"2023-03-27T10:11:02.114728+0000","last_unstale":"2023-03-27T10:11:02.592479+0000","last_undegraded":"2023-03-27T10:11:02.592479+0000","last_fullsized":"2023-03-27T10:11:02.592479+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:49.401563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600809+0000","last_change":"2023-03-27T10:11:02.598805+0000","last_active":"2023-03-27T10:11:02.600809+0000","last_peered":"2023-03-27T10:11:02.600809+0000","last_clean":"2023-03-27T10:11:02.600809+0000","last_became_active":"2023-03-27T10:11:02.598409+0000","last_became_peered":"2023-03-27T10:11:02.598409+0000","last_unstale":"2023-03-27T10:11:02.600809+0000","last_undegraded":"2023-03-27T10:11:02.600809+0000","last_fullsized":"2023-03-27T10:11:02.600809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:07:13.955220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.580593+0000","last_change":"2023-03-27T10:11:02.109414+0000","last_active":"2023-03-27T10:11:02.580593+0000","last_peered":"2023-03-27T10:11:02.580593+0000","last_clean":"2023-03-27T10:11:02.580593+0000","last_became_active":"2023-03-27T10:11:02.109134+0000","last_became_peered":"2023-03-27T10:11:02.109134+0000","last_unstale":"2023-03-27T10:11:02.580593+0000","last_undegraded":"2023-03-27T10:11:02.580593+0000","last_fullsized":"2023-03-27T10:11:02.580593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:27:26.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585259+0000","last_change":"2023-03-27T10:11:02.591808+0000","last_active":"2023-03-27T10:11:03.585259+0000","last_peered":"2023-03-27T10:11:03.585259+0000","last_clean":"2023-03-27T10:11:03.585259+0000","last_became_active":"2023-03-27T10:11:02.591539+0000","last_became_peered":"2023-03-27T10:11:02.591539+0000","last_unstale":"2023-03-27T10:11:03.585259+0000","last_undegraded":"2023-03-27T10:11:03.585259+0000","last_fullsized":"2023-03-27T10:11:03.585259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:11:06.618949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.577367+0000","last_change":"2023-03-27T10:11:02.109376+0000","last_active":"2023-03-27T10:11:02.577367+0000","last_peered":"2023-03-27T10:11:02.577367+0000","last_clean":"2023-03-27T10:11:02.577367+0000","last_became_active":"2023-03-27T10:11:02.109114+0000","last_became_peered":"2023-03-27T10:11:02.109114+0000","last_unstale":"2023-03-27T10:11:02.577367+0000","last_undegraded":"2023-03-27T10:11:02.577367+0000","last_fullsized":"2023-03-27T10:11:02.577367+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:58:01.770082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603420+0000","last_change":"2023-03-27T10:11:02.596034+0000","last_active":"2023-03-27T10:11:02.603420+0000","last_peered":"2023-03-27T10:11:02.603420+0000","last_clean":"2023-03-27T10:11:02.603420+0000","last_became_active":"2023-03-27T10:11:02.595431+0000","last_became_peered":"2023-03-27T10:11:02.595431+0000","last_unstale":"2023-03-27T10:11:02.603420+0000","last_undegraded":"2023-03-27T10:11:02.603420+0000","last_fullsized":"2023-03-27T10:11:02.603420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:06:19.061523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.582838+0000","last_change":"2023-03-27T10:11:02.114222+0000","last_active":"2023-03-27T10:11:02.582838+0000","last_peered":"2023-03-27T10:11:02.582838+0000","last_clean":"2023-03-27T10:11:02.582838+0000","last_became_active":"2023-03-27T10:11:02.113920+0000","last_became_peered":"2023-03-27T10:11:02.113920+0000","last_unstale":"2023-03-27T10:11:02.582838+0000","last_undegraded":"2023-03-27T10:11:02.582838+0000","last_fullsized":"2023-03-27T10:11:02.582838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:49.401563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598867+0000","last_change":"2023-03-27T10:11:02.593589+0000","last_active":"2023-03-27T10:11:02.598867+0000","last_peered":"2023-03-27T10:11:02.598867+0000","last_clean":"2023-03-27T10:11:02.598867+0000","last_became_active":"2023-03-27T10:11:02.593309+0000","last_became_peered":"2023-03-27T10:11:02.593309+0000","last_unstale":"2023-03-27T10:11:02.598867+0000","last_undegraded":"2023-03-27T10:11:02.598867+0000","last_fullsized":"2023-03-27T10:11:02.598867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:44:33.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609539+0000","last_change":"2023-03-27T10:11:02.113086+0000","last_active":"2023-03-27T10:11:02.609539+0000","last_peered":"2023-03-27T10:11:02.609539+0000","last_clean":"2023-03-27T10:11:02.609539+0000","last_became_active":"2023-03-27T10:11:02.112825+0000","last_became_peered":"2023-03-27T10:11:02.112825+0000","last_unstale":"2023-03-27T10:11:02.609539+0000","last_undegraded":"2023-03-27T10:11:02.609539+0000","last_fullsized":"2023-03-27T10:11:02.609539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:51.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603439+0000","last_change":"2023-03-27T10:11:02.591394+0000","last_active":"2023-03-27T10:11:02.603439+0000","last_peered":"2023-03-27T10:11:02.603439+0000","last_clean":"2023-03-27T10:11:02.603439+0000","last_became_active":"2023-03-27T10:11:02.590560+0000","last_became_peered":"2023-03-27T10:11:02.590560+0000","last_unstale":"2023-03-27T10:11:02.603439+0000","last_undegraded":"2023-03-27T10:11:02.603439+0000","last_fullsized":"2023-03-27T10:11:02.603439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:07:13.955220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611703+0000","last_change":"2023-03-27T10:11:02.114317+0000","last_active":"2023-03-27T10:11:02.611703+0000","last_peered":"2023-03-27T10:11:02.611703+0000","last_clean":"2023-03-27T10:11:02.611703+0000","last_became_active":"2023-03-27T10:11:02.114035+0000","last_became_peered":"2023-03-27T10:11:02.114035+0000","last_unstale":"2023-03-27T10:11:02.611703+0000","last_undegraded":"2023-03-27T10:11:02.611703+0000","last_fullsized":"2023-03-27T10:11:02.611703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:10:21.595177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.587221+0000","last_change":"2023-03-27T10:11:02.585208+0000","last_active":"2023-03-27T10:11:02.587221+0000","last_peered":"2023-03-27T10:11:02.587221+0000","last_clean":"2023-03-27T10:11:02.587221+0000","last_became_active":"2023-03-27T10:11:02.584961+0000","last_became_peered":"2023-03-27T10:11:02.584961+0000","last_unstale":"2023-03-27T10:11:02.587221+0000","last_undegraded":"2023-03-27T10:11:02.587221+0000","last_fullsized":"2023-03-27T10:11:02.587221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:27:27.352911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606355+0000","last_change":"2023-03-27T10:11:02.113234+0000","last_active":"2023-03-27T10:11:02.606355+0000","last_peered":"2023-03-27T10:11:02.606355+0000","last_clean":"2023-03-27T10:11:02.606355+0000","last_became_active":"2023-03-27T10:11:02.112937+0000","last_became_peered":"2023-03-27T10:11:02.112937+0000","last_unstale":"2023-03-27T10:11:02.606355+0000","last_undegraded":"2023-03-27T10:11:02.606355+0000","last_fullsized":"2023-03-27T10:11:02.606355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:32:07.276905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594688+0000","last_change":"2023-03-27T10:11:02.585357+0000","last_active":"2023-03-27T10:11:02.594688+0000","last_peered":"2023-03-27T10:11:02.594688+0000","last_clean":"2023-03-27T10:11:02.594688+0000","last_became_active":"2023-03-27T10:11:02.585093+0000","last_became_peered":"2023-03-27T10:11:02.585093+0000","last_unstale":"2023-03-27T10:11:02.594688+0000","last_undegraded":"2023-03-27T10:11:02.594688+0000","last_fullsized":"2023-03-27T10:11:02.594688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:20:18.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.592924+0000","last_change":"2023-03-27T10:11:02.114464+0000","last_active":"2023-03-27T10:11:02.592924+0000","last_peered":"2023-03-27T10:11:02.592924+0000","last_clean":"2023-03-27T10:11:02.592924+0000","last_became_active":"2023-03-27T10:11:02.114213+0000","last_became_peered":"2023-03-27T10:11:02.114213+0000","last_unstale":"2023-03-27T10:11:02.592924+0000","last_undegraded":"2023-03-27T10:11:02.592924+0000","last_fullsized":"2023-03-27T10:11:02.592924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:30:20.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.607113+0000","last_change":"2023-03-27T10:11:02.598274+0000","last_active":"2023-03-27T10:11:02.607113+0000","last_peered":"2023-03-27T10:11:02.607113+0000","last_clean":"2023-03-27T10:11:02.607113+0000","last_became_active":"2023-03-27T10:11:02.597994+0000","last_became_peered":"2023-03-27T10:11:02.597994+0000","last_unstale":"2023-03-27T10:11:02.607113+0000","last_undegraded":"2023-03-27T10:11:02.607113+0000","last_fullsized":"2023-03-27T10:11:02.607113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:07:13.955220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.589118+0000","last_change":"2023-03-27T10:11:02.105653+0000","last_active":"2023-03-27T10:11:02.589118+0000","last_peered":"2023-03-27T10:11:02.589118+0000","last_clean":"2023-03-27T10:11:02.589118+0000","last_became_active":"2023-03-27T10:11:02.105213+0000","last_became_peered":"2023-03-27T10:11:02.105213+0000","last_unstale":"2023-03-27T10:11:02.589118+0000","last_undegraded":"2023-03-27T10:11:02.589118+0000","last_fullsized":"2023-03-27T10:11:02.589118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:57:18.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594738+0000","last_change":"2023-03-27T10:11:02.584509+0000","last_active":"2023-03-27T10:11:02.594738+0000","last_peered":"2023-03-27T10:11:02.594738+0000","last_clean":"2023-03-27T10:11:02.594738+0000","last_became_active":"2023-03-27T10:11:02.584236+0000","last_became_peered":"2023-03-27T10:11:02.584236+0000","last_unstale":"2023-03-27T10:11:02.594738+0000","last_undegraded":"2023-03-27T10:11:02.594738+0000","last_fullsized":"2023-03-27T10:11:02.594738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:06:19.061523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.614289+0000","last_change":"2023-03-27T10:11:02.112350+0000","last_active":"2023-03-27T10:11:02.614289+0000","last_peered":"2023-03-27T10:11:02.614289+0000","last_clean":"2023-03-27T10:11:02.614289+0000","last_became_active":"2023-03-27T10:11:02.112068+0000","last_became_peered":"2023-03-27T10:11:02.112068+0000","last_unstale":"2023-03-27T10:11:02.614289+0000","last_undegraded":"2023-03-27T10:11:02.614289+0000","last_fullsized":"2023-03-27T10:11:02.614289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:15:06.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602823+0000","last_change":"2023-03-27T10:11:02.598515+0000","last_active":"2023-03-27T10:11:02.602823+0000","last_peered":"2023-03-27T10:11:02.602823+0000","last_clean":"2023-03-27T10:11:02.602823+0000","last_became_active":"2023-03-27T10:11:02.597845+0000","last_became_peered":"2023-03-27T10:11:02.597845+0000","last_unstale":"2023-03-27T10:11:02.602823+0000","last_undegraded":"2023-03-27T10:11:02.602823+0000","last_fullsized":"2023-03-27T10:11:02.602823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609692+0000","last_change":"2023-03-27T10:11:02.116494+0000","last_active":"2023-03-27T10:11:02.609692+0000","last_peered":"2023-03-27T10:11:02.609692+0000","last_clean":"2023-03-27T10:11:02.609692+0000","last_became_active":"2023-03-27T10:11:02.116236+0000","last_became_peered":"2023-03-27T10:11:02.116236+0000","last_unstale":"2023-03-27T10:11:02.609692+0000","last_undegraded":"2023-03-27T10:11:02.609692+0000","last_fullsized":"2023-03-27T10:11:02.609692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:30:20.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606489+0000","last_change":"2023-03-27T10:11:02.600080+0000","last_active":"2023-03-27T10:11:02.606489+0000","last_peered":"2023-03-27T10:11:02.606489+0000","last_clean":"2023-03-27T10:11:02.606489+0000","last_became_active":"2023-03-27T10:11:02.599760+0000","last_became_peered":"2023-03-27T10:11:02.599760+0000","last_unstale":"2023-03-27T10:11:02.606489+0000","last_undegraded":"2023-03-27T10:11:02.606489+0000","last_fullsized":"2023-03-27T10:11:02.606489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:00:09.866300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604893+0000","last_change":"2023-03-27T10:11:02.114934+0000","last_active":"2023-03-27T10:11:02.604893+0000","last_peered":"2023-03-27T10:11:02.604893+0000","last_clean":"2023-03-27T10:11:02.604893+0000","last_became_active":"2023-03-27T10:11:02.114671+0000","last_became_peered":"2023-03-27T10:11:02.114671+0000","last_unstale":"2023-03-27T10:11:02.604893+0000","last_undegraded":"2023-03-27T10:11:02.604893+0000","last_fullsized":"2023-03-27T10:11:02.604893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:55.280078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606024+0000","last_change":"2023-03-27T10:11:02.598905+0000","last_active":"2023-03-27T10:11:02.606024+0000","last_peered":"2023-03-27T10:11:02.606024+0000","last_clean":"2023-03-27T10:11:02.606024+0000","last_became_active":"2023-03-27T10:11:02.598608+0000","last_became_peered":"2023-03-27T10:11:02.598608+0000","last_unstale":"2023-03-27T10:11:02.606024+0000","last_undegraded":"2023-03-27T10:11:02.606024+0000","last_fullsized":"2023-03-27T10:11:02.606024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:55:17.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585297+0000","last_change":"2023-03-27T10:11:02.113132+0000","last_active":"2023-03-27T10:11:03.585297+0000","last_peered":"2023-03-27T10:11:03.585297+0000","last_clean":"2023-03-27T10:11:03.585297+0000","last_became_active":"2023-03-27T10:11:02.112871+0000","last_became_peered":"2023-03-27T10:11:02.112871+0000","last_unstale":"2023-03-27T10:11:03.585297+0000","last_undegraded":"2023-03-27T10:11:03.585297+0000","last_fullsized":"2023-03-27T10:11:03.585297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:46:00.315514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585407+0000","last_change":"2023-03-27T10:11:02.600474+0000","last_active":"2023-03-27T10:11:03.585407+0000","last_peered":"2023-03-27T10:11:03.585407+0000","last_clean":"2023-03-27T10:11:03.585407+0000","last_became_active":"2023-03-27T10:11:02.599587+0000","last_became_peered":"2023-03-27T10:11:02.599587+0000","last_unstale":"2023-03-27T10:11:03.585407+0000","last_undegraded":"2023-03-27T10:11:03.585407+0000","last_fullsized":"2023-03-27T10:11:03.585407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:52:02.336715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.592593+0000","last_change":"2023-03-27T10:11:02.112179+0000","last_active":"2023-03-27T10:11:02.592593+0000","last_peered":"2023-03-27T10:11:02.592593+0000","last_clean":"2023-03-27T10:11:02.592593+0000","last_became_active":"2023-03-27T10:11:02.111914+0000","last_became_peered":"2023-03-27T10:11:02.111914+0000","last_unstale":"2023-03-27T10:11:02.592593+0000","last_undegraded":"2023-03-27T10:11:02.592593+0000","last_fullsized":"2023-03-27T10:11:02.592593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:30:33.342769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.599545+0000","last_change":"2023-03-27T10:11:02.592253+0000","last_active":"2023-03-27T10:11:02.599545+0000","last_peered":"2023-03-27T10:11:02.599545+0000","last_clean":"2023-03-27T10:11:02.599545+0000","last_became_active":"2023-03-27T10:11:02.591878+0000","last_became_peered":"2023-03-27T10:11:02.591878+0000","last_unstale":"2023-03-27T10:11:02.599545+0000","last_undegraded":"2023-03-27T10:11:02.599545+0000","last_fullsized":"2023-03-27T10:11:02.599545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:09:37.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585135+0000","last_change":"2023-03-27T10:11:02.114739+0000","last_active":"2023-03-27T10:11:03.585135+0000","last_peered":"2023-03-27T10:11:03.585135+0000","last_clean":"2023-03-27T10:11:03.585135+0000","last_became_active":"2023-03-27T10:11:02.114473+0000","last_became_peered":"2023-03-27T10:11:02.114473+0000","last_unstale":"2023-03-27T10:11:03.585135+0000","last_undegraded":"2023-03-27T10:11:03.585135+0000","last_fullsized":"2023-03-27T10:11:03.585135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:04:36.000048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597614+0000","last_change":"2023-03-27T10:11:02.594135+0000","last_active":"2023-03-27T10:11:02.597614+0000","last_peered":"2023-03-27T10:11:02.597614+0000","last_clean":"2023-03-27T10:11:02.597614+0000","last_became_active":"2023-03-27T10:11:02.593872+0000","last_became_peered":"2023-03-27T10:11:02.593872+0000","last_unstale":"2023-03-27T10:11:02.597614+0000","last_undegraded":"2023-03-27T10:11:02.597614+0000","last_fullsized":"2023-03-27T10:11:02.597614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:10:22.601682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585086+0000","last_change":"2023-03-27T10:11:02.110681+0000","last_active":"2023-03-27T10:11:03.585086+0000","last_peered":"2023-03-27T10:11:03.585086+0000","last_clean":"2023-03-27T10:11:03.585086+0000","last_became_active":"2023-03-27T10:11:02.110349+0000","last_became_peered":"2023-03-27T10:11:02.110349+0000","last_unstale":"2023-03-27T10:11:03.585086+0000","last_undegraded":"2023-03-27T10:11:03.585086+0000","last_fullsized":"2023-03-27T10:11:03.585086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:48:27.220025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606479+0000","last_change":"2023-03-27T10:11:02.597154+0000","last_active":"2023-03-27T10:11:02.606479+0000","last_peered":"2023-03-27T10:11:02.606479+0000","last_clean":"2023-03-27T10:11:02.606479+0000","last_became_active":"2023-03-27T10:11:02.596883+0000","last_became_peered":"2023-03-27T10:11:02.596883+0000","last_unstale":"2023-03-27T10:11:02.606479+0000","last_undegraded":"2023-03-27T10:11:02.606479+0000","last_fullsized":"2023-03-27T10:11:02.606479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:18.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.587964+0000","last_change":"2023-03-27T10:11:02.113021+0000","last_active":"2023-03-27T10:11:02.587964+0000","last_peered":"2023-03-27T10:11:02.587964+0000","last_clean":"2023-03-27T10:11:02.587964+0000","last_became_active":"2023-03-27T10:11:02.112757+0000","last_became_peered":"2023-03-27T10:11:02.112757+0000","last_unstale":"2023-03-27T10:11:02.587964+0000","last_undegraded":"2023-03-27T10:11:02.587964+0000","last_fullsized":"2023-03-27T10:11:02.587964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:10:21.595177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600790+0000","last_change":"2023-03-27T10:11:02.598651+0000","last_active":"2023-03-27T10:11:02.600790+0000","last_peered":"2023-03-27T10:11:02.600790+0000","last_clean":"2023-03-27T10:11:02.600790+0000","last_became_active":"2023-03-27T10:11:02.598094+0000","last_became_peered":"2023-03-27T10:11:02.598094+0000","last_unstale":"2023-03-27T10:11:02.600790+0000","last_undegraded":"2023-03-27T10:11:02.600790+0000","last_fullsized":"2023-03-27T10:11:02.600790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:55:17.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.584947+0000","last_change":"2023-03-27T10:11:02.114306+0000","last_active":"2023-03-27T10:11:03.584947+0000","last_peered":"2023-03-27T10:11:03.584947+0000","last_clean":"2023-03-27T10:11:03.584947+0000","last_became_active":"2023-03-27T10:11:02.114053+0000","last_became_peered":"2023-03-27T10:11:02.114053+0000","last_unstale":"2023-03-27T10:11:03.584947+0000","last_undegraded":"2023-03-27T10:11:03.584947+0000","last_fullsized":"2023-03-27T10:11:03.584947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:59:30.011362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594053+0000","last_change":"2023-03-27T10:11:02.591092+0000","last_active":"2023-03-27T10:11:02.594053+0000","last_peered":"2023-03-27T10:11:02.594053+0000","last_clean":"2023-03-27T10:11:02.594053+0000","last_became_active":"2023-03-27T10:11:02.590565+0000","last_became_peered":"2023-03-27T10:11:02.590565+0000","last_unstale":"2023-03-27T10:11:02.594053+0000","last_undegraded":"2023-03-27T10:11:02.594053+0000","last_fullsized":"2023-03-27T10:11:02.594053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:56.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.581039+0000","last_change":"2023-03-27T10:11:02.114525+0000","last_active":"2023-03-27T10:11:02.581039+0000","last_peered":"2023-03-27T10:11:02.581039+0000","last_clean":"2023-03-27T10:11:02.581039+0000","last_became_active":"2023-03-27T10:11:02.113867+0000","last_became_peered":"2023-03-27T10:11:02.113867+0000","last_unstale":"2023-03-27T10:11:02.581039+0000","last_undegraded":"2023-03-27T10:11:02.581039+0000","last_fullsized":"2023-03-27T10:11:02.581039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:52:01.330209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.104682+0000","last_change":"2023-03-27T10:09:46.107098+0000","last_active":"2023-03-27T10:11:02.104682+0000","last_peered":"2023-03-27T10:11:02.104682+0000","last_clean":"2023-03-27T10:11:02.104682+0000","last_became_active":"2023-03-27T10:09:46.106831+0000","last_became_peered":"2023-03-27T10:09:46.106831+0000","last_unstale":"2023-03-27T10:11:02.104682+0000","last_undegraded":"2023-03-27T10:11:02.104682+0000","last_fullsized":"2023-03-27T10:11:02.104682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597608+0000","last_change":"2023-03-27T10:11:02.584755+0000","last_active":"2023-03-27T10:11:02.597608+0000","last_peered":"2023-03-27T10:11:02.597608+0000","last_clean":"2023-03-27T10:11:02.597608+0000","last_became_active":"2023-03-27T10:11:02.584440+0000","last_became_peered":"2023-03-27T10:11:02.584440+0000","last_unstale":"2023-03-27T10:11:02.597608+0000","last_undegraded":"2023-03-27T10:11:02.597608+0000","last_fullsized":"2023-03-27T10:11:02.597608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:09:37.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.580138+0000","last_change":"2023-03-27T10:11:02.112948+0000","last_active":"2023-03-27T10:11:02.580138+0000","last_peered":"2023-03-27T10:11:02.580138+0000","last_clean":"2023-03-27T10:11:02.580138+0000","last_became_active":"2023-03-27T10:11:02.112706+0000","last_became_peered":"2023-03-27T10:11:02.112706+0000","last_unstale":"2023-03-27T10:11:02.580138+0000","last_undegraded":"2023-03-27T10:11:02.580138+0000","last_fullsized":"2023-03-27T10:11:02.580138+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:51.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.109516+0000","last_change":"2023-03-27T10:09:46.107305+0000","last_active":"2023-03-27T10:11:02.109516+0000","last_peered":"2023-03-27T10:11:02.109516+0000","last_clean":"2023-03-27T10:11:02.109516+0000","last_became_active":"2023-03-27T10:09:46.107038+0000","last_became_peered":"2023-03-27T10:09:46.107038+0000","last_unstale":"2023-03-27T10:11:02.109516+0000","last_undegraded":"2023-03-27T10:11:02.109516+0000","last_fullsized":"2023-03-27T10:11:02.109516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.607366+0000","last_change":"2023-03-27T10:11:02.596219+0000","last_active":"2023-03-27T10:11:02.607366+0000","last_peered":"2023-03-27T10:11:02.607366+0000","last_clean":"2023-03-27T10:11:02.607366+0000","last_became_active":"2023-03-27T10:11:02.595766+0000","last_became_peered":"2023-03-27T10:11:02.595766+0000","last_unstale":"2023-03-27T10:11:02.607366+0000","last_undegraded":"2023-03-27T10:11:02.607366+0000","last_fullsized":"2023-03-27T10:11:02.607366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:20:23.393796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585316+0000","last_change":"2023-03-27T10:11:02.114314+0000","last_active":"2023-03-27T10:11:03.585316+0000","last_peered":"2023-03-27T10:11:03.585316+0000","last_clean":"2023-03-27T10:11:03.585316+0000","last_became_active":"2023-03-27T10:11:02.113990+0000","last_became_peered":"2023-03-27T10:11:02.113990+0000","last_unstale":"2023-03-27T10:11:03.585316+0000","last_undegraded":"2023-03-27T10:11:03.585316+0000","last_fullsized":"2023-03-27T10:11:03.585316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:08:56.852064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.582661+0000","last_change":"2023-03-27T10:09:46.326263+0000","last_active":"2023-03-27T10:11:02.582661+0000","last_peered":"2023-03-27T10:11:02.582661+0000","last_clean":"2023-03-27T10:11:02.582661+0000","last_became_active":"2023-03-27T10:09:46.325963+0000","last_became_peered":"2023-03-27T10:09:46.325963+0000","last_unstale":"2023-03-27T10:11:02.582661+0000","last_undegraded":"2023-03-27T10:11:02.582661+0000","last_fullsized":"2023-03-27T10:11:02.582661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598399+0000","last_change":"2023-03-27T10:11:02.590021+0000","last_active":"2023-03-27T10:11:02.598399+0000","last_peered":"2023-03-27T10:11:02.598399+0000","last_clean":"2023-03-27T10:11:02.598399+0000","last_became_active":"2023-03-27T10:11:02.589696+0000","last_became_peered":"2023-03-27T10:11:02.589696+0000","last_unstale":"2023-03-27T10:11:02.598399+0000","last_undegraded":"2023-03-27T10:11:02.598399+0000","last_fullsized":"2023-03-27T10:11:02.598399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:13:52.060979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.585510+0000","last_change":"2023-03-27T10:11:02.113028+0000","last_active":"2023-03-27T10:11:02.585510+0000","last_peered":"2023-03-27T10:11:02.585510+0000","last_clean":"2023-03-27T10:11:02.585510+0000","last_became_active":"2023-03-27T10:11:02.112674+0000","last_became_peered":"2023-03-27T10:11:02.112674+0000","last_unstale":"2023-03-27T10:11:02.585510+0000","last_undegraded":"2023-03-27T10:11:02.585510+0000","last_fullsized":"2023-03-27T10:11:02.585510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:44:32.578752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.111623+0000","last_change":"2023-03-27T10:09:46.106690+0000","last_active":"2023-03-27T10:11:02.111623+0000","last_peered":"2023-03-27T10:11:02.111623+0000","last_clean":"2023-03-27T10:11:02.111623+0000","last_became_active":"2023-03-27T10:09:46.106393+0000","last_became_peered":"2023-03-27T10:09:46.106393+0000","last_unstale":"2023-03-27T10:11:02.111623+0000","last_undegraded":"2023-03-27T10:11:02.111623+0000","last_fullsized":"2023-03-27T10:11:02.111623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.102113+0000","last_change":"2023-03-27T10:09:40.691310+0000","last_active":"2023-03-27T10:11:02.102113+0000","last_peered":"2023-03-27T10:11:02.102113+0000","last_clean":"2023-03-27T10:11:02.102113+0000","last_became_active":"2023-03-27T10:09:40.690248+0000","last_became_peered":"2023-03-27T10:09:40.690248+0000","last_unstale":"2023-03-27T10:11:02.102113+0000","last_undegraded":"2023-03-27T10:11:02.102113+0000","last_fullsized":"2023-03-27T10:11:02.102113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_clean_scrub_stamp":"2023-03-27T10:09:39.335229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:58:29.036302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608355+0000","last_change":"2023-03-27T10:11:02.604511+0000","last_active":"2023-03-27T10:11:02.608355+0000","last_peered":"2023-03-27T10:11:02.608355+0000","last_clean":"2023-03-27T10:11:02.608355+0000","last_became_active":"2023-03-27T10:11:02.604234+0000","last_became_peered":"2023-03-27T10:11:02.604234+0000","last_unstale":"2023-03-27T10:11:02.608355+0000","last_undegraded":"2023-03-27T10:11:02.608355+0000","last_fullsized":"2023-03-27T10:11:02.608355+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:56.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608969+0000","last_change":"2023-03-27T10:11:02.118691+0000","last_active":"2023-03-27T10:11:02.608969+0000","last_peered":"2023-03-27T10:11:02.608969+0000","last_clean":"2023-03-27T10:11:02.608969+0000","last_became_active":"2023-03-27T10:11:02.118500+0000","last_became_peered":"2023-03-27T10:11:02.118500+0000","last_unstale":"2023-03-27T10:11:02.608969+0000","last_undegraded":"2023-03-27T10:11:02.608969+0000","last_fullsized":"2023-03-27T10:11:02.608969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:30:33.342769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.102251+0000","last_change":"2023-03-27T10:09:46.108163+0000","last_active":"2023-03-27T10:11:02.102251+0000","last_peered":"2023-03-27T10:11:02.102251+0000","last_clean":"2023-03-27T10:11:02.102251+0000","last_became_active":"2023-03-27T10:09:46.107807+0000","last_became_peered":"2023-03-27T10:09:46.107807+0000","last_unstale":"2023-03-27T10:11:02.102251+0000","last_undegraded":"2023-03-27T10:11:02.102251+0000","last_fullsized":"2023-03-27T10:11:02.102251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603224+0000","last_change":"2023-03-27T10:11:02.596118+0000","last_active":"2023-03-27T10:11:02.603224+0000","last_peered":"2023-03-27T10:11:02.603224+0000","last_clean":"2023-03-27T10:11:02.603224+0000","last_became_active":"2023-03-27T10:11:02.595611+0000","last_became_peered":"2023-03-27T10:11:02.595611+0000","last_unstale":"2023-03-27T10:11:02.603224+0000","last_undegraded":"2023-03-27T10:11:02.603224+0000","last_fullsized":"2023-03-27T10:11:02.603224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:53:11.976085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.588260+0000","last_change":"2023-03-27T10:11:02.113875+0000","last_active":"2023-03-27T10:11:02.588260+0000","last_peered":"2023-03-27T10:11:02.588260+0000","last_clean":"2023-03-27T10:11:02.588260+0000","last_became_active":"2023-03-27T10:11:02.113523+0000","last_became_peered":"2023-03-27T10:11:02.113523+0000","last_unstale":"2023-03-27T10:11:02.588260+0000","last_undegraded":"2023-03-27T10:11:02.588260+0000","last_fullsized":"2023-03-27T10:11:02.588260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:52:53.616013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.105173+0000","last_change":"2023-03-27T10:09:46.107100+0000","last_active":"2023-03-27T10:11:02.105173+0000","last_peered":"2023-03-27T10:11:02.105173+0000","last_clean":"2023-03-27T10:11:02.105173+0000","last_became_active":"2023-03-27T10:09:46.106766+0000","last_became_peered":"2023-03-27T10:09:46.106766+0000","last_unstale":"2023-03-27T10:11:02.105173+0000","last_undegraded":"2023-03-27T10:11:02.105173+0000","last_fullsized":"2023-03-27T10:11:02.105173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:44:01.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606719+0000","last_change":"2023-03-27T10:11:02.599357+0000","last_active":"2023-03-27T10:11:02.606719+0000","last_peered":"2023-03-27T10:11:02.606719+0000","last_clean":"2023-03-27T10:11:02.606719+0000","last_became_active":"2023-03-27T10:11:02.599041+0000","last_became_peered":"2023-03-27T10:11:02.599041+0000","last_unstale":"2023-03-27T10:11:02.606719+0000","last_undegraded":"2023-03-27T10:11:02.606719+0000","last_fullsized":"2023-03-27T10:11:02.606719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:06:19.061523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.581739+0000","last_change":"2023-03-27T10:11:02.110351+0000","last_active":"2023-03-27T10:11:02.581739+0000","last_peered":"2023-03-27T10:11:02.581739+0000","last_clean":"2023-03-27T10:11:02.581739+0000","last_became_active":"2023-03-27T10:11:02.110094+0000","last_became_peered":"2023-03-27T10:11:02.110094+0000","last_unstale":"2023-03-27T10:11:02.581739+0000","last_undegraded":"2023-03-27T10:11:02.581739+0000","last_fullsized":"2023-03-27T10:11:02.581739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:53:10.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.105347+0000","last_change":"2023-03-27T10:09:46.108779+0000","last_active":"2023-03-27T10:11:02.105347+0000","last_peered":"2023-03-27T10:11:02.105347+0000","last_clean":"2023-03-27T10:11:02.105347+0000","last_became_active":"2023-03-27T10:09:46.108307+0000","last_became_peered":"2023-03-27T10:09:46.108307+0000","last_unstale":"2023-03-27T10:11:02.105347+0000","last_undegraded":"2023-03-27T10:11:02.105347+0000","last_fullsized":"2023-03-27T10:11:02.105347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603244+0000","last_change":"2023-03-27T10:11:02.596101+0000","last_active":"2023-03-27T10:11:02.603244+0000","last_peered":"2023-03-27T10:11:02.603244+0000","last_clean":"2023-03-27T10:11:02.603244+0000","last_became_active":"2023-03-27T10:11:02.595825+0000","last_became_peered":"2023-03-27T10:11:02.595825+0000","last_unstale":"2023-03-27T10:11:02.603244+0000","last_undegraded":"2023-03-27T10:11:02.603244+0000","last_fullsized":"2023-03-27T10:11:02.603244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:20:18.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.575275+0000","last_change":"2023-03-27T10:11:02.110788+0000","last_active":"2023-03-27T10:11:02.575275+0000","last_peered":"2023-03-27T10:11:02.575275+0000","last_clean":"2023-03-27T10:11:02.575275+0000","last_became_active":"2023-03-27T10:11:02.110510+0000","last_became_peered":"2023-03-27T10:11:02.110510+0000","last_unstale":"2023-03-27T10:11:02.575275+0000","last_undegraded":"2023-03-27T10:11:02.575275+0000","last_fullsized":"2023-03-27T10:11:02.575275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:42:09.406356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.099461+0000","last_change":"2023-03-27T10:09:46.108791+0000","last_active":"2023-03-27T10:11:02.099461+0000","last_peered":"2023-03-27T10:11:02.099461+0000","last_clean":"2023-03-27T10:11:02.099461+0000","last_became_active":"2023-03-27T10:09:46.108203+0000","last_became_peered":"2023-03-27T10:09:46.108203+0000","last_unstale":"2023-03-27T10:11:02.099461+0000","last_undegraded":"2023-03-27T10:11:02.099461+0000","last_fullsized":"2023-03-27T10:11:02.099461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":438272,"data_stored":179837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.379},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.92300000000000004}]},{"osd":5,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.872}]},{"osd":7,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88800000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9500,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362340,"statfs":{"total":96636764160,"available":96627036160,"internally_reserved":0,"allocated":1003520,"data_stored":756354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.72099999999999997}]},{"osd":2,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":6.351,"5min":6.351,"15min":6.351},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48699999999999999}]},{"osd":6,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.5},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":173204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.316},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.38}]},{"osd":2,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.498},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.62}]},{"osd":6,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9436,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362404,"statfs":{"total":96636764160,"available":96627101696,"internally_reserved":0,"allocated":1003520,"data_stored":756354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.495}]},{"osd":3,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.9430000000000001,"5min":2.9430000000000001,"15min":2.9430000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.80600000000000005}]},{"osd":5,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95999999999999996}]},{"osd":6,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.749}]},{"osd":7,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":174696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.626},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.67800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":430080,"data_stored":173702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8492,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363348,"statfs":{"total":96636764160,"available":96628068352,"internally_reserved":0,"allocated":430080,"data_stored":173226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.157,"5min":12.157,"15min":12.157},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.749}]},{"osd":3,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.72599999999999998}]},{"osd":4,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.78000000000000003}]},{"osd":7,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":425984,"data_stored":173680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53200000000000003}]},{"osd":1,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.55600000000000005}]},{"osd":3,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-27T10:11:06.910 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-27T10:11:07.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.125+0000 7f1755fff700 1 Processor -- start 2023-03-27T10:11:07.125 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.126+0000 7f1755fff700 1 -- start start 2023-03-27T10:11:07.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1755fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f175015ca20 0x7f17500ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.126 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1755fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500cd610 0x7f17500b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1755fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17500cebc0 con 0x7f17500d0b90 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1755fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500ceea0 con 0x7f175015ca20 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1755fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500cf180 con 0x7f17500cd610 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1747fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f175015ca20 0x7f17500ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f174f7fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f17500d0b90 0x7f17500d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60618/0 (socket says 172.21.15.172:60618) 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f174f7fe700 1 -- 172.21.15.172:0/1288769937 learned_addr learned my addr 172.21.15.172:0/1288769937 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:07.127 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f174ffff700 1 --2- 172.21.15.172:0/1288769937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500cd610 0x7f17500b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1747fff700 1 -- 172.21.15.172:0/1288769937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500cd610 msgr2=0x7f17500b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1747fff700 1 --2- 172.21.15.172:0/1288769937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500cd610 0x7f17500b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.127+0000 7f1747fff700 1 -- 172.21.15.172:0/1288769937 >> v1:172.21.15.172:6789/0 conn(0x7f17500d0b90 legacy=0x7f17500d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.128+0000 7f1747fff700 1 -- 172.21.15.172:0/1288769937 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500cf460 con 0x7f175015ca20 2023-03-27T10:11:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.128+0000 7f1747fff700 1 --2- 172.21.15.172:0/1288769937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f175015ca20 0x7f17500ce500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1738009840 tx=0x7f1738009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67716377ecaedb0a server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.128+0000 7f174effd700 1 -- 172.21.15.172:0/1288769937 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738011830 con 0x7f175015ca20 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.128+0000 7f174effd700 1 -- 172.21.15.172:0/1288769937 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1738011990 con 0x7f175015ca20 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.128+0000 7f174effd700 1 -- 172.21.15.172:0/1288769937 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738011d20 con 0x7f175015ca20 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 -- 172.21.15.172:0/1288769937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f175015ca20 msgr2=0x7f17500ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 --2- 172.21.15.172:0/1288769937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f175015ca20 0x7f17500ce500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1738009840 tx=0x7f1738009b50 comp rx=0 tx=0).stop 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 -- 172.21.15.172:0/1288769937 shutdown_connections 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 --2- 172.21.15.172:0/1288769937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500cd610 0x7f17500b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.130 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 --2- 172.21.15.172:0/1288769937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f175015ca20 0x7f17500ce500 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 -- 172.21.15.172:0/1288769937 >> 172.21.15.172:0/1288769937 conn(0x7f17500721f0 msgr2=0x7f175009c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:07.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 -- 172.21.15.172:0/1288769937 shutdown_connections 2023-03-27T10:11:07.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.129+0000 7f1755fff700 1 -- 172.21.15.172:0/1288769937 wait complete. 2023-03-27T10:11:07.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.131+0000 7f1755fff700 1 Processor -- start 2023-03-27T10:11:07.131 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.131+0000 7f1755fff700 1 -- start start 2023-03-27T10:11:07.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1755fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 0x7f17500b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1755fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500d0b90 0x7f17500cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.133 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1755fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f175015ca20 0x7f1750159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1755fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500b7b70 con 0x7f17500cd610 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1755fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501572b0 con 0x7f175015ca20 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1755fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1750157590 con 0x7f17500d0b90 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 0x7f17500b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 0x7f17500b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45908/0 (socket says 172.21.15.172:45908) 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 -- 172.21.15.172:0/2609926453 learned_addr learned my addr 172.21.15.172:0/2609926453 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f1747fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500d0b90 0x7f17500cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.134 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174ffff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f175015ca20 0x7f1750159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 -- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500d0b90 msgr2=0x7f17500cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500d0b90 0x7f17500cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 -- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f175015ca20 msgr2=0x7f1750159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f175015ca20 0x7f1750159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.133+0000 7f174f7fe700 1 -- 172.21.15.172:0/2609926453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380094a0 con 0x7f17500cd610 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.134+0000 7f174f7fe700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 0x7f17500b85f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f174000c700 tx=0x7f174000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:07.135 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.134+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400074e0 con 0x7f17500cd610 2023-03-27T10:11:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.134+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740007640 con 0x7f17500cd610 2023-03-27T10:11:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.134+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17500d2d30 con 0x7f17500cd610 2023-03-27T10:11:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.134+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740005a30 con 0x7f17500cd610 2023-03-27T10:11:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.134+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17500afc50 con 0x7f17500cd610 2023-03-27T10:11:07.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.135+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17500b06b0 con 0x7f17500cd610 2023-03-27T10:11:07.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.136+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f1740019030 con 0x7f17500cd610 2023-03-27T10:11:07.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.137+0000 7f174cff9700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1730066e30 0x7f17300692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.137+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1740083420 con 0x7f17500cd610 2023-03-27T10:11:07.137 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.137+0000 7f1747fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1730066e30 0x7f17300692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.138 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.138+0000 7f1747fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1730066e30 0x7f17300692e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1738000c00 tx=0x7f1738008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:07.140 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.141+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f174004b4f0 con 0x7f17500cd610 2023-03-27T10:11:07.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.325+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 --> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1750157700 con 0x7f1730066e30 2023-03-27T10:11:07.334 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.335+0000 7f174cff9700 1 -- 172.21.15.172:0/2609926453 <== mgr.4100 v2:172.21.15.191:6832/109700 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310874 (secure 0 0 0) 0x7f1750157700 con 0x7f1730066e30 2023-03-27T10:11:07.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1730066e30 msgr2=0x7f17300692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1730066e30 0x7f17300692e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1738000c00 tx=0x7f1738008030 comp rx=0 tx=0).stop 2023-03-27T10:11:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 msgr2=0x7f17500b85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 0x7f17500b85f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f174000c700 tx=0x7f174000ca10 comp rx=0 tx=0).stop 2023-03-27T10:11:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 shutdown_connections 2023-03-27T10:11:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f1730066e30 0x7f17300692e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f175015ca20 0x7f1750159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17500cd610 0x7f17500b85f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 --2- 172.21.15.172:0/2609926453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17500d0b90 0x7f17500cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 >> 172.21.15.172:0/2609926453 conn(0x7f17500721f0 msgr2=0x7f17500d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:07.345 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 shutdown_connections 2023-03-27T10:11:07.346 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.339+0000 7f1755fff700 1 -- 172.21.15.172:0/2609926453 wait complete. 2023-03-27T10:11:07.346 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-03-27T10:11:07.356 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-03-27T10:11:07.294524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69832,"kb_used_data":4488,"kb_used_omap":0,"kb_used_meta":65280,"kb_avail":754904888,"statfs":{"total":773094113280,"available":773022605312,"internally_reserved":0,"allocated":4595712,"data_stored":2561053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66846720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594939+0000","last_change":"2023-03-27T10:11:02.585696+0000","last_active":"2023-03-27T10:11:02.594939+0000","last_peered":"2023-03-27T10:11:02.594939+0000","last_clean":"2023-03-27T10:11:02.594939+0000","last_became_active":"2023-03-27T10:11:02.585452+0000","last_became_peered":"2023-03-27T10:11:02.585452+0000","last_unstale":"2023-03-27T10:11:02.594939+0000","last_undegraded":"2023-03-27T10:11:02.594939+0000","last_fullsized":"2023-03-27T10:11:02.594939+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:41:45.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597624+0000","last_change":"2023-03-27T10:11:02.587288+0000","last_active":"2023-03-27T10:11:02.597624+0000","last_peered":"2023-03-27T10:11:02.597624+0000","last_clean":"2023-03-27T10:11:02.597624+0000","last_became_active":"2023-03-27T10:11:02.586999+0000","last_became_peered":"2023-03-27T10:11:02.586999+0000","last_unstale":"2023-03-27T10:11:02.597624+0000","last_undegraded":"2023-03-27T10:11:02.597624+0000","last_fullsized":"2023-03-27T10:11:02.597624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:00:09.866300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603437+0000","last_change":"2023-03-27T10:11:02.601277+0000","last_active":"2023-03-27T10:11:02.603437+0000","last_peered":"2023-03-27T10:11:02.603437+0000","last_clean":"2023-03-27T10:11:02.603437+0000","last_became_active":"2023-03-27T10:11:02.600992+0000","last_became_peered":"2023-03-27T10:11:02.600992+0000","last_unstale":"2023-03-27T10:11:02.603437+0000","last_undegraded":"2023-03-27T10:11:02.603437+0000","last_fullsized":"2023-03-27T10:11:02.603437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:53:11.976085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585272+0000","last_change":"2023-03-27T10:11:02.594058+0000","last_active":"2023-03-27T10:11:03.585272+0000","last_peered":"2023-03-27T10:11:03.585272+0000","last_clean":"2023-03-27T10:11:03.585272+0000","last_became_active":"2023-03-27T10:11:02.593788+0000","last_became_peered":"2023-03-27T10:11:02.593788+0000","last_unstale":"2023-03-27T10:11:03.585272+0000","last_undegraded":"2023-03-27T10:11:03.585272+0000","last_fullsized":"2023-03-27T10:11:03.585272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:35:35.826629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585134+0000","last_change":"2023-03-27T10:11:02.587715+0000","last_active":"2023-03-27T10:11:03.585134+0000","last_peered":"2023-03-27T10:11:03.585134+0000","last_clean":"2023-03-27T10:11:03.585134+0000","last_became_active":"2023-03-27T10:11:02.587435+0000","last_became_peered":"2023-03-27T10:11:02.587435+0000","last_unstale":"2023-03-27T10:11:03.585134+0000","last_undegraded":"2023-03-27T10:11:03.585134+0000","last_fullsized":"2023-03-27T10:11:03.585134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:52.645620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606386+0000","last_change":"2023-03-27T10:11:02.602250+0000","last_active":"2023-03-27T10:11:02.606386+0000","last_peered":"2023-03-27T10:11:02.606386+0000","last_clean":"2023-03-27T10:11:02.606386+0000","last_became_active":"2023-03-27T10:11:02.601972+0000","last_became_peered":"2023-03-27T10:11:02.601972+0000","last_unstale":"2023-03-27T10:11:02.606386+0000","last_undegraded":"2023-03-27T10:11:02.606386+0000","last_fullsized":"2023-03-27T10:11:02.606386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:49:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598082+0000","last_change":"2023-03-27T10:11:02.589339+0000","last_active":"2023-03-27T10:11:02.598082+0000","last_peered":"2023-03-27T10:11:02.598082+0000","last_clean":"2023-03-27T10:11:02.598082+0000","last_became_active":"2023-03-27T10:11:02.588923+0000","last_became_peered":"2023-03-27T10:11:02.588923+0000","last_unstale":"2023-03-27T10:11:02.598082+0000","last_undegraded":"2023-03-27T10:11:02.598082+0000","last_fullsized":"2023-03-27T10:11:02.598082+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:28:39.436788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.595410+0000","last_change":"2023-03-27T10:11:02.586554+0000","last_active":"2023-03-27T10:11:02.595410+0000","last_peered":"2023-03-27T10:11:02.595410+0000","last_clean":"2023-03-27T10:11:02.595410+0000","last_became_active":"2023-03-27T10:11:02.586291+0000","last_became_peered":"2023-03-27T10:11:02.586291+0000","last_unstale":"2023-03-27T10:11:02.595410+0000","last_undegraded":"2023-03-27T10:11:02.595410+0000","last_fullsized":"2023-03-27T10:11:02.595410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:28:39.436788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597519+0000","last_change":"2023-03-27T10:11:02.591897+0000","last_active":"2023-03-27T10:11:02.597519+0000","last_peered":"2023-03-27T10:11:02.597519+0000","last_clean":"2023-03-27T10:11:02.597519+0000","last_became_active":"2023-03-27T10:11:02.591638+0000","last_became_peered":"2023-03-27T10:11:02.591638+0000","last_unstale":"2023-03-27T10:11:02.597519+0000","last_undegraded":"2023-03-27T10:11:02.597519+0000","last_fullsized":"2023-03-27T10:11:02.597519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:49:19.692095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602473+0000","last_change":"2023-03-27T10:11:02.594631+0000","last_active":"2023-03-27T10:11:02.602473+0000","last_peered":"2023-03-27T10:11:02.602473+0000","last_clean":"2023-03-27T10:11:02.602473+0000","last_became_active":"2023-03-27T10:11:02.594203+0000","last_became_peered":"2023-03-27T10:11:02.594203+0000","last_unstale":"2023-03-27T10:11:02.602473+0000","last_undegraded":"2023-03-27T10:11:02.602473+0000","last_fullsized":"2023-03-27T10:11:02.602473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:41:45.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606454+0000","last_change":"2023-03-27T10:11:02.597483+0000","last_active":"2023-03-27T10:11:02.606454+0000","last_peered":"2023-03-27T10:11:02.606454+0000","last_clean":"2023-03-27T10:11:02.606454+0000","last_became_active":"2023-03-27T10:11:02.597143+0000","last_became_peered":"2023-03-27T10:11:02.597143+0000","last_unstale":"2023-03-27T10:11:02.606454+0000","last_undegraded":"2023-03-27T10:11:02.606454+0000","last_fullsized":"2023-03-27T10:11:02.606454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:20:18.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.591544+0000","last_change":"2023-03-27T10:11:02.587871+0000","last_active":"2023-03-27T10:11:02.591544+0000","last_peered":"2023-03-27T10:11:02.591544+0000","last_clean":"2023-03-27T10:11:02.591544+0000","last_became_active":"2023-03-27T10:11:02.586997+0000","last_became_peered":"2023-03-27T10:11:02.586997+0000","last_unstale":"2023-03-27T10:11:02.591544+0000","last_undegraded":"2023-03-27T10:11:02.591544+0000","last_fullsized":"2023-03-27T10:11:02.591544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:18.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602620+0000","last_change":"2023-03-27T10:11:02.593892+0000","last_active":"2023-03-27T10:11:02.602620+0000","last_peered":"2023-03-27T10:11:02.602620+0000","last_clean":"2023-03-27T10:11:02.602620+0000","last_became_active":"2023-03-27T10:11:02.593507+0000","last_became_peered":"2023-03-27T10:11:02.593507+0000","last_unstale":"2023-03-27T10:11:02.602620+0000","last_undegraded":"2023-03-27T10:11:02.602620+0000","last_fullsized":"2023-03-27T10:11:02.602620+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604594+0000","last_change":"2023-03-27T10:11:02.595635+0000","last_active":"2023-03-27T10:11:02.604594+0000","last_peered":"2023-03-27T10:11:02.604594+0000","last_clean":"2023-03-27T10:11:02.604594+0000","last_became_active":"2023-03-27T10:11:02.595278+0000","last_became_peered":"2023-03-27T10:11:02.595278+0000","last_unstale":"2023-03-27T10:11:02.604594+0000","last_undegraded":"2023-03-27T10:11:02.604594+0000","last_fullsized":"2023-03-27T10:11:02.604594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598055+0000","last_change":"2023-03-27T10:11:02.589171+0000","last_active":"2023-03-27T10:11:02.598055+0000","last_peered":"2023-03-27T10:11:02.598055+0000","last_clean":"2023-03-27T10:11:02.598055+0000","last_became_active":"2023-03-27T10:11:02.588558+0000","last_became_peered":"2023-03-27T10:11:02.588558+0000","last_unstale":"2023-03-27T10:11:02.598055+0000","last_undegraded":"2023-03-27T10:11:02.598055+0000","last_fullsized":"2023-03-27T10:11:02.598055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:09:37.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.607629+0000","last_change":"2023-03-27T10:11:02.600532+0000","last_active":"2023-03-27T10:11:02.607629+0000","last_peered":"2023-03-27T10:11:02.607629+0000","last_clean":"2023-03-27T10:11:02.607629+0000","last_became_active":"2023-03-27T10:11:02.600255+0000","last_became_peered":"2023-03-27T10:11:02.600255+0000","last_unstale":"2023-03-27T10:11:02.607629+0000","last_undegraded":"2023-03-27T10:11:02.607629+0000","last_fullsized":"2023-03-27T10:11:02.607629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609287+0000","last_change":"2023-03-27T10:11:02.605864+0000","last_active":"2023-03-27T10:11:02.609287+0000","last_peered":"2023-03-27T10:11:02.609287+0000","last_clean":"2023-03-27T10:11:02.609287+0000","last_became_active":"2023-03-27T10:11:02.605580+0000","last_became_peered":"2023-03-27T10:11:02.605580+0000","last_unstale":"2023-03-27T10:11:02.609287+0000","last_undegraded":"2023-03-27T10:11:02.609287+0000","last_fullsized":"2023-03-27T10:11:02.609287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:55:17.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611061+0000","last_change":"2023-03-27T10:11:02.608136+0000","last_active":"2023-03-27T10:11:02.611061+0000","last_peered":"2023-03-27T10:11:02.611061+0000","last_clean":"2023-03-27T10:11:02.611061+0000","last_became_active":"2023-03-27T10:11:02.607876+0000","last_became_peered":"2023-03-27T10:11:02.607876+0000","last_unstale":"2023-03-27T10:11:02.611061+0000","last_undegraded":"2023-03-27T10:11:02.611061+0000","last_fullsized":"2023-03-27T10:11:02.611061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:52.645620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585382+0000","last_change":"2023-03-27T10:11:02.598490+0000","last_active":"2023-03-27T10:11:03.585382+0000","last_peered":"2023-03-27T10:11:03.585382+0000","last_clean":"2023-03-27T10:11:03.585382+0000","last_became_active":"2023-03-27T10:11:02.598229+0000","last_became_peered":"2023-03-27T10:11:02.598229+0000","last_unstale":"2023-03-27T10:11:03.585382+0000","last_undegraded":"2023-03-27T10:11:03.585382+0000","last_fullsized":"2023-03-27T10:11:03.585382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:15.637434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611025+0000","last_change":"2023-03-27T10:11:02.607708+0000","last_active":"2023-03-27T10:11:02.611025+0000","last_peered":"2023-03-27T10:11:02.611025+0000","last_clean":"2023-03-27T10:11:02.611025+0000","last_became_active":"2023-03-27T10:11:02.607430+0000","last_became_peered":"2023-03-27T10:11:02.607430+0000","last_unstale":"2023-03-27T10:11:02.611025+0000","last_undegraded":"2023-03-27T10:11:02.611025+0000","last_fullsized":"2023-03-27T10:11:02.611025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:30:34.349275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606458+0000","last_change":"2023-03-27T10:11:02.599932+0000","last_active":"2023-03-27T10:11:02.606458+0000","last_peered":"2023-03-27T10:11:02.606458+0000","last_clean":"2023-03-27T10:11:02.606458+0000","last_became_active":"2023-03-27T10:11:02.599670+0000","last_became_peered":"2023-03-27T10:11:02.599670+0000","last_unstale":"2023-03-27T10:11:02.606458+0000","last_undegraded":"2023-03-27T10:11:02.606458+0000","last_fullsized":"2023-03-27T10:11:02.606458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:53:13.497786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604549+0000","last_change":"2023-03-27T10:11:02.591217+0000","last_active":"2023-03-27T10:11:02.604549+0000","last_peered":"2023-03-27T10:11:02.604549+0000","last_clean":"2023-03-27T10:11:02.604549+0000","last_became_active":"2023-03-27T10:11:02.590951+0000","last_became_peered":"2023-03-27T10:11:02.590951+0000","last_unstale":"2023-03-27T10:11:02.604549+0000","last_undegraded":"2023-03-27T10:11:02.604549+0000","last_fullsized":"2023-03-27T10:11:02.604549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:55:32.614782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603296+0000","last_change":"2023-03-27T10:11:02.594207+0000","last_active":"2023-03-27T10:11:02.603296+0000","last_peered":"2023-03-27T10:11:02.603296+0000","last_clean":"2023-03-27T10:11:02.603296+0000","last_became_active":"2023-03-27T10:11:02.593789+0000","last_became_peered":"2023-03-27T10:11:02.593789+0000","last_unstale":"2023-03-27T10:11:02.603296+0000","last_undegraded":"2023-03-27T10:11:02.603296+0000","last_fullsized":"2023-03-27T10:11:02.603296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:55:32.614782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.584951+0000","last_change":"2023-03-27T10:11:02.593443+0000","last_active":"2023-03-27T10:11:03.584951+0000","last_peered":"2023-03-27T10:11:03.584951+0000","last_clean":"2023-03-27T10:11:03.584951+0000","last_became_active":"2023-03-27T10:11:02.592861+0000","last_became_peered":"2023-03-27T10:11:02.592861+0000","last_unstale":"2023-03-27T10:11:03.584951+0000","last_undegraded":"2023-03-27T10:11:03.584951+0000","last_fullsized":"2023-03-27T10:11:03.584951+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:50.408069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600530+0000","last_change":"2023-03-27T10:11:02.595626+0000","last_active":"2023-03-27T10:11:02.600530+0000","last_peered":"2023-03-27T10:11:02.600530+0000","last_clean":"2023-03-27T10:11:02.600530+0000","last_became_active":"2023-03-27T10:11:02.595341+0000","last_became_peered":"2023-03-27T10:11:02.595341+0000","last_unstale":"2023-03-27T10:11:02.600530+0000","last_undegraded":"2023-03-27T10:11:02.600530+0000","last_fullsized":"2023-03-27T10:11:02.600530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:58:51.735680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608372+0000","last_change":"2023-03-27T10:11:02.604976+0000","last_active":"2023-03-27T10:11:02.608372+0000","last_peered":"2023-03-27T10:11:02.608372+0000","last_clean":"2023-03-27T10:11:02.608372+0000","last_became_active":"2023-03-27T10:11:02.604534+0000","last_became_peered":"2023-03-27T10:11:02.604534+0000","last_unstale":"2023-03-27T10:11:02.608372+0000","last_undegraded":"2023-03-27T10:11:02.608372+0000","last_fullsized":"2023-03-27T10:11:02.608372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:46:46.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.599231+0000","last_change":"2023-03-27T10:11:02.594503+0000","last_active":"2023-03-27T10:11:02.599231+0000","last_peered":"2023-03-27T10:11:02.599231+0000","last_clean":"2023-03-27T10:11:02.599231+0000","last_became_active":"2023-03-27T10:11:02.594090+0000","last_became_peered":"2023-03-27T10:11:02.594090+0000","last_unstale":"2023-03-27T10:11:02.599231+0000","last_undegraded":"2023-03-27T10:11:02.599231+0000","last_fullsized":"2023-03-27T10:11:02.599231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:50.408069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602164+0000","last_change":"2023-03-27T10:11:02.595266+0000","last_active":"2023-03-27T10:11:02.602164+0000","last_peered":"2023-03-27T10:11:02.602164+0000","last_clean":"2023-03-27T10:11:02.602164+0000","last_became_active":"2023-03-27T10:11:02.594995+0000","last_became_peered":"2023-03-27T10:11:02.594995+0000","last_unstale":"2023-03-27T10:11:02.602164+0000","last_undegraded":"2023-03-27T10:11:02.602164+0000","last_fullsized":"2023-03-27T10:11:02.602164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:56.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611015+0000","last_change":"2023-03-27T10:11:02.603858+0000","last_active":"2023-03-27T10:11:02.611015+0000","last_peered":"2023-03-27T10:11:02.611015+0000","last_clean":"2023-03-27T10:11:02.611015+0000","last_became_active":"2023-03-27T10:11:02.603600+0000","last_became_peered":"2023-03-27T10:11:02.603600+0000","last_unstale":"2023-03-27T10:11:02.611015+0000","last_undegraded":"2023-03-27T10:11:02.611015+0000","last_fullsized":"2023-03-27T10:11:02.611015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:30:21.786118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608574+0000","last_change":"2023-03-27T10:11:02.601990+0000","last_active":"2023-03-27T10:11:02.608574+0000","last_peered":"2023-03-27T10:11:02.608574+0000","last_clean":"2023-03-27T10:11:02.608574+0000","last_became_active":"2023-03-27T10:11:02.601716+0000","last_became_peered":"2023-03-27T10:11:02.601716+0000","last_unstale":"2023-03-27T10:11:02.608574+0000","last_undegraded":"2023-03-27T10:11:02.608574+0000","last_fullsized":"2023-03-27T10:11:02.608574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:15.637434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603279+0000","last_change":"2023-03-27T10:11:02.594032+0000","last_active":"2023-03-27T10:11:02.603279+0000","last_peered":"2023-03-27T10:11:02.603279+0000","last_clean":"2023-03-27T10:11:02.603279+0000","last_became_active":"2023-03-27T10:11:02.593500+0000","last_became_peered":"2023-03-27T10:11:02.593500+0000","last_unstale":"2023-03-27T10:11:02.603279+0000","last_undegraded":"2023-03-27T10:11:02.603279+0000","last_fullsized":"2023-03-27T10:11:02.603279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:06:05.348655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603748+0000","last_change":"2023-03-27T10:11:02.596983+0000","last_active":"2023-03-27T10:11:02.603748+0000","last_peered":"2023-03-27T10:11:02.603748+0000","last_clean":"2023-03-27T10:11:02.603748+0000","last_became_active":"2023-03-27T10:11:02.596733+0000","last_became_peered":"2023-03-27T10:11:02.596733+0000","last_unstale":"2023-03-27T10:11:02.603748+0000","last_undegraded":"2023-03-27T10:11:02.603748+0000","last_fullsized":"2023-03-27T10:11:02.603748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:27:27.352911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609251+0000","last_change":"2023-03-27T10:11:02.604551+0000","last_active":"2023-03-27T10:11:02.609251+0000","last_peered":"2023-03-27T10:11:02.609251+0000","last_clean":"2023-03-27T10:11:02.609251+0000","last_became_active":"2023-03-27T10:11:02.604270+0000","last_became_peered":"2023-03-27T10:11:02.604270+0000","last_unstale":"2023-03-27T10:11:02.609251+0000","last_undegraded":"2023-03-27T10:11:02.609251+0000","last_fullsized":"2023-03-27T10:11:02.609251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:41:45.319088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608298+0000","last_change":"2023-03-27T10:11:02.111789+0000","last_active":"2023-03-27T10:11:02.608298+0000","last_peered":"2023-03-27T10:11:02.608298+0000","last_clean":"2023-03-27T10:11:02.608298+0000","last_became_active":"2023-03-27T10:11:02.111520+0000","last_became_peered":"2023-03-27T10:11:02.111520+0000","last_unstale":"2023-03-27T10:11:02.608298+0000","last_undegraded":"2023-03-27T10:11:02.608298+0000","last_fullsized":"2023-03-27T10:11:02.608298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:02:29.503179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608382+0000","last_change":"2023-03-27T10:11:02.605653+0000","last_active":"2023-03-27T10:11:02.608382+0000","last_peered":"2023-03-27T10:11:02.608382+0000","last_clean":"2023-03-27T10:11:02.608382+0000","last_became_active":"2023-03-27T10:11:02.605369+0000","last_became_peered":"2023-03-27T10:11:02.605369+0000","last_unstale":"2023-03-27T10:11:02.608382+0000","last_undegraded":"2023-03-27T10:11:02.608382+0000","last_fullsized":"2023-03-27T10:11:02.608382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:18.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.593136+0000","last_change":"2023-03-27T10:11:02.113177+0000","last_active":"2023-03-27T10:11:02.593136+0000","last_peered":"2023-03-27T10:11:02.593136+0000","last_clean":"2023-03-27T10:11:02.593136+0000","last_became_active":"2023-03-27T10:11:02.112898+0000","last_became_peered":"2023-03-27T10:11:02.112898+0000","last_unstale":"2023-03-27T10:11:02.593136+0000","last_undegraded":"2023-03-27T10:11:02.593136+0000","last_fullsized":"2023-03-27T10:11:02.593136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:14.630929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604966+0000","last_change":"2023-03-27T10:11:02.595496+0000","last_active":"2023-03-27T10:11:02.604966+0000","last_peered":"2023-03-27T10:11:02.604966+0000","last_clean":"2023-03-27T10:11:02.604966+0000","last_became_active":"2023-03-27T10:11:02.595231+0000","last_became_peered":"2023-03-27T10:11:02.595231+0000","last_unstale":"2023-03-27T10:11:02.604966+0000","last_undegraded":"2023-03-27T10:11:02.604966+0000","last_fullsized":"2023-03-27T10:11:02.604966+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:20:23.393796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.605357+0000","last_change":"2023-03-27T10:11:02.115993+0000","last_active":"2023-03-27T10:11:02.605357+0000","last_peered":"2023-03-27T10:11:02.605357+0000","last_clean":"2023-03-27T10:11:02.605357+0000","last_became_active":"2023-03-27T10:11:02.115716+0000","last_became_peered":"2023-03-27T10:11:02.115716+0000","last_unstale":"2023-03-27T10:11:02.605357+0000","last_undegraded":"2023-03-27T10:11:02.605357+0000","last_fullsized":"2023-03-27T10:11:02.605357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:00:14.630929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598854+0000","last_change":"2023-03-27T10:11:02.597461+0000","last_active":"2023-03-27T10:11:02.598854+0000","last_peered":"2023-03-27T10:11:02.598854+0000","last_clean":"2023-03-27T10:11:02.598854+0000","last_became_active":"2023-03-27T10:11:02.597192+0000","last_became_peered":"2023-03-27T10:11:02.597192+0000","last_unstale":"2023-03-27T10:11:02.598854+0000","last_undegraded":"2023-03-27T10:11:02.598854+0000","last_fullsized":"2023-03-27T10:11:02.598854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:20:23.393796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604475+0000","last_change":"2023-03-27T10:11:02.110922+0000","last_active":"2023-03-27T10:11:02.604475+0000","last_peered":"2023-03-27T10:11:02.604475+0000","last_clean":"2023-03-27T10:11:02.604475+0000","last_became_active":"2023-03-27T10:11:02.110646+0000","last_became_peered":"2023-03-27T10:11:02.110646+0000","last_unstale":"2023-03-27T10:11:02.604475+0000","last_undegraded":"2023-03-27T10:11:02.604475+0000","last_fullsized":"2023-03-27T10:11:02.604475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:17.923414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600981+0000","last_change":"2023-03-27T10:11:02.596409+0000","last_active":"2023-03-27T10:11:02.600981+0000","last_peered":"2023-03-27T10:11:02.600981+0000","last_clean":"2023-03-27T10:11:02.600981+0000","last_became_active":"2023-03-27T10:11:02.596142+0000","last_became_peered":"2023-03-27T10:11:02.596142+0000","last_unstale":"2023-03-27T10:11:02.600981+0000","last_undegraded":"2023-03-27T10:11:02.600981+0000","last_fullsized":"2023-03-27T10:11:02.600981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:46:46.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609625+0000","last_change":"2023-03-27T10:11:02.114156+0000","last_active":"2023-03-27T10:11:02.609625+0000","last_peered":"2023-03-27T10:11:02.609625+0000","last_clean":"2023-03-27T10:11:02.609625+0000","last_became_active":"2023-03-27T10:11:02.113802+0000","last_became_peered":"2023-03-27T10:11:02.113802+0000","last_unstale":"2023-03-27T10:11:02.609625+0000","last_undegraded":"2023-03-27T10:11:02.609625+0000","last_fullsized":"2023-03-27T10:11:02.609625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:52:01.330209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609569+0000","last_change":"2023-03-27T10:11:02.597657+0000","last_active":"2023-03-27T10:11:02.609569+0000","last_peered":"2023-03-27T10:11:02.609569+0000","last_clean":"2023-03-27T10:11:02.609569+0000","last_became_active":"2023-03-27T10:11:02.597349+0000","last_became_peered":"2023-03-27T10:11:02.597349+0000","last_unstale":"2023-03-27T10:11:02.609569+0000","last_undegraded":"2023-03-27T10:11:02.609569+0000","last_fullsized":"2023-03-27T10:11:02.609569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:46:46.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609283+0000","last_change":"2023-03-27T10:11:02.115879+0000","last_active":"2023-03-27T10:11:02.609283+0000","last_peered":"2023-03-27T10:11:02.609283+0000","last_clean":"2023-03-27T10:11:02.609283+0000","last_became_active":"2023-03-27T10:11:02.115543+0000","last_became_peered":"2023-03-27T10:11:02.115543+0000","last_unstale":"2023-03-27T10:11:02.609283+0000","last_undegraded":"2023-03-27T10:11:02.609283+0000","last_fullsized":"2023-03-27T10:11:02.609283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:46:51.625489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604574+0000","last_change":"2023-03-27T10:11:02.592565+0000","last_active":"2023-03-27T10:11:02.604574+0000","last_peered":"2023-03-27T10:11:02.604574+0000","last_clean":"2023-03-27T10:11:02.604574+0000","last_became_active":"2023-03-27T10:11:02.592320+0000","last_became_peered":"2023-03-27T10:11:02.592320+0000","last_unstale":"2023-03-27T10:11:02.604574+0000","last_undegraded":"2023-03-27T10:11:02.604574+0000","last_fullsized":"2023-03-27T10:11:02.604574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:06:05.348655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.592479+0000","last_change":"2023-03-27T10:11:02.114979+0000","last_active":"2023-03-27T10:11:02.592479+0000","last_peered":"2023-03-27T10:11:02.592479+0000","last_clean":"2023-03-27T10:11:02.592479+0000","last_became_active":"2023-03-27T10:11:02.114728+0000","last_became_peered":"2023-03-27T10:11:02.114728+0000","last_unstale":"2023-03-27T10:11:02.592479+0000","last_undegraded":"2023-03-27T10:11:02.592479+0000","last_fullsized":"2023-03-27T10:11:02.592479+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:49.401563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600809+0000","last_change":"2023-03-27T10:11:02.598805+0000","last_active":"2023-03-27T10:11:02.600809+0000","last_peered":"2023-03-27T10:11:02.600809+0000","last_clean":"2023-03-27T10:11:02.600809+0000","last_became_active":"2023-03-27T10:11:02.598409+0000","last_became_peered":"2023-03-27T10:11:02.598409+0000","last_unstale":"2023-03-27T10:11:02.600809+0000","last_undegraded":"2023-03-27T10:11:02.600809+0000","last_fullsized":"2023-03-27T10:11:02.600809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:07:13.955220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.580593+0000","last_change":"2023-03-27T10:11:02.109414+0000","last_active":"2023-03-27T10:11:02.580593+0000","last_peered":"2023-03-27T10:11:02.580593+0000","last_clean":"2023-03-27T10:11:02.580593+0000","last_became_active":"2023-03-27T10:11:02.109134+0000","last_became_peered":"2023-03-27T10:11:02.109134+0000","last_unstale":"2023-03-27T10:11:02.580593+0000","last_undegraded":"2023-03-27T10:11:02.580593+0000","last_fullsized":"2023-03-27T10:11:02.580593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:27:26.346405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585259+0000","last_change":"2023-03-27T10:11:02.591808+0000","last_active":"2023-03-27T10:11:03.585259+0000","last_peered":"2023-03-27T10:11:03.585259+0000","last_clean":"2023-03-27T10:11:03.585259+0000","last_became_active":"2023-03-27T10:11:02.591539+0000","last_became_peered":"2023-03-27T10:11:02.591539+0000","last_unstale":"2023-03-27T10:11:03.585259+0000","last_undegraded":"2023-03-27T10:11:03.585259+0000","last_fullsized":"2023-03-27T10:11:03.585259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:11:06.618949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.577367+0000","last_change":"2023-03-27T10:11:02.109376+0000","last_active":"2023-03-27T10:11:02.577367+0000","last_peered":"2023-03-27T10:11:02.577367+0000","last_clean":"2023-03-27T10:11:02.577367+0000","last_became_active":"2023-03-27T10:11:02.109114+0000","last_became_peered":"2023-03-27T10:11:02.109114+0000","last_unstale":"2023-03-27T10:11:02.577367+0000","last_undegraded":"2023-03-27T10:11:02.577367+0000","last_fullsized":"2023-03-27T10:11:02.577367+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:58:01.770082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603420+0000","last_change":"2023-03-27T10:11:02.596034+0000","last_active":"2023-03-27T10:11:02.603420+0000","last_peered":"2023-03-27T10:11:02.603420+0000","last_clean":"2023-03-27T10:11:02.603420+0000","last_became_active":"2023-03-27T10:11:02.595431+0000","last_became_peered":"2023-03-27T10:11:02.595431+0000","last_unstale":"2023-03-27T10:11:02.603420+0000","last_undegraded":"2023-03-27T10:11:02.603420+0000","last_fullsized":"2023-03-27T10:11:02.603420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:06:19.061523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.582838+0000","last_change":"2023-03-27T10:11:02.114222+0000","last_active":"2023-03-27T10:11:02.582838+0000","last_peered":"2023-03-27T10:11:02.582838+0000","last_clean":"2023-03-27T10:11:02.582838+0000","last_became_active":"2023-03-27T10:11:02.113920+0000","last_became_peered":"2023-03-27T10:11:02.113920+0000","last_unstale":"2023-03-27T10:11:02.582838+0000","last_undegraded":"2023-03-27T10:11:02.582838+0000","last_fullsized":"2023-03-27T10:11:02.582838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:21:49.401563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598867+0000","last_change":"2023-03-27T10:11:02.593589+0000","last_active":"2023-03-27T10:11:02.598867+0000","last_peered":"2023-03-27T10:11:02.598867+0000","last_clean":"2023-03-27T10:11:02.598867+0000","last_became_active":"2023-03-27T10:11:02.593309+0000","last_became_peered":"2023-03-27T10:11:02.593309+0000","last_unstale":"2023-03-27T10:11:02.598867+0000","last_undegraded":"2023-03-27T10:11:02.598867+0000","last_fullsized":"2023-03-27T10:11:02.598867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:44:33.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609539+0000","last_change":"2023-03-27T10:11:02.113086+0000","last_active":"2023-03-27T10:11:02.609539+0000","last_peered":"2023-03-27T10:11:02.609539+0000","last_clean":"2023-03-27T10:11:02.609539+0000","last_became_active":"2023-03-27T10:11:02.112825+0000","last_became_peered":"2023-03-27T10:11:02.112825+0000","last_unstale":"2023-03-27T10:11:02.609539+0000","last_undegraded":"2023-03-27T10:11:02.609539+0000","last_fullsized":"2023-03-27T10:11:02.609539+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:51.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603439+0000","last_change":"2023-03-27T10:11:02.591394+0000","last_active":"2023-03-27T10:11:02.603439+0000","last_peered":"2023-03-27T10:11:02.603439+0000","last_clean":"2023-03-27T10:11:02.603439+0000","last_became_active":"2023-03-27T10:11:02.590560+0000","last_became_peered":"2023-03-27T10:11:02.590560+0000","last_unstale":"2023-03-27T10:11:02.603439+0000","last_undegraded":"2023-03-27T10:11:02.603439+0000","last_fullsized":"2023-03-27T10:11:02.603439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:07:13.955220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.611703+0000","last_change":"2023-03-27T10:11:02.114317+0000","last_active":"2023-03-27T10:11:02.611703+0000","last_peered":"2023-03-27T10:11:02.611703+0000","last_clean":"2023-03-27T10:11:02.611703+0000","last_became_active":"2023-03-27T10:11:02.114035+0000","last_became_peered":"2023-03-27T10:11:02.114035+0000","last_unstale":"2023-03-27T10:11:02.611703+0000","last_undegraded":"2023-03-27T10:11:02.611703+0000","last_fullsized":"2023-03-27T10:11:02.611703+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:10:21.595177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.587221+0000","last_change":"2023-03-27T10:11:02.585208+0000","last_active":"2023-03-27T10:11:02.587221+0000","last_peered":"2023-03-27T10:11:02.587221+0000","last_clean":"2023-03-27T10:11:02.587221+0000","last_became_active":"2023-03-27T10:11:02.584961+0000","last_became_peered":"2023-03-27T10:11:02.584961+0000","last_unstale":"2023-03-27T10:11:02.587221+0000","last_undegraded":"2023-03-27T10:11:02.587221+0000","last_fullsized":"2023-03-27T10:11:02.587221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:27:27.352911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606355+0000","last_change":"2023-03-27T10:11:02.113234+0000","last_active":"2023-03-27T10:11:02.606355+0000","last_peered":"2023-03-27T10:11:02.606355+0000","last_clean":"2023-03-27T10:11:02.606355+0000","last_became_active":"2023-03-27T10:11:02.112937+0000","last_became_peered":"2023-03-27T10:11:02.112937+0000","last_unstale":"2023-03-27T10:11:02.606355+0000","last_undegraded":"2023-03-27T10:11:02.606355+0000","last_fullsized":"2023-03-27T10:11:02.606355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:32:07.276905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594688+0000","last_change":"2023-03-27T10:11:02.585357+0000","last_active":"2023-03-27T10:11:02.594688+0000","last_peered":"2023-03-27T10:11:02.594688+0000","last_clean":"2023-03-27T10:11:02.594688+0000","last_became_active":"2023-03-27T10:11:02.585093+0000","last_became_peered":"2023-03-27T10:11:02.585093+0000","last_unstale":"2023-03-27T10:11:02.594688+0000","last_undegraded":"2023-03-27T10:11:02.594688+0000","last_fullsized":"2023-03-27T10:11:02.594688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:20:18.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.592924+0000","last_change":"2023-03-27T10:11:02.114464+0000","last_active":"2023-03-27T10:11:02.592924+0000","last_peered":"2023-03-27T10:11:02.592924+0000","last_clean":"2023-03-27T10:11:02.592924+0000","last_became_active":"2023-03-27T10:11:02.114213+0000","last_became_peered":"2023-03-27T10:11:02.114213+0000","last_unstale":"2023-03-27T10:11:02.592924+0000","last_undegraded":"2023-03-27T10:11:02.592924+0000","last_fullsized":"2023-03-27T10:11:02.592924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:30:20.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.607113+0000","last_change":"2023-03-27T10:11:02.598274+0000","last_active":"2023-03-27T10:11:02.607113+0000","last_peered":"2023-03-27T10:11:02.607113+0000","last_clean":"2023-03-27T10:11:02.607113+0000","last_became_active":"2023-03-27T10:11:02.597994+0000","last_became_peered":"2023-03-27T10:11:02.597994+0000","last_unstale":"2023-03-27T10:11:02.607113+0000","last_undegraded":"2023-03-27T10:11:02.607113+0000","last_fullsized":"2023-03-27T10:11:02.607113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:07:13.955220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.589118+0000","last_change":"2023-03-27T10:11:02.105653+0000","last_active":"2023-03-27T10:11:02.589118+0000","last_peered":"2023-03-27T10:11:02.589118+0000","last_clean":"2023-03-27T10:11:02.589118+0000","last_became_active":"2023-03-27T10:11:02.105213+0000","last_became_peered":"2023-03-27T10:11:02.105213+0000","last_unstale":"2023-03-27T10:11:02.589118+0000","last_undegraded":"2023-03-27T10:11:02.589118+0000","last_fullsized":"2023-03-27T10:11:02.589118+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T11:57:18.882990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594738+0000","last_change":"2023-03-27T10:11:02.584509+0000","last_active":"2023-03-27T10:11:02.594738+0000","last_peered":"2023-03-27T10:11:02.594738+0000","last_clean":"2023-03-27T10:11:02.594738+0000","last_became_active":"2023-03-27T10:11:02.584236+0000","last_became_peered":"2023-03-27T10:11:02.584236+0000","last_unstale":"2023-03-27T10:11:02.594738+0000","last_undegraded":"2023-03-27T10:11:02.594738+0000","last_fullsized":"2023-03-27T10:11:02.594738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:06:19.061523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.614289+0000","last_change":"2023-03-27T10:11:02.112350+0000","last_active":"2023-03-27T10:11:02.614289+0000","last_peered":"2023-03-27T10:11:02.614289+0000","last_clean":"2023-03-27T10:11:02.614289+0000","last_became_active":"2023-03-27T10:11:02.112068+0000","last_became_peered":"2023-03-27T10:11:02.112068+0000","last_unstale":"2023-03-27T10:11:02.614289+0000","last_undegraded":"2023-03-27T10:11:02.614289+0000","last_fullsized":"2023-03-27T10:11:02.614289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:15:06.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.602823+0000","last_change":"2023-03-27T10:11:02.598515+0000","last_active":"2023-03-27T10:11:02.602823+0000","last_peered":"2023-03-27T10:11:02.602823+0000","last_clean":"2023-03-27T10:11:02.602823+0000","last_became_active":"2023-03-27T10:11:02.597845+0000","last_became_peered":"2023-03-27T10:11:02.597845+0000","last_unstale":"2023-03-27T10:11:02.602823+0000","last_undegraded":"2023-03-27T10:11:02.602823+0000","last_fullsized":"2023-03-27T10:11:02.602823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:14:16.772241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.609692+0000","last_change":"2023-03-27T10:11:02.116494+0000","last_active":"2023-03-27T10:11:02.609692+0000","last_peered":"2023-03-27T10:11:02.609692+0000","last_clean":"2023-03-27T10:11:02.609692+0000","last_became_active":"2023-03-27T10:11:02.116236+0000","last_became_peered":"2023-03-27T10:11:02.116236+0000","last_unstale":"2023-03-27T10:11:02.609692+0000","last_undegraded":"2023-03-27T10:11:02.609692+0000","last_fullsized":"2023-03-27T10:11:02.609692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:30:20.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606489+0000","last_change":"2023-03-27T10:11:02.600080+0000","last_active":"2023-03-27T10:11:02.606489+0000","last_peered":"2023-03-27T10:11:02.606489+0000","last_clean":"2023-03-27T10:11:02.606489+0000","last_became_active":"2023-03-27T10:11:02.599760+0000","last_became_peered":"2023-03-27T10:11:02.599760+0000","last_unstale":"2023-03-27T10:11:02.606489+0000","last_undegraded":"2023-03-27T10:11:02.606489+0000","last_fullsized":"2023-03-27T10:11:02.606489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:00:09.866300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.604893+0000","last_change":"2023-03-27T10:11:02.114934+0000","last_active":"2023-03-27T10:11:02.604893+0000","last_peered":"2023-03-27T10:11:02.604893+0000","last_clean":"2023-03-27T10:11:02.604893+0000","last_became_active":"2023-03-27T10:11:02.114671+0000","last_became_peered":"2023-03-27T10:11:02.114671+0000","last_unstale":"2023-03-27T10:11:02.604893+0000","last_undegraded":"2023-03-27T10:11:02.604893+0000","last_fullsized":"2023-03-27T10:11:02.604893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:55.280078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606024+0000","last_change":"2023-03-27T10:11:02.598905+0000","last_active":"2023-03-27T10:11:02.606024+0000","last_peered":"2023-03-27T10:11:02.606024+0000","last_clean":"2023-03-27T10:11:02.606024+0000","last_became_active":"2023-03-27T10:11:02.598608+0000","last_became_peered":"2023-03-27T10:11:02.598608+0000","last_unstale":"2023-03-27T10:11:02.606024+0000","last_undegraded":"2023-03-27T10:11:02.606024+0000","last_fullsized":"2023-03-27T10:11:02.606024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:55:17.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585297+0000","last_change":"2023-03-27T10:11:02.113132+0000","last_active":"2023-03-27T10:11:03.585297+0000","last_peered":"2023-03-27T10:11:03.585297+0000","last_clean":"2023-03-27T10:11:03.585297+0000","last_became_active":"2023-03-27T10:11:02.112871+0000","last_became_peered":"2023-03-27T10:11:02.112871+0000","last_unstale":"2023-03-27T10:11:03.585297+0000","last_undegraded":"2023-03-27T10:11:03.585297+0000","last_fullsized":"2023-03-27T10:11:03.585297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T13:46:00.315514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585407+0000","last_change":"2023-03-27T10:11:02.600474+0000","last_active":"2023-03-27T10:11:03.585407+0000","last_peered":"2023-03-27T10:11:03.585407+0000","last_clean":"2023-03-27T10:11:03.585407+0000","last_became_active":"2023-03-27T10:11:02.599587+0000","last_became_peered":"2023-03-27T10:11:02.599587+0000","last_unstale":"2023-03-27T10:11:03.585407+0000","last_undegraded":"2023-03-27T10:11:03.585407+0000","last_fullsized":"2023-03-27T10:11:03.585407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:52:02.336715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.592593+0000","last_change":"2023-03-27T10:11:02.112179+0000","last_active":"2023-03-27T10:11:02.592593+0000","last_peered":"2023-03-27T10:11:02.592593+0000","last_clean":"2023-03-27T10:11:02.592593+0000","last_became_active":"2023-03-27T10:11:02.111914+0000","last_became_peered":"2023-03-27T10:11:02.111914+0000","last_unstale":"2023-03-27T10:11:02.592593+0000","last_undegraded":"2023-03-27T10:11:02.592593+0000","last_fullsized":"2023-03-27T10:11:02.592593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:30:33.342769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.599545+0000","last_change":"2023-03-27T10:11:02.592253+0000","last_active":"2023-03-27T10:11:02.599545+0000","last_peered":"2023-03-27T10:11:02.599545+0000","last_clean":"2023-03-27T10:11:02.599545+0000","last_became_active":"2023-03-27T10:11:02.591878+0000","last_became_peered":"2023-03-27T10:11:02.591878+0000","last_unstale":"2023-03-27T10:11:02.599545+0000","last_undegraded":"2023-03-27T10:11:02.599545+0000","last_fullsized":"2023-03-27T10:11:02.599545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:09:37.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585135+0000","last_change":"2023-03-27T10:11:02.114739+0000","last_active":"2023-03-27T10:11:03.585135+0000","last_peered":"2023-03-27T10:11:03.585135+0000","last_clean":"2023-03-27T10:11:03.585135+0000","last_became_active":"2023-03-27T10:11:02.114473+0000","last_became_peered":"2023-03-27T10:11:02.114473+0000","last_unstale":"2023-03-27T10:11:03.585135+0000","last_undegraded":"2023-03-27T10:11:03.585135+0000","last_fullsized":"2023-03-27T10:11:03.585135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:04:36.000048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597614+0000","last_change":"2023-03-27T10:11:02.594135+0000","last_active":"2023-03-27T10:11:02.597614+0000","last_peered":"2023-03-27T10:11:02.597614+0000","last_clean":"2023-03-27T10:11:02.597614+0000","last_became_active":"2023-03-27T10:11:02.593872+0000","last_became_peered":"2023-03-27T10:11:02.593872+0000","last_unstale":"2023-03-27T10:11:02.597614+0000","last_undegraded":"2023-03-27T10:11:02.597614+0000","last_fullsized":"2023-03-27T10:11:02.597614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:10:22.601682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585086+0000","last_change":"2023-03-27T10:11:02.110681+0000","last_active":"2023-03-27T10:11:03.585086+0000","last_peered":"2023-03-27T10:11:03.585086+0000","last_clean":"2023-03-27T10:11:03.585086+0000","last_became_active":"2023-03-27T10:11:02.110349+0000","last_became_peered":"2023-03-27T10:11:02.110349+0000","last_unstale":"2023-03-27T10:11:03.585086+0000","last_undegraded":"2023-03-27T10:11:03.585086+0000","last_fullsized":"2023-03-27T10:11:03.585086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:48:27.220025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606479+0000","last_change":"2023-03-27T10:11:02.597154+0000","last_active":"2023-03-27T10:11:02.606479+0000","last_peered":"2023-03-27T10:11:02.606479+0000","last_clean":"2023-03-27T10:11:02.606479+0000","last_became_active":"2023-03-27T10:11:02.596883+0000","last_became_peered":"2023-03-27T10:11:02.596883+0000","last_unstale":"2023-03-27T10:11:02.606479+0000","last_undegraded":"2023-03-27T10:11:02.606479+0000","last_fullsized":"2023-03-27T10:11:02.606479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:24:18.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.587964+0000","last_change":"2023-03-27T10:11:02.113021+0000","last_active":"2023-03-27T10:11:02.587964+0000","last_peered":"2023-03-27T10:11:02.587964+0000","last_clean":"2023-03-27T10:11:02.587964+0000","last_became_active":"2023-03-27T10:11:02.112757+0000","last_became_peered":"2023-03-27T10:11:02.112757+0000","last_unstale":"2023-03-27T10:11:02.587964+0000","last_undegraded":"2023-03-27T10:11:02.587964+0000","last_fullsized":"2023-03-27T10:11:02.587964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:10:21.595177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.600790+0000","last_change":"2023-03-27T10:11:02.598651+0000","last_active":"2023-03-27T10:11:02.600790+0000","last_peered":"2023-03-27T10:11:02.600790+0000","last_clean":"2023-03-27T10:11:02.600790+0000","last_became_active":"2023-03-27T10:11:02.598094+0000","last_became_peered":"2023-03-27T10:11:02.598094+0000","last_unstale":"2023-03-27T10:11:02.600790+0000","last_undegraded":"2023-03-27T10:11:02.600790+0000","last_fullsized":"2023-03-27T10:11:02.600790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:55:17.024781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.584947+0000","last_change":"2023-03-27T10:11:02.114306+0000","last_active":"2023-03-27T10:11:03.584947+0000","last_peered":"2023-03-27T10:11:03.584947+0000","last_clean":"2023-03-27T10:11:03.584947+0000","last_became_active":"2023-03-27T10:11:02.114053+0000","last_became_peered":"2023-03-27T10:11:02.114053+0000","last_unstale":"2023-03-27T10:11:03.584947+0000","last_undegraded":"2023-03-27T10:11:03.584947+0000","last_fullsized":"2023-03-27T10:11:03.584947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:59:30.011362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.594053+0000","last_change":"2023-03-27T10:11:02.591092+0000","last_active":"2023-03-27T10:11:02.594053+0000","last_peered":"2023-03-27T10:11:02.594053+0000","last_clean":"2023-03-27T10:11:02.594053+0000","last_became_active":"2023-03-27T10:11:02.590565+0000","last_became_peered":"2023-03-27T10:11:02.590565+0000","last_unstale":"2023-03-27T10:11:02.594053+0000","last_undegraded":"2023-03-27T10:11:02.594053+0000","last_fullsized":"2023-03-27T10:11:02.594053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:56.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.581039+0000","last_change":"2023-03-27T10:11:02.114525+0000","last_active":"2023-03-27T10:11:02.581039+0000","last_peered":"2023-03-27T10:11:02.581039+0000","last_clean":"2023-03-27T10:11:02.581039+0000","last_became_active":"2023-03-27T10:11:02.113867+0000","last_became_peered":"2023-03-27T10:11:02.113867+0000","last_unstale":"2023-03-27T10:11:02.581039+0000","last_undegraded":"2023-03-27T10:11:02.581039+0000","last_fullsized":"2023-03-27T10:11:02.581039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:52:01.330209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.104682+0000","last_change":"2023-03-27T10:09:46.107098+0000","last_active":"2023-03-27T10:11:02.104682+0000","last_peered":"2023-03-27T10:11:02.104682+0000","last_clean":"2023-03-27T10:11:02.104682+0000","last_became_active":"2023-03-27T10:09:46.106831+0000","last_became_peered":"2023-03-27T10:09:46.106831+0000","last_unstale":"2023-03-27T10:11:02.104682+0000","last_undegraded":"2023-03-27T10:11:02.104682+0000","last_fullsized":"2023-03-27T10:11:02.104682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.597608+0000","last_change":"2023-03-27T10:11:02.584755+0000","last_active":"2023-03-27T10:11:02.597608+0000","last_peered":"2023-03-27T10:11:02.597608+0000","last_clean":"2023-03-27T10:11:02.597608+0000","last_became_active":"2023-03-27T10:11:02.584440+0000","last_became_peered":"2023-03-27T10:11:02.584440+0000","last_unstale":"2023-03-27T10:11:02.597608+0000","last_undegraded":"2023-03-27T10:11:02.597608+0000","last_fullsized":"2023-03-27T10:11:02.597608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T12:09:37.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.580138+0000","last_change":"2023-03-27T10:11:02.112948+0000","last_active":"2023-03-27T10:11:02.580138+0000","last_peered":"2023-03-27T10:11:02.580138+0000","last_clean":"2023-03-27T10:11:02.580138+0000","last_became_active":"2023-03-27T10:11:02.112706+0000","last_became_peered":"2023-03-27T10:11:02.112706+0000","last_unstale":"2023-03-27T10:11:02.580138+0000","last_undegraded":"2023-03-27T10:11:02.580138+0000","last_fullsized":"2023-03-27T10:11:02.580138+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:57:51.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.109516+0000","last_change":"2023-03-27T10:09:46.107305+0000","last_active":"2023-03-27T10:11:02.109516+0000","last_peered":"2023-03-27T10:11:02.109516+0000","last_clean":"2023-03-27T10:11:02.109516+0000","last_became_active":"2023-03-27T10:09:46.107038+0000","last_became_peered":"2023-03-27T10:09:46.107038+0000","last_unstale":"2023-03-27T10:11:02.109516+0000","last_undegraded":"2023-03-27T10:11:02.109516+0000","last_fullsized":"2023-03-27T10:11:02.109516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.607366+0000","last_change":"2023-03-27T10:11:02.596219+0000","last_active":"2023-03-27T10:11:02.607366+0000","last_peered":"2023-03-27T10:11:02.607366+0000","last_clean":"2023-03-27T10:11:02.607366+0000","last_became_active":"2023-03-27T10:11:02.595766+0000","last_became_peered":"2023-03-27T10:11:02.595766+0000","last_unstale":"2023-03-27T10:11:02.607366+0000","last_undegraded":"2023-03-27T10:11:02.607366+0000","last_fullsized":"2023-03-27T10:11:02.607366+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T21:20:23.393796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-03-27T10:11:03.585316+0000","last_change":"2023-03-27T10:11:02.114314+0000","last_active":"2023-03-27T10:11:03.585316+0000","last_peered":"2023-03-27T10:11:03.585316+0000","last_clean":"2023-03-27T10:11:03.585316+0000","last_became_active":"2023-03-27T10:11:02.113990+0000","last_became_peered":"2023-03-27T10:11:02.113990+0000","last_unstale":"2023-03-27T10:11:03.585316+0000","last_undegraded":"2023-03-27T10:11:03.585316+0000","last_fullsized":"2023-03-27T10:11:03.585316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:08:56.852064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.582661+0000","last_change":"2023-03-27T10:09:46.326263+0000","last_active":"2023-03-27T10:11:02.582661+0000","last_peered":"2023-03-27T10:11:02.582661+0000","last_clean":"2023-03-27T10:11:02.582661+0000","last_became_active":"2023-03-27T10:09:46.325963+0000","last_became_peered":"2023-03-27T10:09:46.325963+0000","last_unstale":"2023-03-27T10:11:02.582661+0000","last_undegraded":"2023-03-27T10:11:02.582661+0000","last_fullsized":"2023-03-27T10:11:02.582661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.598399+0000","last_change":"2023-03-27T10:11:02.590021+0000","last_active":"2023-03-27T10:11:02.598399+0000","last_peered":"2023-03-27T10:11:02.598399+0000","last_clean":"2023-03-27T10:11:02.598399+0000","last_became_active":"2023-03-27T10:11:02.589696+0000","last_became_peered":"2023-03-27T10:11:02.589696+0000","last_unstale":"2023-03-27T10:11:02.598399+0000","last_undegraded":"2023-03-27T10:11:02.598399+0000","last_fullsized":"2023-03-27T10:11:02.598399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:13:52.060979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.585510+0000","last_change":"2023-03-27T10:11:02.113028+0000","last_active":"2023-03-27T10:11:02.585510+0000","last_peered":"2023-03-27T10:11:02.585510+0000","last_clean":"2023-03-27T10:11:02.585510+0000","last_became_active":"2023-03-27T10:11:02.112674+0000","last_became_peered":"2023-03-27T10:11:02.112674+0000","last_unstale":"2023-03-27T10:11:02.585510+0000","last_undegraded":"2023-03-27T10:11:02.585510+0000","last_fullsized":"2023-03-27T10:11:02.585510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:44:32.578752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.111623+0000","last_change":"2023-03-27T10:09:46.106690+0000","last_active":"2023-03-27T10:11:02.111623+0000","last_peered":"2023-03-27T10:11:02.111623+0000","last_clean":"2023-03-27T10:11:02.111623+0000","last_became_active":"2023-03-27T10:09:46.106393+0000","last_became_peered":"2023-03-27T10:09:46.106393+0000","last_unstale":"2023-03-27T10:11:02.111623+0000","last_undegraded":"2023-03-27T10:11:02.111623+0000","last_fullsized":"2023-03-27T10:11:02.111623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:13:47.070373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.102113+0000","last_change":"2023-03-27T10:09:40.691310+0000","last_active":"2023-03-27T10:11:02.102113+0000","last_peered":"2023-03-27T10:11:02.102113+0000","last_clean":"2023-03-27T10:11:02.102113+0000","last_became_active":"2023-03-27T10:09:40.690248+0000","last_became_peered":"2023-03-27T10:09:40.690248+0000","last_unstale":"2023-03-27T10:11:02.102113+0000","last_undegraded":"2023-03-27T10:11:02.102113+0000","last_fullsized":"2023-03-27T10:11:02.102113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:39.335229+0000","last_clean_scrub_stamp":"2023-03-27T10:09:39.335229+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:58:29.036302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608355+0000","last_change":"2023-03-27T10:11:02.604511+0000","last_active":"2023-03-27T10:11:02.608355+0000","last_peered":"2023-03-27T10:11:02.608355+0000","last_clean":"2023-03-27T10:11:02.608355+0000","last_became_active":"2023-03-27T10:11:02.604234+0000","last_became_peered":"2023-03-27T10:11:02.604234+0000","last_unstale":"2023-03-27T10:11:02.608355+0000","last_undegraded":"2023-03-27T10:11:02.608355+0000","last_fullsized":"2023-03-27T10:11:02.608355+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T15:15:56.286584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.608969+0000","last_change":"2023-03-27T10:11:02.118691+0000","last_active":"2023-03-27T10:11:02.608969+0000","last_peered":"2023-03-27T10:11:02.608969+0000","last_clean":"2023-03-27T10:11:02.608969+0000","last_became_active":"2023-03-27T10:11:02.118500+0000","last_became_peered":"2023-03-27T10:11:02.118500+0000","last_unstale":"2023-03-27T10:11:02.608969+0000","last_undegraded":"2023-03-27T10:11:02.608969+0000","last_fullsized":"2023-03-27T10:11:02.608969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T20:30:33.342769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.102251+0000","last_change":"2023-03-27T10:09:46.108163+0000","last_active":"2023-03-27T10:11:02.102251+0000","last_peered":"2023-03-27T10:11:02.102251+0000","last_clean":"2023-03-27T10:11:02.102251+0000","last_became_active":"2023-03-27T10:09:46.107807+0000","last_became_peered":"2023-03-27T10:09:46.107807+0000","last_unstale":"2023-03-27T10:11:02.102251+0000","last_undegraded":"2023-03-27T10:11:02.102251+0000","last_fullsized":"2023-03-27T10:11:02.102251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603224+0000","last_change":"2023-03-27T10:11:02.596118+0000","last_active":"2023-03-27T10:11:02.603224+0000","last_peered":"2023-03-27T10:11:02.603224+0000","last_clean":"2023-03-27T10:11:02.603224+0000","last_became_active":"2023-03-27T10:11:02.595611+0000","last_became_peered":"2023-03-27T10:11:02.595611+0000","last_unstale":"2023-03-27T10:11:02.603224+0000","last_undegraded":"2023-03-27T10:11:02.603224+0000","last_fullsized":"2023-03-27T10:11:02.603224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:53:11.976085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.588260+0000","last_change":"2023-03-27T10:11:02.113875+0000","last_active":"2023-03-27T10:11:02.588260+0000","last_peered":"2023-03-27T10:11:02.588260+0000","last_clean":"2023-03-27T10:11:02.588260+0000","last_became_active":"2023-03-27T10:11:02.113523+0000","last_became_peered":"2023-03-27T10:11:02.113523+0000","last_unstale":"2023-03-27T10:11:02.588260+0000","last_undegraded":"2023-03-27T10:11:02.588260+0000","last_fullsized":"2023-03-27T10:11:02.588260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T16:52:53.616013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.105173+0000","last_change":"2023-03-27T10:09:46.107100+0000","last_active":"2023-03-27T10:11:02.105173+0000","last_peered":"2023-03-27T10:11:02.105173+0000","last_clean":"2023-03-27T10:11:02.105173+0000","last_became_active":"2023-03-27T10:09:46.106766+0000","last_became_peered":"2023-03-27T10:09:46.106766+0000","last_unstale":"2023-03-27T10:11:02.105173+0000","last_undegraded":"2023-03-27T10:11:02.105173+0000","last_fullsized":"2023-03-27T10:11:02.105173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T10:44:01.238487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.606719+0000","last_change":"2023-03-27T10:11:02.599357+0000","last_active":"2023-03-27T10:11:02.606719+0000","last_peered":"2023-03-27T10:11:02.606719+0000","last_clean":"2023-03-27T10:11:02.606719+0000","last_became_active":"2023-03-27T10:11:02.599041+0000","last_became_peered":"2023-03-27T10:11:02.599041+0000","last_unstale":"2023-03-27T10:11:02.606719+0000","last_undegraded":"2023-03-27T10:11:02.606719+0000","last_fullsized":"2023-03-27T10:11:02.606719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:06:19.061523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.581739+0000","last_change":"2023-03-27T10:11:02.110351+0000","last_active":"2023-03-27T10:11:02.581739+0000","last_peered":"2023-03-27T10:11:02.581739+0000","last_clean":"2023-03-27T10:11:02.581739+0000","last_became_active":"2023-03-27T10:11:02.110094+0000","last_became_peered":"2023-03-27T10:11:02.110094+0000","last_unstale":"2023-03-27T10:11:02.581739+0000","last_undegraded":"2023-03-27T10:11:02.581739+0000","last_fullsized":"2023-03-27T10:11:02.581739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T17:53:10.969579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.105347+0000","last_change":"2023-03-27T10:09:46.108779+0000","last_active":"2023-03-27T10:11:02.105347+0000","last_peered":"2023-03-27T10:11:02.105347+0000","last_clean":"2023-03-27T10:11:02.105347+0000","last_became_active":"2023-03-27T10:09:46.108307+0000","last_became_peered":"2023-03-27T10:09:46.108307+0000","last_unstale":"2023-03-27T10:11:02.105347+0000","last_undegraded":"2023-03-27T10:11:02.105347+0000","last_fullsized":"2023-03-27T10:11:02.105347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T18:22:29.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.603244+0000","last_change":"2023-03-27T10:11:02.596101+0000","last_active":"2023-03-27T10:11:02.603244+0000","last_peered":"2023-03-27T10:11:02.603244+0000","last_clean":"2023-03-27T10:11:02.603244+0000","last_became_active":"2023-03-27T10:11:02.595825+0000","last_became_peered":"2023-03-27T10:11:02.595825+0000","last_unstale":"2023-03-27T10:11:02.603244+0000","last_undegraded":"2023-03-27T10:11:02.603244+0000","last_fullsized":"2023-03-27T10:11:02.603244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:02.084175+0000","last_clean_scrub_stamp":"2023-03-27T10:11:02.084175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:20:18.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.575275+0000","last_change":"2023-03-27T10:11:02.110788+0000","last_active":"2023-03-27T10:11:02.575275+0000","last_peered":"2023-03-27T10:11:02.575275+0000","last_clean":"2023-03-27T10:11:02.575275+0000","last_became_active":"2023-03-27T10:11:02.110510+0000","last_became_peered":"2023-03-27T10:11:02.110510+0000","last_unstale":"2023-03-27T10:11:02.575275+0000","last_undegraded":"2023-03-27T10:11:02.575275+0000","last_fullsized":"2023-03-27T10:11:02.575275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:11:01.077669+0000","last_clean_scrub_stamp":"2023-03-27T10:11:01.077669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T19:42:09.406356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-03-27T10:11:02.099461+0000","last_change":"2023-03-27T10:09:46.108791+0000","last_active":"2023-03-27T10:11:02.099461+0000","last_peered":"2023-03-27T10:11:02.099461+0000","last_clean":"2023-03-27T10:11:02.099461+0000","last_became_active":"2023-03-27T10:09:46.108203+0000","last_became_peered":"2023-03-27T10:09:46.108203+0000","last_unstale":"2023-03-27T10:11:02.099461+0000","last_undegraded":"2023-03-27T10:11:02.099461+0000","last_fullsized":"2023-03-27T10:11:02.099461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-27T10:09:45.086432+0000","last_clean_scrub_stamp":"2023-03-27T10:09:45.086432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-28T14:35:33.397723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8436,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363404,"statfs":{"total":96636764160,"available":96628125696,"internally_reserved":0,"allocated":438272,"data_stored":179837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.379},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.92300000000000004}]},{"osd":5,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.872}]},{"osd":7,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88800000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9500,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362340,"statfs":{"total":96636764160,"available":96627036160,"internally_reserved":0,"allocated":1003520,"data_stored":756354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.72099999999999997}]},{"osd":2,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":6.351,"5min":6.351,"15min":6.351},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48699999999999999}]},{"osd":6,"last update":"Mon Mar 27 10:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.5},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":173204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.316},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.38}]},{"osd":2,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.498},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.41199999999999998}]},{"osd":4,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.62}]},{"osd":6,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9436,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362404,"statfs":{"total":96636764160,"available":96627101696,"internally_reserved":0,"allocated":1003520,"data_stored":756354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":5.141,"5min":5.141,"15min":5.141},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.495}]},{"osd":3,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.9430000000000001,"5min":2.9430000000000001,"15min":2.9430000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.80600000000000005}]},{"osd":5,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95999999999999996}]},{"osd":6,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":0.749}]},{"osd":7,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.899,"5min":2.899,"15min":2.899},"last":0.82299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":174696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.39700000000000002}]},{"osd":4,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.58499999999999996}]},{"osd":5,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.626},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.327,"5min":2.327,"15min":2.327},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.67800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":430080,"data_stored":173702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48599999999999999}]},{"osd":7,"last update":"Mon Mar 27 10:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8492,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363348,"statfs":{"total":96636764160,"available":96628068352,"internally_reserved":0,"allocated":430080,"data_stored":173226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.157,"5min":12.157,"15min":12.157},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Mar 27 10:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.749}]},{"osd":3,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.72599999999999998}]},{"osd":4,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.78000000000000003}]},{"osd":7,"last update":"Mon Mar 27 10:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8360,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363480,"statfs":{"total":96636764160,"available":96628203520,"internally_reserved":0,"allocated":425984,"data_stored":173680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53200000000000003}]},{"osd":1,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.4540000000000002,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.55600000000000005}]},{"osd":3,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Mar 27 10:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-27T10:11:07.363 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-27T10:11:07.363 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-03-27T10:11:07.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.588+0000 7ff5123ff700 1 Processor -- start 2023-03-27T10:11:07.587 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.588+0000 7ff5123ff700 1 -- start start 2023-03-27T10:11:07.588 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.589+0000 7ff5123ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff50c0ce270 0x7ff50c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.589+0000 7ff5123ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0cb940 con 0x7ff50c15c620 2023-03-27T10:11:07.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.589+0000 7ff5123ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0cc780 con 0x7ff50c06b2b0 2023-03-27T10:11:07.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.589+0000 7ff5123ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c0ce6e0 con 0x7ff50c0ce270 2023-03-27T10:11:07.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.589+0000 7ff50bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff50c15c620 0x7ff50c0ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60634/0 (socket says 172.21.15.172:60634) 2023-03-27T10:11:07.589 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.589+0000 7ff50bfff700 1 -- 172.21.15.172:0/3241692606 learned_addr learned my addr 172.21.15.172:0/3241692606 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:07.590 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50b7fe700 1 --2- 172.21.15.172:0/3241692606 >> v2:172.21.15.191:3300/0 conn(0x7ff50c0ce270 0x7ff50c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50affd700 1 -- 172.21.15.172:0/3241692606 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386338195 0 0) 0x7ff50c0cb940 con 0x7ff50c15c620 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50affd700 1 -- 172.21.15.172:0/3241692606 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f40035b0 con 0x7ff50c15c620 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50b7fe700 1 -- 172.21.15.172:0/3241692606 >> v1:172.21.15.191:6789/0 conn(0x7ff50c06b2b0 legacy=0x7ff50c0ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50b7fe700 1 -- 172.21.15.172:0/3241692606 >> v1:172.21.15.172:6789/0 conn(0x7ff50c15c620 legacy=0x7ff50c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50b7fe700 1 -- 172.21.15.172:0/3241692606 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c15c9f0 con 0x7ff50c0ce270 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.590+0000 7ff50b7fe700 1 --2- 172.21.15.172:0/3241692606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c0cb400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff500009840 tx=0x7ff500009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=270f4b9a9e1c9586 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:07.591 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff50affd700 1 -- 172.21.15.172:0/3241692606 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500011830 con 0x7ff50c0ce270 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff50affd700 1 -- 172.21.15.172:0/3241692606 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500011990 con 0x7ff50c0ce270 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff50affd700 1 -- 172.21.15.172:0/3241692606 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500011d20 con 0x7ff50c0ce270 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 -- 172.21.15.172:0/3241692606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 msgr2=0x7ff50c0cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 --2- 172.21.15.172:0/3241692606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c0cb400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff500009840 tx=0x7ff500009b50 comp rx=0 tx=0).stop 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 -- 172.21.15.172:0/3241692606 shutdown_connections 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 --2- 172.21.15.172:0/3241692606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c0cb400 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 -- 172.21.15.172:0/3241692606 >> 172.21.15.172:0/3241692606 conn(0x7ff50c072230 msgr2=0x7ff50c06aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:07.592 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 -- 172.21.15.172:0/3241692606 shutdown_connections 2023-03-27T10:11:07.593 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.591+0000 7ff5123ff700 1 -- 172.21.15.172:0/3241692606 wait complete. 2023-03-27T10:11:07.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.593+0000 7ff5123ff700 1 Processor -- start 2023-03-27T10:11:07.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.593+0000 7ff5123ff700 1 -- start start 2023-03-27T10:11:07.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff5123ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff50c06b2b0 0x7ff50c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff5123ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.594 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff5123ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 0x7ff50c0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff5123ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c15bcb0 con 0x7ff50c15c620 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff5123ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c156160 con 0x7ff50c0ce270 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff5123ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0c5a70 con 0x7ff50c06b2b0 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff51099c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 0x7ff50c0b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff51099c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 0x7ff50c0b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45912/0 (socket says 172.21.15.172:45912) 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.594+0000 7ff51099c700 1 -- 172.21.15.172:0/370529111 learned_addr learned my addr 172.21.15.172:0/370529111 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:07.595 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff50b7fe700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff50bfff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff50c06b2b0 0x7ff50c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff51099c700 1 -- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff50c06b2b0 msgr2=0x7ff50c15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff51099c700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff50c06b2b0 0x7ff50c15b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff51099c700 1 -- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 msgr2=0x7ff50c155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff51099c700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.596 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff51099c700 1 -- 172.21.15.172:0/370529111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000094a0 con 0x7ff50c15c620 2023-03-27T10:11:07.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff51099c700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 0x7ff50c0b6530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff50400cc50 tx=0x7ff50400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:07.597 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400ad80 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400ce50 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c0cbe50 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504003c40 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.595+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c0cbb70 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.596+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c0cc130 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.597+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff504010050 con 0x7ff50c15c620 2023-03-27T10:11:07.598 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.598+0000 7ff508ff9700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff4f8066e30 0x7ff4f80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:07.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.598+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5040841b0 con 0x7ff50c15c620 2023-03-27T10:11:07.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.599+0000 7ff50bfff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff4f8066e30 0x7ff4f80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:07.599 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.599+0000 7ff50bfff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff4f8066e30 0x7ff4f80692e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0010e0 tx=0x7ff4fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:07.601 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.602+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff504051480 con 0x7ff50c15c620 2023-03-27T10:11:07.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.868+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff50c09a390 con 0x7ff50c15c620 2023-03-27T10:11:07.872 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.873+0000 7ff508ff9700 1 -- 172.21.15.172:0/370529111 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff504054aa0 con 0x7ff50c15c620 2023-03-27T10:11:07.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff4f8066e30 msgr2=0x7ff4f80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff4f8066e30 0x7ff4f80692e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0010e0 tx=0x7ff4fc009040 comp rx=0 tx=0).stop 2023-03-27T10:11:07.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 msgr2=0x7ff50c0b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:07.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 0x7ff50c0b6530 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff50400cc50 tx=0x7ff50400a340 comp rx=0 tx=0).stop 2023-03-27T10:11:07.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 shutdown_connections 2023-03-27T10:11:07.875 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff50c15c620 0x7ff50c0b6530 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff50c06b2b0 0x7ff50c15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff4f8066e30 0x7ff4f80692e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 --2- 172.21.15.172:0/370529111 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff50c0ce270 0x7ff50c155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:07.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 >> 172.21.15.172:0/370529111 conn(0x7ff50c072230 msgr2=0x7ff50c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:07.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 shutdown_connections 2023-03-27T10:11:07.876 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:07.875+0000 7ff5123ff700 1 -- 172.21.15.172:0/370529111 wait complete. 2023-03-27T10:11:07.877 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2023-03-27T10:11:07.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-27T10:11:08.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.078+0000 7f371b3ff700 1 Processor -- start 2023-03-27T10:11:08.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.078+0000 7f371b3ff700 1 -- start start 2023-03-27T10:11:08.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.079+0000 7f371b3ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37140b0050 0x7f37140ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.079+0000 7f371b3ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f371415a540 0x7f37140cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.079+0000 7f371b3ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140caa80 con 0x7f37140ce7d0 2023-03-27T10:11:08.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.079+0000 7f371b3ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37140c9570 con 0x7f37140b0050 2023-03-27T10:11:08.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.079+0000 7f371b3ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371415aa90 con 0x7f371415a540 2023-03-27T10:11:08.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371919b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f37140ce7d0 0x7f37140af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60648/0 (socket says 172.21.15.172:60648) 2023-03-27T10:11:08.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371919b700 1 -- 172.21.15.172:0/66421154 learned_addr learned my addr 172.21.15.172:0/66421154 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:08.080 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371899a700 1 --2- 172.21.15.172:0/66421154 >> v2:172.21.15.172:3300/0 conn(0x7f37140b0050 0x7f37140ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371999c700 1 --2- 172.21.15.172:0/66421154 >> v2:172.21.15.191:3300/0 conn(0x7f371415a540 0x7f37140cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.081 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f370bfff700 1 -- 172.21.15.172:0/66421154 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772024423 0 0) 0x7f37140caa80 con 0x7f37140ce7d0 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f370bfff700 1 -- 172.21.15.172:0/66421154 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37000035b0 con 0x7f37140ce7d0 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371899a700 1 -- 172.21.15.172:0/66421154 >> v2:172.21.15.191:3300/0 conn(0x7f371415a540 msgr2=0x7f37140cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371899a700 1 --2- 172.21.15.172:0/66421154 >> v2:172.21.15.191:3300/0 conn(0x7f371415a540 0x7f37140cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371899a700 1 -- 172.21.15.172:0/66421154 >> v1:172.21.15.172:6789/0 conn(0x7f37140ce7d0 legacy=0x7f37140af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371899a700 1 -- 172.21.15.172:0/66421154 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140c9780 con 0x7f37140b0050 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.080+0000 7f371899a700 1 --2- 172.21.15.172:0/66421154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37140b0050 0x7f37140ca540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f37140c9290 tx=0x7f3704009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6ad09f33a4bd1e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f370bfff700 1 -- 172.21.15.172:0/66421154 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704011830 con 0x7f37140b0050 2023-03-27T10:11:08.082 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f370bfff700 1 -- 172.21.15.172:0/66421154 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704011990 con 0x7f37140b0050 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f370bfff700 1 -- 172.21.15.172:0/66421154 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704011d20 con 0x7f37140b0050 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 -- 172.21.15.172:0/66421154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37140b0050 msgr2=0x7f37140ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 --2- 172.21.15.172:0/66421154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37140b0050 0x7f37140ca540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f37140c9290 tx=0x7f3704009b20 comp rx=0 tx=0).stop 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 -- 172.21.15.172:0/66421154 shutdown_connections 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 --2- 172.21.15.172:0/66421154 >> v2:172.21.15.191:3300/0 conn(0x7f371415a540 0x7f37140cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 --2- 172.21.15.172:0/66421154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37140b0050 0x7f37140ca540 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 -- 172.21.15.172:0/66421154 >> 172.21.15.172:0/66421154 conn(0x7f371406a1a0 msgr2=0x7f371406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.083 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 -- 172.21.15.172:0/66421154 shutdown_connections 2023-03-27T10:11:08.084 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.081+0000 7f371b3ff700 1 -- 172.21.15.172:0/66421154 wait complete. 2023-03-27T10:11:08.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.083+0000 7f371b3ff700 1 Processor -- start 2023-03-27T10:11:08.085 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.083+0000 7f371b3ff700 1 -- start start 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371b3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37140b0050 0x7f3714143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371b3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37140ce7d0 0x7f371406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371b3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 0x7f371406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371b3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140c7c70 con 0x7f371415a540 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371b3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37141f40c0 con 0x7f37140b0050 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371b3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37141544a0 con 0x7f37140ce7d0 2023-03-27T10:11:08.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371999c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 0x7f371406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371999c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 0x7f371406fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45934/0 (socket says 172.21.15.172:45934) 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.084+0000 7f371999c700 1 -- 172.21.15.172:0/3582621248 learned_addr learned my addr 172.21.15.172:0/3582621248 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371919b700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37140b0050 0x7f3714143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371899a700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37140ce7d0 0x7f371406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371999c700 1 -- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37140ce7d0 msgr2=0x7f371406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371999c700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37140ce7d0 0x7f371406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371999c700 1 -- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37140b0050 msgr2=0x7f3714143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371999c700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37140b0050 0x7f3714143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371999c700 1 -- 172.21.15.172:0/3582621248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040094a0 con 0x7f371415a540 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371999c700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 0x7f371406fef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f370c007e40 tx=0x7f370c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c00ed30 con 0x7f371415a540 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c014420 con 0x7f371415a540 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140c9d40 con 0x7f371415a540 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.085+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0147d0 con 0x7f371415a540 2023-03-27T10:11:08.088 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.086+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37140c9a60 con 0x7f371415a540 2023-03-27T10:11:08.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.087+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37140ca020 con 0x7f371415a540 2023-03-27T10:11:08.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.087+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f370c012050 con 0x7f371415a540 2023-03-27T10:11:08.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.088+0000 7f3709ffb700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f36f8066e30 0x7f36f80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.088+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f370c084830 con 0x7f371415a540 2023-03-27T10:11:08.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.089+0000 7f371919b700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f36f8066e30 0x7f36f80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.089+0000 7f371919b700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f36f8066e30 0x7f36f80692e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3710007fd0 tx=0x7f3710009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.092+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7f370c051a70 con 0x7f371415a540 2023-03-27T10:11:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.321+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37140c7db0 con 0x7f371415a540 2023-03-27T10:11:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.322+0000 7f3709ffb700 1 -- 172.21.15.172:0/3582621248 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f37140c7db0 con 0x7f371415a540 2023-03-27T10:11:08.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:08.322 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4730,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/582352933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":582352933},{"type":"v1","addr":"172.21.15.172:6834","nonce":582352933}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3004564680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":3004564680},{"type":"v1","addr":"172.21.15.191:6835","nonce":3004564680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4742,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/288487287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":288487287},{"type":"v1","addr":"172.21.15.191:6837","nonce":288487287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-27T10:11:02.571096+0000","modified":"2023-03-27T10:11:05.598205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/352432093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":352432093},{"type":"v1","addr":"172.21.15.172:6835","nonce":352432093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-27T10:11:08.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f36f8066e30 msgr2=0x7f36f80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f36f8066e30 0x7f36f80692e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3710007fd0 tx=0x7f3710009040 comp rx=0 tx=0).stop 2023-03-27T10:11:08.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 msgr2=0x7f371406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.324 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 0x7f371406fef0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f370c007e40 tx=0x7f370c00e3c0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 shutdown_connections 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f371415a540 0x7f371406fef0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f36f8066e30 0x7f36f80692e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37140b0050 0x7f3714143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 --2- 172.21.15.172:0/3582621248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37140ce7d0 0x7f371406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.324+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 >> 172.21.15.172:0/3582621248 conn(0x7f371406a1a0 msgr2=0x7f37141536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.325+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 shutdown_connections 2023-03-27T10:11:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.325+0000 7f371b3ff700 1 -- 172.21.15.172:0/3582621248 wait complete. 2023-03-27T10:11:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 16 2023-03-27T10:11:08.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-27T10:11:02.571096+0000', 'modified': '2023-03-27T10:11:05.598205+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4990}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4990': {'gid': 4990, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6835/352432093', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6833', 'nonce': 352432093}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 352432093}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-27T10:11:08.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-27T10:11:08.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-03-27T10:11:08.929 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.929+0000 7f4714bff700 1 Processor -- start 2023-03-27T10:11:08.930 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.929+0000 7f4714bff700 1 -- start start 2023-03-27T10:11:08.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4714bff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f47100ce270 0x7f47100cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4714bff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f471006b2b0 0x7f471006b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.933 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4714bff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47100cb940 con 0x7f471015c620 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4714bff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47100ce6e0 con 0x7f471006b2b0 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4714bff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471006bc70 con 0x7f47100ce270 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470ed9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f471006b2b0 0x7f471006b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470e59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f471015c620 0x7f47100ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60658/0 (socket says 172.21.15.172:60658) 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470e59c700 1 -- 172.21.15.172:0/4153459794 learned_addr learned my addr 172.21.15.172:0/4153459794 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4707fff700 1 --2- 172.21.15.172:0/4153459794 >> v2:172.21.15.191:3300/0 conn(0x7f47100ce270 0x7f47100cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.934 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470ed9d700 1 -- 172.21.15.172:0/4153459794 >> v2:172.21.15.191:3300/0 conn(0x7f47100ce270 msgr2=0x7f47100cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470ed9d700 1 --2- 172.21.15.172:0/4153459794 >> v2:172.21.15.191:3300/0 conn(0x7f47100ce270 0x7f47100cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470ed9d700 1 -- 172.21.15.172:0/4153459794 >> v1:172.21.15.172:6789/0 conn(0x7f471015c620 legacy=0x7f47100ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470ed9d700 1 -- 172.21.15.172:0/4153459794 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100cc780 con 0x7f471006b2b0 2023-03-27T10:11:08.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f4707fff700 1 --2- 172.21.15.172:0/4153459794 >> v2:172.21.15.191:3300/0 conn(0x7f47100ce270 0x7f47100cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:11:08.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.931+0000 7f470dd9b700 1 -- 172.21.15.172:0/4153459794 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886422678 0 0) 0x7f47100cb940 con 0x7f471015c620 2023-03-27T10:11:08.935 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.932+0000 7f470ed9d700 1 --2- 172.21.15.172:0/4153459794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471006b2b0 0x7f471006b730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f47100715e0 tx=0x7f470800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f2b9306ef124dc server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.932+0000 7f470dd9b700 1 -- 172.21.15.172:0/4153459794 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800e070 con 0x7f471006b2b0 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.932+0000 7f470dd9b700 1 -- 172.21.15.172:0/4153459794 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800bbd0 con 0x7f471006b2b0 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.932+0000 7f470dd9b700 1 -- 172.21.15.172:0/4153459794 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708012430 con 0x7f471006b2b0 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.932+0000 7f4714bff700 1 -- 172.21.15.172:0/4153459794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471006b2b0 msgr2=0x7f471006b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.932+0000 7f4714bff700 1 --2- 172.21.15.172:0/4153459794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471006b2b0 0x7f471006b730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f47100715e0 tx=0x7f470800b330 comp rx=0 tx=0).stop 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.933+0000 7f4714bff700 1 -- 172.21.15.172:0/4153459794 shutdown_connections 2023-03-27T10:11:08.936 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.933+0000 7f4714bff700 1 --2- 172.21.15.172:0/4153459794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471006b2b0 0x7f471006b730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.937 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.933+0000 7f4714bff700 1 --2- 172.21.15.172:0/4153459794 >> v2:172.21.15.191:3300/0 conn(0x7f47100ce270 0x7f47100cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.937 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.933+0000 7f4714bff700 1 -- 172.21.15.172:0/4153459794 >> 172.21.15.172:0/4153459794 conn(0x7f4710072230 msgr2=0x7f471006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.937 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.933+0000 7f4714bff700 1 -- 172.21.15.172:0/4153459794 shutdown_connections 2023-03-27T10:11:08.937 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.933+0000 7f4714bff700 1 -- 172.21.15.172:0/4153459794 wait complete. 2023-03-27T10:11:08.941 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.934+0000 7f4714bff700 1 Processor -- start 2023-03-27T10:11:08.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.934+0000 7f4714bff700 1 -- start start 2023-03-27T10:11:08.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.935+0000 7f4714bff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471006b2b0 0x7f47100cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.935+0000 7f4714bff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47100ce270 0x7f4710155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.942 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.935+0000 7f4714bff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 0x7f471006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.935+0000 7f4714bff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100b1c50 con 0x7f471015c620 2023-03-27T10:11:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.935+0000 7f4714bff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100b10d0 con 0x7f471006b2b0 2023-03-27T10:11:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.935+0000 7f4714bff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47100b13b0 con 0x7f47100ce270 2023-03-27T10:11:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 0x7f471006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 0x7f471006e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45952/0 (socket says 172.21.15.172:45952) 2023-03-27T10:11:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 -- 172.21.15.172:0/1819058338 learned_addr learned my addr 172.21.15.172:0/1819058338 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470e59c700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471006b2b0 0x7f47100cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f4707fff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47100ce270 0x7f4710155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 -- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47100ce270 msgr2=0x7f4710155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47100ce270 0x7f4710155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 -- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471006b2b0 msgr2=0x7f47100cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471006b2b0 0x7f47100cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 -- 172.21.15.172:0/1819058338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708009a70 con 0x7f471015c620 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f4707fff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47100ce270 0x7f4710155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470e59c700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471006b2b0 0x7f47100cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.936+0000 7f470ed9d700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 0x7f471006e3c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4710071700 tx=0x7f4708004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.937+0000 7f4706ffd700 1 -- 172.21.15.172:0/1819058338 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708012430 con 0x7f471015c620 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.937+0000 7f4706ffd700 1 -- 172.21.15.172:0/1819058338 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4708020070 con 0x7f471015c620 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.937+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47100cbb70 con 0x7f471015c620 2023-03-27T10:11:08.946 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.937+0000 7f4706ffd700 1 -- 172.21.15.172:0/1819058338 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708004280 con 0x7f471015c620 2023-03-27T10:11:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.937+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471015c9f0 con 0x7f471015c620 2023-03-27T10:11:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.939+0000 7f4706ffd700 1 -- 172.21.15.172:0/1819058338 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7f47080043e0 con 0x7f471015c620 2023-03-27T10:11:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.939+0000 7f4706ffd700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f46f0066e30 0x7f46f00692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.940+0000 7f4706ffd700 1 -- 172.21.15.172:0/1819058338 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4708022070 con 0x7f471015c620 2023-03-27T10:11:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.940+0000 7f470e59c700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f46f0066e30 0x7f46f00692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.941+0000 7f470e59c700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f46f0066e30 0x7f46f00692e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f47000017b0 tx=0x7f4700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.942+0000 7f472843bb80 1 Processor -- start 2023-03-27T10:11:08.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.942+0000 7f472843bb80 1 -- start start 2023-03-27T10:11:08.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f472843bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b79b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b76e2b0 0x55e00b7b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.956 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f472843bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b659c40 con 0x55e00b79ad80 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b6c8bb0 con 0x55e00b770ef0 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b6c1f20 con 0x55e00b76e2b0 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f470e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b79b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f470e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b79b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45954/0 (socket says 172.21.15.172:45954) 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f470e59c700 1 -- 172.21.15.172:0/2939018780 learned_addr learned my addr 172.21.15.172:0/2939018780 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:08.957 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f470ed9d700 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.943+0000 7f4707fff700 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b76e2b0 0x55e00b7b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f470e59c700 1 -- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b76e2b0 msgr2=0x55e00b7b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f470e59c700 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b76e2b0 0x55e00b7b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f470e59c700 1 -- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 msgr2=0x55e00b7b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f470e59c700 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f470e59c700 1 -- 172.21.15.172:0/2939018780 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00b4b6540 con 0x55e00b79ad80 2023-03-27T10:11:08.958 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f470e59c700 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b79b150 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f47000071b0 tx=0x7f4700011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ce63165e5f3d34 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f46effff700 1 -- 172.21.15.172:0/2939018780 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4700005b40 con 0x55e00b79ad80 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f46effff700 1 -- 172.21.15.172:0/2939018780 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700005ca0 con 0x55e00b79ad80 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.944+0000 7f46effff700 1 -- 172.21.15.172:0/2939018780 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470000e850 con 0x55e00b79ad80 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 -- 172.21.15.172:0/2939018780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 msgr2=0x55e00b79b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b79b150 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f47000071b0 tx=0x7f4700011000 comp rx=0 tx=0).stop 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 -- 172.21.15.172:0/2939018780 shutdown_connections 2023-03-27T10:11:08.959 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b79b150 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 --2- 172.21.15.172:0/2939018780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b76e2b0 0x55e00b7b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 -- 172.21.15.172:0/2939018780 >> 172.21.15.172:0/2939018780 conn(0x55e00b765840 msgr2=0x55e00b76ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 -- 172.21.15.172:0/2939018780 shutdown_connections 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.945+0000 7f472843bb80 1 -- 172.21.15.172:0/2939018780 wait complete. 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.946+0000 7f472843bb80 1 -- start start 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.946+0000 7f472843bb80 1 Processor -- start 2023-03-27T10:11:08.960 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b79e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 0x55e00b7849e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 0x55e00b7bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b4b7140 con 0x55e00b770ef0 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b7855b0 con 0x55e00b76e2b0 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b79d630 con 0x55e00b79ad80 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f472843bb80 10 client.0 _ll_register_callbacks cb 0x55e00b6ca450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-27T10:11:08.961 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 0x55e00b7849e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.962 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 0x55e00b7849e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45964/0 (socket says 172.21.15.172:45964) 2023-03-27T10:11:08.962 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 -- 172.21.15.172:0/1429196647 learned_addr learned my addr 172.21.15.172:0/1429196647 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:08.962 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 -- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 msgr2=0x55e00b7bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.962 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 0x55e00b7bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.962 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 -- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 msgr2=0x55e00b79e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.962 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f470e59c700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b79e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.947+0000 7f4707fff700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b79e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f4707fff700 1 -- 172.21.15.172:0/1429196647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470000f040 con 0x55e00b770ef0 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f470e59c700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b79e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f4707fff700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 0x55e00b7849e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4710156b00 tx=0x7f46f8010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3315fb29057573 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f46ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f46ed7fa700 1 -- 172.21.15.172:0/1429196647 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8016750 con 0x55e00b770ef0 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e00b762e50 con 0x55e00b770ef0 2023-03-27T10:11:08.963 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f46ed7fa700 1 -- 172.21.15.172:0/1429196647 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46f80168b0 con 0x55e00b770ef0 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f46ed7fa700 1 -- 172.21.15.172:0/1429196647 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46f8016a70 con 0x55e00b770ef0 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f472843bb80 10 client.5337 fetch_fsmap learned FSMap version 16 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e00b4f0b10 con 0x55e00b770ef0 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.948+0000 7f46ed7fa700 1 -- 172.21.15.172:0/1429196647 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e00b762e50 con 0x55e00b770ef0 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f46ed7fa700 1 -- 172.21.15.172:0/1429196647 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f46f8016bd0 con 0x55e00b770ef0 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f472843bb80 10 client.5337 fetch_fsmap finished waiting for FSMap version 16 2023-03-27T10:11:08.964 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f472843bb80 10 client.5337 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f472843bb80 20 client.5337 populate_metadata read hostname 'smithi172' 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f472843bb80 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b7b3e30 0x55e00b79bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f472843bb80 4 client.5337 mds_command: new command op to 4990 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 --> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e00b73fae0 con 0x55e00b7b3e30 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f470e59c700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b7b3e30 0x55e00b79bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f46ed7fa700 10 client.5337 ms_handle_connect on v2:172.21.15.172:6833/352432093 2023-03-27T10:11:08.965 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.949+0000 7f470e59c700 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b7b3e30 0x55e00b79bd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=965f4d61bc27ea1e server_cookie=427d0fb53731741e in_seq=0 out_seq=0 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f46ed7fa700 1 -- 172.21.15.172:0/1429196647 <== mds.0 v2:172.21.15.172:6833/352432093 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55e00b73fae0 con 0x55e00b7b3e30 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f46ed7fa700 10 client.5337 handle_command_reply: tid=0 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 client.5337 shutdown 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 msgr2=0x55e00b7849e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 0x55e00b7849e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4710156b00 tx=0x7f46f8010950 comp rx=0 tx=0).stop 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 shutdown_connections 2023-03-27T10:11:08.966 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b7b3e30 0x55e00b79bd30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 0x55e00b7bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b79e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f46ed7fa700 0 client.5337 ms_handle_reset on v2:172.21.15.172:6833/352432093 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 --2- 172.21.15.172:0/1429196647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b770ef0 0x55e00b7849e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.950+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 >> 172.21.15.172:0/1429196647 conn(0x55e00b765840 msgr2=0x55e00b7b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.951+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 shutdown_connections 2023-03-27T10:11:08.967 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.951+0000 7f472843bb80 1 -- 172.21.15.172:0/1429196647 wait complete. 2023-03-27T10:11:08.968 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.951+0000 7f472843bb80 20 client.5337 trim_cache size 0 max 16384 2023-03-27T10:11:08.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.968+0000 7f472843bb80 1 Processor -- start 2023-03-27T10:11:08.969 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.968+0000 7f472843bb80 1 -- start start 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f472843bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 0x55e00b7bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 0x55e00b7b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f472843bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b7bb2f0 con 0x55e00b76e2b0 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b79a850 con 0x55e00b770ef0 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b7b7650 con 0x55e00b79ad80 2023-03-27T10:11:08.970 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f470e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 0x55e00b7bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f470e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 0x55e00b7bd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45974/0 (socket says 172.21.15.172:45974) 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.969+0000 7f470e59c700 1 -- 172.21.15.172:0/768845656 learned_addr learned my addr 172.21.15.172:0/768845656 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f470e59c700 1 -- 172.21.15.172:0/768845656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 msgr2=0x55e00b7b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f470e59c700 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 0x55e00b7b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f470e59c700 1 -- 172.21.15.172:0/768845656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 msgr2=0x55e00b7b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f470e59c700 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.971 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f470e59c700 1 -- 172.21.15.172:0/768845656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00b689230 con 0x55e00b76e2b0 2023-03-27T10:11:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f470e59c700 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 0x55e00b7bd170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4700007180 tx=0x7f4700017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daaccb41a2100c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f4704ff9700 1 -- 172.21.15.172:0/768845656 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470002d2d0 con 0x55e00b76e2b0 2023-03-27T10:11:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f4704ff9700 1 -- 172.21.15.172:0/768845656 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470002d670 con 0x55e00b76e2b0 2023-03-27T10:11:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.970+0000 7f4704ff9700 1 -- 172.21.15.172:0/768845656 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470002d7e0 con 0x55e00b76e2b0 2023-03-27T10:11:08.975 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 -- 172.21.15.172:0/768845656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 msgr2=0x55e00b7bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 0x55e00b7bd170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4700007180 tx=0x7f4700017070 comp rx=0 tx=0).stop 2023-03-27T10:11:08.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 -- 172.21.15.172:0/768845656 shutdown_connections 2023-03-27T10:11:08.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b79ad80 0x55e00b7b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b76e2b0 0x55e00b7bd170 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 --2- 172.21.15.172:0/768845656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b770ef0 0x55e00b7b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.976 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 -- 172.21.15.172:0/768845656 >> 172.21.15.172:0/768845656 conn(0x55e00b765840 msgr2=0x55e00b76bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 -- 172.21.15.172:0/768845656 shutdown_connections 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 -- 172.21.15.172:0/768845656 wait complete. 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.971+0000 7f472843bb80 1 -- start start 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.972+0000 7f472843bb80 1 Processor -- start 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b803d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b770ef0 0x55e00b7bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.977 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b7b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b7d26a0 con 0x55e00b79ad80 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b81bec0 con 0x55e00b76e2b0 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b786480 con 0x55e00b770ef0 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f472843bb80 10 client.0 _ll_register_callbacks cb 0x55e00b6ca450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b7b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b7b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45982/0 (socket says 172.21.15.172:45982) 2023-03-27T10:11:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 -- 172.21.15.172:0/4004039874 learned_addr learned my addr 172.21.15.172:0/4004039874 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f4707fff700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b770ef0 0x55e00b7bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470e59c700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b803d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 -- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b770ef0 msgr2=0x55e00b7bd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b770ef0 0x55e00b7bd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 -- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 msgr2=0x55e00b803d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b803d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 -- 172.21.15.172:0/4004039874 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e00b4b6540 con 0x55e00b79ad80 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f4707fff700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b770ef0 0x55e00b7bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470e59c700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b803d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f470ed9d700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b7b7bd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f470800b8b0 tx=0x7f4708057e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e6e7957542e354 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.973+0000 7f46ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f46ed7fa700 1 -- 172.21.15.172:0/4004039874 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708004670 con 0x55e00b79ad80 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f46ed7fa700 1 -- 172.21.15.172:0/4004039874 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47080047d0 con 0x55e00b79ad80 2023-03-27T10:11:08.980 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4700005ca0 con 0x55e00b79ad80 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f46ed7fa700 1 -- 172.21.15.172:0/4004039874 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4708053520 con 0x55e00b79ad80 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 10 client.5343 fetch_fsmap learned FSMap version 16 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e00b4d9990 con 0x55e00b79ad80 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f46ed7fa700 1 -- 172.21.15.172:0/4004039874 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4700005ca0 con 0x55e00b79ad80 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f46ed7fa700 1 -- 172.21.15.172:0/4004039874 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f4708083020 con 0x55e00b79ad80 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 10 client.5343 fetch_fsmap finished waiting for FSMap version 16 2023-03-27T10:11:08.981 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 10 client.5343 resolve_mds: resolved name 'c' to daemon mds.c 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 20 client.5343 populate_metadata read hostname 'smithi172' 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b79bc40 0x55e00b79c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 4 client.5343 mds_command: new command op to 4990 tid=0[{"prefix": "status"}] 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 --> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e00b6bb100 con 0x55e00b79bc40 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.974+0000 7f470e59c700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b79bc40 0x55e00b79c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f470e59c700 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b79bc40 0x55e00b79c010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10a51c834d51db3d server_cookie=309f7a7ca9c7d2a9 in_seq=0 out_seq=0 2023-03-27T10:11:08.982 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f46ed7fa700 10 client.5343 ms_handle_connect on v2:172.21.15.172:6833/352432093 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f46ed7fa700 1 -- 172.21.15.172:0/4004039874 <== mds.0 v2:172.21.15.172:6833/352432093 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e00b6bb100 con 0x55e00b79bc40 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f46ed7fa700 10 client.5343 handle_command_reply: tid=0 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 client.5343 shutdown 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 msgr2=0x55e00b7b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b7b7bd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f470800b8b0 tx=0x7f4708057e80 comp rx=0 tx=0).stop 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 shutdown_connections 2023-03-27T10:11:08.983 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:6833/352432093,v1:172.21.15.172:6835/352432093] conn(0x55e00b79bc40 0x55e00b79c010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e00b79ad80 0x55e00b7b7bd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e00b76e2b0 0x55e00b803d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 --2- 172.21.15.172:0/4004039874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e00b770ef0 0x55e00b7bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f46ed7fa700 0 client.5343 ms_handle_reset on v2:172.21.15.172:6833/352432093 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.975+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 >> 172.21.15.172:0/4004039874 conn(0x55e00b765840 msgr2=0x55e00b7bcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 shutdown_connections 2023-03-27T10:11:08.984 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f472843bb80 1 -- 172.21.15.172:0/4004039874 wait complete. 2023-03-27T10:11:08.985 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f472843bb80 20 client.5343 trim_cache size 0 max 16384 2023-03-27T10:11:08.985 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-03-27T10:11:08.985 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "b9fe5031-957d-4f6c-a6ac-e7da3c176686", 2023-03-27T10:11:08.985 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2023-03-27T10:11:08.985 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4990, 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 6.4021272160000002, 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 16, 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 38, 2023-03-27T10:11:08.986 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 38, 2023-03-27T10:11:08.987 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 15.979154102000001 2023-03-27T10:11:08.987 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-03-27T10:11:08.987 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f46f0066e30 msgr2=0x7f46f00692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f46f0066e30 0x7f46f00692e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f47000017b0 tx=0x7f4700009040 comp rx=0 tx=0).stop 2023-03-27T10:11:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 msgr2=0x7f471006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 0x7f471006e3c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4710071700 tx=0x7f4708004ad0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 shutdown_connections 2023-03-27T10:11:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f471015c620 0x7f471006e3c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7f46f0066e30 0x7f46f00692e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f471006b2b0 0x7f47100cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 --2- 172.21.15.172:0/1819058338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47100ce270 0x7f4710155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:08.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 >> 172.21.15.172:0/1819058338 conn(0x7f4710072230 msgr2=0x7f47100ad940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:08.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 shutdown_connections 2023-03-27T10:11:08.989 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:08.976+0000 7f4714bff700 1 -- 172.21.15.172:0/1819058338 wait complete. 2023-03-27T10:11:08.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-27T10:11:09.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.178+0000 7fddcb7ff700 1 Processor -- start 2023-03-27T10:11:09.178 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.178+0000 7fddcb7ff700 1 -- start start 2023-03-27T10:11:09.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddcb7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc415c6f0 0x7fddc40cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.182 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddcb7ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fddc4065e30 0x7fddc4160b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddcb7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fddc4161040 0x7fddc40b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddcb7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40cb360 con 0x7fddc4161040 2023-03-27T10:11:09.183 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddcb7ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc4160390 con 0x7fddc4065e30 2023-03-27T10:11:09.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddcb7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4160670 con 0x7fddc415c6f0 2023-03-27T10:11:09.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddc9d9c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fddc4161040 0x7fddc40b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddc9d9c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fddc4161040 0x7fddc40b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45990/0 (socket says 172.21.15.172:45990) 2023-03-27T10:11:09.184 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.179+0000 7fddc9d9c700 1 -- 172.21.15.172:0/993314029 learned_addr learned my addr 172.21.15.172:0/993314029 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:09.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc8d9a700 1 --2- 172.21.15.172:0/993314029 >> v2:172.21.15.191:3300/0 conn(0x7fddc4065e30 0x7fddc4160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc959b700 1 --2- 172.21.15.172:0/993314029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc415c6f0 0x7fddc40cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc9d9c700 1 -- 172.21.15.172:0/993314029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc415c6f0 msgr2=0x7fddc40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:09.185 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc9d9c700 1 --2- 172.21.15.172:0/993314029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc415c6f0 0x7fddc40cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc9d9c700 1 -- 172.21.15.172:0/993314029 >> v2:172.21.15.191:3300/0 conn(0x7fddc4065e30 msgr2=0x7fddc4160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:09.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc9d9c700 1 --2- 172.21.15.172:0/993314029 >> v2:172.21.15.191:3300/0 conn(0x7fddc4065e30 0x7fddc4160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc9d9c700 1 -- 172.21.15.172:0/993314029 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40cb570 con 0x7fddc4161040 2023-03-27T10:11:09.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddc9d9c700 1 --2- 172.21.15.172:0/993314029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc4161040 0x7fddc40b0f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fddc406bff0 tx=0x7fddbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feedc75c5dc3cdde server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:09.187 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddbbfff700 1 -- 172.21.15.172:0/993314029 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e070 con 0x7fddc4161040 2023-03-27T10:11:09.187 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddbbfff700 1 -- 172.21.15.172:0/993314029 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00b910 con 0x7fddc4161040 2023-03-27T10:11:09.187 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.180+0000 7fddbbfff700 1 -- 172.21.15.172:0/993314029 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00bcc0 con 0x7fddc4161040 2023-03-27T10:11:09.187 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 -- 172.21.15.172:0/993314029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc4161040 msgr2=0x7fddc40b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:09.187 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/993314029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc4161040 0x7fddc40b0f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fddc406bff0 tx=0x7fddbc00b330 comp rx=0 tx=0).stop 2023-03-27T10:11:09.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 -- 172.21.15.172:0/993314029 shutdown_connections 2023-03-27T10:11:09.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/993314029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc4161040 0x7fddc40b0f30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/993314029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc415c6f0 0x7fddc40cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/993314029 >> v2:172.21.15.191:3300/0 conn(0x7fddc4065e30 0x7fddc4160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 -- 172.21.15.172:0/993314029 >> 172.21.15.172:0/993314029 conn(0x7fddc40cbf30 msgr2=0x7fddc40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:09.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 -- 172.21.15.172:0/993314029 shutdown_connections 2023-03-27T10:11:09.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.181+0000 7fddcb7ff700 1 -- 172.21.15.172:0/993314029 wait complete. 2023-03-27T10:11:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.184+0000 7fddcb7ff700 1 Processor -- start 2023-03-27T10:11:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.184+0000 7fddcb7ff700 1 -- start start 2023-03-27T10:11:09.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddcb7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc4065e30 0x7fddc40c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddcb7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 0x7fddc40c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddcb7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddc4161040 0x7fddc40b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddcb7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40b3530 con 0x7fddc415c6f0 2023-03-27T10:11:09.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddcb7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40c79c0 con 0x7fddc4161040 2023-03-27T10:11:09.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddcb7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40c7ca0 con 0x7fddc4065e30 2023-03-27T10:11:09.196 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddc8d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 0x7fddc40c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddc8d9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 0x7fddc40c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45994/0 (socket says 172.21.15.172:45994) 2023-03-27T10:11:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddc8d9a700 1 -- 172.21.15.172:0/3509319692 learned_addr learned my addr 172.21.15.172:0/3509319692 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:09.197 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddc959b700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc4065e30 0x7fddc40c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.185+0000 7fddc9d9c700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddc4161040 0x7fddc40b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddc8d9a700 1 -- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc4065e30 msgr2=0x7fddc40c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddc8d9a700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc4065e30 0x7fddc40c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.198 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddc8d9a700 1 -- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddc4161040 msgr2=0x7fddc40b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:09.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddc8d9a700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddc4161040 0x7fddc40b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.199 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddc8d9a700 1 -- 172.21.15.172:0/3509319692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc009b30 con 0x7fddc415c6f0 2023-03-27T10:11:09.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddc8d9a700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 0x7fddc40c2fb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fddb400e870 tx=0x7fddb400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:09.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4013680 con 0x7fddc415c6f0 2023-03-27T10:11:09.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb40137e0 con 0x7fddc415c6f0 2023-03-27T10:11:09.200 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc40cbb30 con 0x7fddc415c6f0 2023-03-27T10:11:09.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4013b90 con 0x7fddc415c6f0 2023-03-27T10:11:09.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.186+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc40cb850 con 0x7fddc415c6f0 2023-03-27T10:11:09.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.187+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc40662a0 con 0x7fddc415c6f0 2023-03-27T10:11:09.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.188+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fddb4019030 con 0x7fddc415c6f0 2023-03-27T10:11:09.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.189+0000 7fddb9ffb700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdda8066e30 0x7fdda80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:09.201 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.189+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddb4083f40 con 0x7fddc415c6f0 2023-03-27T10:11:09.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.190+0000 7fddc959b700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdda8066e30 0x7fdda80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:09.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.190+0000 7fddc959b700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdda8066e30 0x7fdda80692e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009b40 tx=0x7fddc0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:09.202 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.193+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fddb4051120 con 0x7fddc415c6f0 2023-03-27T10:11:09.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.422+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fddc40ce890 con 0x7fddc415c6f0 2023-03-27T10:11:09.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.422+0000 7fddb9ffb700 1 -- 172.21.15.172:0/3509319692 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fddb4054740 con 0x7fddc415c6f0 2023-03-27T10:11:09.423 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-27T10:11:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.424+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdda8066e30 msgr2=0x7fdda80692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.424+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdda8066e30 0x7fdda80692e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009b40 tx=0x7fddc0009210 comp rx=0 tx=0).stop 2023-03-27T10:11:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.424+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 msgr2=0x7fddc40c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.424+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 0x7fddc40c2fb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fddb400e870 tx=0x7fddb400eb80 comp rx=0 tx=0).stop 2023-03-27T10:11:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 shutdown_connections 2023-03-27T10:11:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fdda8066e30 0x7fdda80692e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fddc4161040 0x7fddc40b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fddc4065e30 0x7fddc40c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 --2- 172.21.15.172:0/3509319692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddc415c6f0 0x7fddc40c2fb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 >> 172.21.15.172:0/3509319692 conn(0x7fddc40cbf30 msgr2=0x7fddc40ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 shutdown_connections 2023-03-27T10:11:09.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:09.425+0000 7fddcb7ff700 1 -- 172.21.15.172:0/3509319692 wait complete. 2023-03-27T10:11:09.442 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-27T10:11:09.443 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-27T10:11:09.444 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-03-27T10:11:09.445 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-27T10:11:09.445 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-27T10:11:09.445 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-27T10:11:09.446 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-27T10:11:09.446 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-27T10:11:09.446 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-27T10:11:09.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:09.447 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-03-27T10:11:09.489 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-27T10:11:09.489 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-27T10:11:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-03-27T10:11:09.490 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-03-27T10:11:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.491 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:11:09.491 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-03-27T10:11:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-03-27T10:11:09.492 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:11:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-03-27T10:11:09.492 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-03-27T10:11:09.493 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-27T10:11:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:11:09.493 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-27T10:11:09.493 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:11:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-27T10:11:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-03-27T10:11:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-03-27T10:11:09.494 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.495 INFO:teuthology.orchestra.run.smithi172.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-27T10:11:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 8e:d4:13:5b:33:89 brd ff:ff:ff:ff:ff:ff 2023-03-27T10:11:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-27T10:11:09.495 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::cc49:a6ff:fe8a:ce67/64 scope link 2023-03-27T10:11:09.496 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.497 INFO:teuthology.orchestra.run.smithi172.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-27T10:11:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 8e:d4:13:5b:33:89 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-27T10:11:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::8cd4:13ff:fe5b:3389/64 scope link 2023-03-27T10:11:09.497 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.498 INFO:teuthology.orchestra.run.smithi172.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-27T10:11:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether d2:64:46:b5:a0:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-27T10:11:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::d064:46ff:feb5:a0cb/64 scope link 2023-03-27T10:11:09.498 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-03-27T10:11:09.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:09.499 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-27T10:11:09.589 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-03-27T10:11:09.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:09.592 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-03-27T10:11:09.637 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-03-27T10:11:09.637 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-27T10:11:09.637 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-27T10:11:09.637 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-27T10:11:09.638 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-27T10:11:09.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:09.638 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-03-27T10:11:09.639 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-03-27T10:11:09.639 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-27T10:11:09.639 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-27T10:11:09.640 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-27T10:11:09.640 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-03-27T10:11:09.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:09.828 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-03-27T10:11:09.869 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-27T10:11:09.869 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-27T10:11:09.869 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-27T10:11:09.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:09.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-03-27T10:11:09.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:11:09.973 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-27T10:11:10.014 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-27T10:11:10.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-27T10:11:10.015 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-27T10:11:10.094 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-03-27T10:11:10.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:10.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:11:10.231 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:11:10.232 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-27T10:11:10.232 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:11:10.247 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:11:10.247 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-27T10:11:10.247 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:11:10.248 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:11:10.248 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:11:10.268 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-27T10:11:10.269 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=b9fe5031-957d-4f6c-a6ac-e7da3c176686" will pass to kernel 2023-03-27T10:11:10.274 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-27T10:11:10.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:10.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-27T10:11:10.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:10.342 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-27T10:11:10.431 INFO:teuthology.orchestra.run.smithi172.stdout:client5352 2023-03-27T10:11:10.432 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:11:10.432 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-27T10:11:10.472 DEBUG:teuthology.orchestra.run.smithi172:> mktemp -d --suffix=xfstests-dev 2023-03-27T10:11:10.553 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.Bd5h2Tmv1Lxfstests-dev 2023-03-27T10:11:10.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:10.554 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.Bd5h2Tmv1Lxfstests-dev) 2023-03-27T10:11:10.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:10.659 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.Bd5h2Tmv1Lxfstests-dev) 2023-03-27T10:11:10.705 INFO:teuthology.orchestra.run.smithi172.stderr:Cloning into '/tmp/tmp.Bd5h2Tmv1Lxfstests-dev'... 2023-03-27T10:11:11.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:11.520 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-03-27T10:11:11.569 DEBUG:teuthology.orchestra.run.smithi172:> mktemp -d --suffix=test 2023-03-27T10:11:11.611 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.1tAbVmoPKttest 2023-03-27T10:11:11.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:11:11.612 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-03-27T10:11:11.695 DEBUG:teuthology.orchestra.run.smithi172:> mktemp -d --suffix=scratch 2023-03-27T10:11:11.775 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:11:11.776 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-03-27T10:11:11.776 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-03-27T10:11:12.765 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:04:34 ago on Mon 27 Mar 2023 10:06:38 AM UTC. 2023-03-27T10:11:13.883 INFO:teuthology.orchestra.run.smithi172.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-03-27T10:11:13.885 INFO:teuthology.orchestra.run.smithi172.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-03-27T10:11:13.885 INFO:teuthology.orchestra.run.smithi172.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-03-27T10:11:13.886 INFO:teuthology.orchestra.run.smithi172.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-03-27T10:11:13.887 INFO:teuthology.orchestra.run.smithi172.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-03-27T10:11:13.889 INFO:teuthology.orchestra.run.smithi172.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-03-27T10:11:13.891 INFO:teuthology.orchestra.run.smithi172.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-03-27T10:11:13.892 INFO:teuthology.orchestra.run.smithi172.stdout:Package gcc-8.5.0-17.el8.x86_64 is already installed. 2023-03-27T10:11:13.894 INFO:teuthology.orchestra.run.smithi172.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-03-27T10:11:13.895 INFO:teuthology.orchestra.run.smithi172.stdout:Package lvm2-8:2.03.14-6.el8.x86_64 is already installed. 2023-03-27T10:11:13.897 INFO:teuthology.orchestra.run.smithi172.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-03-27T10:11:13.898 INFO:teuthology.orchestra.run.smithi172.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-03-27T10:11:13.898 INFO:teuthology.orchestra.run.smithi172.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-03-27T10:11:13.899 INFO:teuthology.orchestra.run.smithi172.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-03-27T10:11:13.900 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-27T10:11:13.901 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-27T10:11:13.902 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-27T10:11:13.903 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-27T10:11:13.904 INFO:teuthology.orchestra.run.smithi172.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-03-27T10:11:13.905 INFO:teuthology.orchestra.run.smithi172.stdout:Package libuuid-devel-2.32.1-41.el8.x86_64 is already installed. 2023-03-27T10:11:13.906 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-03-27T10:11:13.908 INFO:teuthology.orchestra.run.smithi172.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-03-27T10:11:13.912 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-27T10:11:14.040 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-03-27T10:11:14.044 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================== 2023-03-27T10:11:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-03-27T10:11:14.044 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================== 2023-03-27T10:11:14.044 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2023-03-27T10:11:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: dump x86_64 1:0.4-0.36.b46.el8 CentOS-BaseOS 164 k 2023-03-27T10:11:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: fio x86_64 3.19-4.el8 CentOS-AppStream 538 k 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: indent x86_64 2.2.12-4.el8 epel 185 k 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa CentOS-AppStream 110 k 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: cpp x86_64 8.5.0-18.el8 CentOS-BaseOS 10 M 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper x86_64 8:1.02.181-9.el8 CentOS-BaseOS 378 k 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-event x86_64 8:1.02.181-9.el8 CentOS-BaseOS 272 k 2023-03-27T10:11:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-event-libs x86_64 8:1.02.181-9.el8 CentOS-BaseOS 271 k 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-libs x86_64 8:1.02.181-9.el8 CentOS-BaseOS 410 k 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: gcc x86_64 8.5.0-18.el8 CentOS-BaseOS 23 M 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: gcc-gdb-plugin x86_64 8.5.0-18.el8 CentOS-AppStream 120 k 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: gcc-plugin-annobin x86_64 8.5.0-18.el8 CentOS-BaseOS 35 k 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: libgcc x86_64 8.5.0-18.el8 CentOS-BaseOS 81 k 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: libgomp x86_64 8.5.0-18.el8 CentOS-BaseOS 208 k 2023-03-27T10:11:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: lvm2 x86_64 8:2.03.14-9.el8 CentOS-BaseOS 1.7 M 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: lvm2-libs x86_64 8:2.03.14-9.el8 CentOS-BaseOS 1.2 M 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: sqlite x86_64 3.26.0-17.el8 CentOS-BaseOS 668 k 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: sqlite-libs x86_64 3.26.0-17.el8 CentOS-BaseOS 581 k 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: daxctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 42 k 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemblk x86_64 1.6.1-1.el8 CentOS-AppStream 92 k 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: ndctl-libs x86_64 71.1-4.el8 CentOS-BaseOS 80 k 2023-03-27T10:11:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa CentOS-AppStream 6.5 M 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa CentOS-AppStream 892 k 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa CentOS-AppStream 287 k 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa CentOS-AppStream 44 k 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout: rmt x86_64 2:1.5.3-13.el8 CentOS-BaseOS 51 k 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa CentOS-AppStream 1.8 M 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa CentOS-AppStream 702 k 2023-03-27T10:11:14.048 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling module streams: 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout: python27 2.7 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================== 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout:Install 14 Packages 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 14 Packages 2023-03-27T10:11:14.049 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:14.050 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 51 M 2023-03-27T10:11:14.050 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-03-27T10:11:14.275 INFO:teuthology.orchestra.run.smithi172.stdout:(1/28): fio-3.19-4.el8.x86_64.rpm 2.4 MB/s | 538 kB 00:00 2023-03-27T10:11:14.300 INFO:teuthology.orchestra.run.smithi172.stdout:(2/28): libpmemblk-1.6.1-1.el8.x86_64.rpm 370 kB/s | 92 kB 00:00 2023-03-27T10:11:14.325 INFO:teuthology.orchestra.run.smithi172.stdout:(3/28): python2-2.7.18-12.module_el8+299+aa6e9a 404 kB/s | 110 kB 00:00 2023-03-27T10:11:14.425 INFO:teuthology.orchestra.run.smithi172.stdout:(4/28): python2-pip-wheel-9.0.3-19.module_el8+2 8.7 MB/s | 892 kB 00:00 2023-03-27T10:11:14.467 INFO:teuthology.orchestra.run.smithi172.stdout:(5/28): python2-pip-9.0.3-19.module_el8+299+aa6 11 MB/s | 1.8 MB 00:00 2023-03-27T10:11:14.518 INFO:teuthology.orchestra.run.smithi172.stdout:(6/28): python2-setuptools-39.0.1-13.module_el8 7.5 MB/s | 702 kB 00:00 2023-03-27T10:11:14.601 INFO:teuthology.orchestra.run.smithi172.stdout:(7/28): python2-libs-2.7.18-12.module_el8+299+a 20 MB/s | 6.5 MB 00:00 2023-03-27T10:11:14.618 INFO:teuthology.orchestra.run.smithi172.stdout:(8/28): python2-wheel-wheel-0.31.1-3.module_el8 443 kB/s | 44 kB 00:00 2023-03-27T10:11:14.636 INFO:teuthology.orchestra.run.smithi172.stdout:(9/28): daxctl-libs-71.1-4.el8.x86_64.rpm 1.2 MB/s | 42 kB 00:00 2023-03-27T10:11:14.670 INFO:teuthology.orchestra.run.smithi172.stdout:(10/28): python2-setuptools-wheel-39.0.1-13.mod 1.4 MB/s | 287 kB 00:00 2023-03-27T10:11:14.695 INFO:teuthology.orchestra.run.smithi172.stdout:(11/28): ndctl-libs-71.1-4.el8.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2023-03-27T10:11:14.720 INFO:teuthology.orchestra.run.smithi172.stdout:(12/28): rmt-1.5.3-13.el8.x86_64.rpm 1.0 MB/s | 51 kB 00:00 2023-03-27T10:11:14.745 INFO:teuthology.orchestra.run.smithi172.stdout:(13/28): dump-0.4-0.36.b46.el8.x86_64.rpm 1.3 MB/s | 164 kB 00:00 2023-03-27T10:11:14.771 INFO:teuthology.orchestra.run.smithi172.stdout:(14/28): gcc-gdb-plugin-8.5.0-18.el8.x86_64.rpm 2.3 MB/s | 120 kB 00:00 2023-03-27T10:11:14.838 INFO:teuthology.orchestra.run.smithi172.stdout:(15/28): device-mapper-1.02.181-9.el8.x86_64.rp 5.5 MB/s | 378 kB 00:00 2023-03-27T10:11:14.896 INFO:teuthology.orchestra.run.smithi172.stdout:(16/28): device-mapper-event-1.02.181-9.el8.x86 4.6 MB/s | 272 kB 00:00 2023-03-27T10:11:14.938 INFO:teuthology.orchestra.run.smithi172.stdout:(17/28): device-mapper-event-libs-1.02.181-9.el 6.4 MB/s | 271 kB 00:00 2023-03-27T10:11:15.064 INFO:teuthology.orchestra.run.smithi172.stdout:(18/28): cpp-8.5.0-18.el8.x86_64.rpm 33 MB/s | 10 MB 00:00 2023-03-27T10:11:15.065 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:11:15.069 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:11:15.088 INFO:teuthology.orchestra.run.smithi172.stdout:(19/28): indent-2.2.12-4.el8.x86_64.rpm 471 kB/s | 185 kB 00:00 2023-03-27T10:11:15.122 INFO:teuthology.orchestra.run.smithi172.stdout:(20/28): device-mapper-libs-1.02.181-9.el8.x86_ 2.2 MB/s | 410 kB 00:00 2023-03-27T10:11:15.157 INFO:teuthology.orchestra.run.smithi172.stdout:(21/28): gcc-plugin-annobin-8.5.0-18.el8.x86_64 520 kB/s | 35 kB 00:00 2023-03-27T10:11:15.198 INFO:teuthology.orchestra.run.smithi172.stdout:(22/28): libgcc-8.5.0-18.el8.x86_64.rpm 1.1 MB/s | 81 kB 00:00 2023-03-27T10:11:15.224 INFO:teuthology.orchestra.run.smithi172.stdout:(23/28): libgomp-8.5.0-18.el8.x86_64.rpm 3.1 MB/s | 208 kB 00:00 2023-03-27T10:11:15.307 INFO:teuthology.orchestra.run.smithi172.stdout:(24/28): lvm2-2.03.14-9.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-03-27T10:11:15.349 INFO:teuthology.orchestra.run.smithi172.stdout:(25/28): lvm2-libs-2.03.14-9.el8.x86_64.rpm 9.5 MB/s | 1.2 MB 00:00 2023-03-27T10:11:15.391 INFO:teuthology.orchestra.run.smithi172.stdout:(26/28): sqlite-3.26.0-17.el8.x86_64.rpm 7.8 MB/s | 668 kB 00:00 2023-03-27T10:11:15.425 INFO:teuthology.orchestra.run.smithi172.stdout:(27/28): sqlite-libs-3.26.0-17.el8.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2023-03-27T10:11:15.825 INFO:teuthology.orchestra.run.smithi172.stdout:(28/28): gcc-8.5.0-18.el8.x86_64.rpm 31 MB/s | 23 MB 00:00 2023-03-27T10:11:15.828 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-03-27T10:11:15.828 INFO:teuthology.orchestra.run.smithi172.stdout:Total 29 MB/s | 51 MB 00:01 2023-03-27T10:11:16.610 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-03-27T10:11:16.745 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-03-27T10:11:16.746 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-03-27T10:11:17.277 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-03-27T10:11:17.282 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-03-27T10:11:18.737 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-03-27T10:11:18.796 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgcc-8.5.0-18.el8.x86_64 1/1 2023-03-27T10:11:18.925 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libgcc-8.5.0-18.el8.x86_64 1/42 2023-03-27T10:11:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgcc-8.5.0-18.el8.x86_64 1/42 2023-03-27T10:11:19.271 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : device-mapper-libs-8:1.02.181-9.el8.x86_64 2/42 2023-03-27T10:11:19.548 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : device-mapper-8:1.02.181-9.el8.x86_64 3/42 2023-03-27T10:11:19.806 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : device-mapper-event-libs-8:1.02.181-9.el8.x86_64 4/42 2023-03-27T10:11:20.023 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : sqlite-libs-3.26.0-17.el8.x86_64 5/42 2023-03-27T10:11:20.158 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 6/42 2023-03-27T10:11:20.251 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 6/42 2023-03-27T10:11:20.400 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 7/42 2023-03-27T10:11:20.486 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 7/42 2023-03-27T10:11:20.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 8/42 2023-03-27T10:11:20.724 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 8/42 2023-03-27T10:11:20.917 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : device-mapper-event-8:1.02.181-9.el8.x86_64 9/42 2023-03-27T10:11:21.268 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: device-mapper-event-8:1.02.181-9.el8.x86_64 9/42 2023-03-27T10:11:21.506 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : lvm2-libs-8:2.03.14-9.el8.x86_64 10/42 2023-03-27T10:11:21.725 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : libgomp-8.5.0-18.el8.x86_64 11/42 2023-03-27T10:11:22.726 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgomp-8.5.0-18.el8.x86_64 11/42 2023-03-27T10:11:23.415 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : cpp-8.5.0-18.el8.x86_64 12/42 2023-03-27T10:11:25.245 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cpp-8.5.0-18.el8.x86_64 12/42 2023-03-27T10:11:25.523 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : gcc-8.5.0-18.el8.x86_64 13/42 2023-03-27T10:11:25.585 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: gcc-8.5.0-18.el8.x86_64 13/42 2023-03-27T10:11:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 14/42 2023-03-27T10:11:25.905 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 15/42 2023-03-27T10:11:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 16/42 2023-03-27T10:11:28.253 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 17/42 2023-03-27T10:11:28.680 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 18/42 2023-03-27T10:11:28.905 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 19/42 2023-03-27T10:11:29.099 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 20/42 2023-03-27T10:11:29.147 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 20/42 2023-03-27T10:11:29.389 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 21/42 2023-03-27T10:11:29.598 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : gcc-gdb-plugin-8.5.0-18.el8.x86_64 22/42 2023-03-27T10:11:29.681 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-18.el8.x86_64 22/42 2023-03-27T10:11:29.832 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : gcc-plugin-annobin-8.5.0-18.el8.x86_64 23/42 2023-03-27T10:11:30.107 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: gcc-plugin-annobin-8.5.0-18.el8.x86_64 23/42 2023-03-27T10:11:30.107 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : lvm2-8:2.03.14-9.el8.x86_64 24/42 2023-03-27T10:11:30.107 INFO:teuthology.orchestra.run.smithi172.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2023-03-27T10:11:30.107 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:30.733 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lvm2-8:2.03.14-9.el8.x86_64 24/42 2023-03-27T10:11:31.023 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fio-3.19-4.el8.x86_64 25/42 2023-03-27T10:11:31.261 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : sqlite-3.26.0-17.el8.x86_64 26/42 2023-03-27T10:11:31.468 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : indent-2.2.12-4.el8.x86_64 27/42 2023-03-27T10:11:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 28/42 2023-03-27T10:11:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lvm2-8:2.03.14-6.el8.x86_64 29/42 2023-03-27T10:11:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : lvm2-8:2.03.14-6.el8.x86_64 29/42 2023-03-27T10:11:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lvm2-8:2.03.14-6.el8.x86_64 29/42 2023-03-27T10:11:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : lvm2-libs-8:2.03.14-6.el8.x86_64 30/42 2023-03-27T10:11:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: device-mapper-event-8:1.02.181-6.el8.x86_64 31/42 2023-03-27T10:11:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : device-mapper-event-8:1.02.181-6.el8.x86_64 31/42 2023-03-27T10:11:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : device-mapper-event-libs-8:1.02.181-6.el8.x86_64 32/42 2023-03-27T10:11:32.566 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : gcc-gdb-plugin-8.5.0-17.el8.x86_64 33/42 2023-03-27T10:11:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: gcc-gdb-plugin-8.5.0-17.el8.x86_64 33/42 2023-03-27T10:11:32.940 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : gcc-plugin-annobin-8.5.0-17.el8.x86_64 34/42 2023-03-27T10:11:32.963 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: gcc-8.5.0-17.el8.x86_64 35/42 2023-03-27T10:11:33.241 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : gcc-8.5.0-17.el8.x86_64 35/42 2023-03-27T10:11:33.457 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : device-mapper-libs-8:1.02.181-6.el8.x86_64 36/42 2023-03-27T10:11:33.665 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : device-mapper-8:1.02.181-6.el8.x86_64 37/42 2023-03-27T10:11:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 38/42 2023-03-27T10:11:33.973 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 39/42 2023-03-27T10:11:33.988 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cpp-8.5.0-17.el8.x86_64 40/42 2023-03-27T10:11:34.133 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : cpp-8.5.0-17.el8.x86_64 40/42 2023-03-27T10:11:34.134 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libgcc-8.5.0-17.el8.x86_64 41/42 2023-03-27T10:11:34.332 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgcc-8.5.0-17.el8.x86_64 41/42 2023-03-27T10:11:34.346 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgomp-8.5.0-17.el8.x86_64 42/42 2023-03-27T10:11:34.347 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : libgomp-8.5.0-17.el8.x86_64 42/42 2023-03-27T10:11:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgomp-8.5.0-17.el8.x86_64 42/42 2023-03-27T10:11:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fio-3.19-4.el8.x86_64 1/42 2023-03-27T10:11:35.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/42 2023-03-27T10:11:35.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/42 2023-03-27T10:11:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/42 2023-03-27T10:11:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/42 2023-03-27T10:11:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 12/42 2023-03-27T10:11:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/42 2023-03-27T10:11:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : indent-2.2.12-4.el8.x86_64 14/42 2023-03-27T10:11:35.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gcc-gdb-plugin-8.5.0-18.el8.x86_64 15/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gcc-gdb-plugin-8.5.0-17.el8.x86_64 16/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cpp-8.5.0-18.el8.x86_64 17/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cpp-8.5.0-17.el8.x86_64 18/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-8:1.02.181-9.el8.x86_64 19/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-8:1.02.181-6.el8.x86_64 20/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-event-8:1.02.181-9.el8.x86_64 21/42 2023-03-27T10:11:35.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-event-8:1.02.181-6.el8.x86_64 22/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-event-libs-8:1.02.181-9.el8.x86_64 23/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-event-libs-8:1.02.181-6.el8.x86_64 24/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-libs-8:1.02.181-9.el8.x86_64 25/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : device-mapper-libs-8:1.02.181-6.el8.x86_64 26/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gcc-8.5.0-18.el8.x86_64 27/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gcc-8.5.0-17.el8.x86_64 28/42 2023-03-27T10:11:35.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gcc-plugin-annobin-8.5.0-18.el8.x86_64 29/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gcc-plugin-annobin-8.5.0-17.el8.x86_64 30/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgcc-8.5.0-18.el8.x86_64 31/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgcc-8.5.0-17.el8.x86_64 32/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgomp-8.5.0-18.el8.x86_64 33/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgomp-8.5.0-17.el8.x86_64 34/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lvm2-8:2.03.14-9.el8.x86_64 35/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lvm2-8:2.03.14-6.el8.x86_64 36/42 2023-03-27T10:11:35.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lvm2-libs-8:2.03.14-9.el8.x86_64 37/42 2023-03-27T10:11:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lvm2-libs-8:2.03.14-6.el8.x86_64 38/42 2023-03-27T10:11:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 39/42 2023-03-27T10:11:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 40/42 2023-03-27T10:11:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 41/42 2023-03-27T10:11:36.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 42/42 2023-03-27T10:11:36.565 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:36.565 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2023-03-27T10:11:36.565 INFO:teuthology.orchestra.run.smithi172.stdout: cpp-8.5.0-18.el8.x86_64 2023-03-27T10:11:36.565 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-8:1.02.181-9.el8.x86_64 2023-03-27T10:11:36.565 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-event-8:1.02.181-9.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-event-libs-8:1.02.181-9.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: device-mapper-libs-8:1.02.181-9.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: gcc-8.5.0-18.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: gcc-gdb-plugin-8.5.0-18.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: gcc-plugin-annobin-8.5.0-18.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: libgcc-8.5.0-18.el8.x86_64 2023-03-27T10:11:36.566 INFO:teuthology.orchestra.run.smithi172.stdout: libgomp-8.5.0-18.el8.x86_64 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout: lvm2-8:2.03.14-9.el8.x86_64 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout: lvm2-libs-8:2.03.14-9.el8.x86_64 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout: sqlite-3.26.0-17.el8.x86_64 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout: sqlite-libs-3.26.0-17.el8.x86_64 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-03-27T10:11:36.567 INFO:teuthology.orchestra.run.smithi172.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: fio-3.19-4.el8.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: indent-2.2.12-4.el8.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-03-27T10:11:36.568 INFO:teuthology.orchestra.run.smithi172.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:36.569 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-03-27T10:11:36.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo useradd -m fsgqa 2023-03-27T10:11:36.975 INFO:teuthology.orchestra.run.smithi172.stderr:useradd: user 'fsgqa' already exists 2023-03-27T10:11:36.978 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-03-27T10:11:36.979 DEBUG:teuthology.orchestra.run.smithi172:> sudo groupadd fsgqa 2023-03-27T10:11:37.040 INFO:teuthology.orchestra.run.smithi172.stderr:groupadd: group 'fsgqa' already exists 2023-03-27T10:11:37.041 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-03-27T10:11:37.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo useradd fsgqa2 2023-03-27T10:11:38.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo useradd 123456-fsgqa 2023-03-27T10:11:41.594 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-03-27T10:11:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.779+0000 7fa46f7ff700 1 Processor -- start 2023-03-27T10:11:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.779+0000 7fa46f7ff700 1 -- start start 2023-03-27T10:11:41.780 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46f7ff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4680ce7d0 0x7fa4680ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:41.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46f7ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa4680b0050 0x7fa4680cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:41.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46f7ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4680caa80 con 0x7fa46815a540 2023-03-27T10:11:41.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46f7ff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680c9570 con 0x7fa4680ce7d0 2023-03-27T10:11:41.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46f7ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46815aa90 con 0x7fa4680b0050 2023-03-27T10:11:41.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4680ce7d0 0x7fa4680ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:41.781 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4680ce7d0 0x7fa4680ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40864/0 (socket says 172.21.15.172:40864) 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 -- 172.21.15.172:0/4259439312 learned_addr learned my addr 172.21.15.172:0/4259439312 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46cd9a700 1 --1- 172.21.15.172:0/4259439312 >> v1:172.21.15.172:6789/0 conn(0x7fa46815a540 0x7fa4680af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39468/0 (socket says 172.21.15.172:39468) 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46dd9c700 1 --2- 172.21.15.172:0/4259439312 >> v2:172.21.15.191:3300/0 conn(0x7fa4680b0050 0x7fa4680cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 -- 172.21.15.172:0/4259439312 >> v2:172.21.15.191:3300/0 conn(0x7fa4680b0050 msgr2=0x7fa4680cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 --2- 172.21.15.172:0/4259439312 >> v2:172.21.15.191:3300/0 conn(0x7fa4680b0050 0x7fa4680cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 -- 172.21.15.172:0/4259439312 >> v1:172.21.15.172:6789/0 conn(0x7fa46815a540 legacy=0x7fa4680af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46d59b700 1 -- 172.21.15.172:0/4259439312 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680c9780 con 0x7fa4680ce7d0 2023-03-27T10:11:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa46dd9c700 1 --2- 172.21.15.172:0/4259439312 >> v2:172.21.15.191:3300/0 conn(0x7fa4680b0050 0x7fa4680cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-27T10:11:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.781+0000 7fa45ffff700 1 -- 172.21.15.172:0/4259439312 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262514632 0 0) 0x7fa4680caa80 con 0x7fa46815a540 2023-03-27T10:11:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.782+0000 7fa46d59b700 1 --2- 172.21.15.172:0/4259439312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680ce7d0 0x7fa4680ca540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa46806adb0 tx=0x7fa464009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddab822ed75c1e server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.782+0000 7fa45ffff700 1 -- 172.21.15.172:0/4259439312 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400b870 con 0x7fa4680ce7d0 2023-03-27T10:11:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.782+0000 7fa45ffff700 1 -- 172.21.15.172:0/4259439312 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46400b9d0 con 0x7fa4680ce7d0 2023-03-27T10:11:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.782+0000 7fa45ffff700 1 -- 172.21.15.172:0/4259439312 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46400bd60 con 0x7fa4680ce7d0 2023-03-27T10:11:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.782+0000 7fa46f7ff700 1 -- 172.21.15.172:0/4259439312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680ce7d0 msgr2=0x7fa4680ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.782+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/4259439312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680ce7d0 0x7fa4680ca540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa46806adb0 tx=0x7fa464009bd0 comp rx=0 tx=0).stop 2023-03-27T10:11:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.783+0000 7fa46f7ff700 1 -- 172.21.15.172:0/4259439312 shutdown_connections 2023-03-27T10:11:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.783+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/4259439312 >> v2:172.21.15.191:3300/0 conn(0x7fa4680b0050 0x7fa4680cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.783+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/4259439312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680ce7d0 0x7fa4680ca540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.783+0000 7fa46f7ff700 1 -- 172.21.15.172:0/4259439312 >> 172.21.15.172:0/4259439312 conn(0x7fa46806a1a0 msgr2=0x7fa46806a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.783+0000 7fa46f7ff700 1 -- 172.21.15.172:0/4259439312 shutdown_connections 2023-03-27T10:11:41.786 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.783+0000 7fa46f7ff700 1 -- 172.21.15.172:0/4259439312 wait complete. 2023-03-27T10:11:41.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.785+0000 7fa46f7ff700 1 Processor -- start 2023-03-27T10:11:41.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.785+0000 7fa46f7ff700 1 -- start start 2023-03-27T10:11:41.787 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46f7ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 0x7fa468145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46f7ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa4680ce7d0 0x7fa4680c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46f7ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46815a540 0x7fa4681509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46f7ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680c88a0 con 0x7fa4680b0050 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46f7ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680c7980 con 0x7fa46815a540 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46f7ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa468145b50 con 0x7fa4680ce7d0 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46d59b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 0x7fa468145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:41.788 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46d59b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 0x7fa468145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40872/0 (socket says 172.21.15.172:40872) 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46d59b700 1 -- 172.21.15.172:0/1485048024 learned_addr learned my addr 172.21.15.172:0/1485048024 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46cd9a700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa4680ce7d0 0x7fa4680c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.786+0000 7fa46dd9c700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46815a540 0x7fa4681509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46d59b700 1 -- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa4680ce7d0 msgr2=0x7fa4680c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46d59b700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa4680ce7d0 0x7fa4680c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46d59b700 1 -- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46815a540 msgr2=0x7fa4681509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46d59b700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46815a540 0x7fa4681509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:41.789 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46d59b700 1 -- 172.21.15.172:0/1485048024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464009550 con 0x7fa4680b0050 2023-03-27T10:11:41.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46d59b700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 0x7fa468145610 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa464009c10 tx=0x7fa464004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:41.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464004310 con 0x7fa4680b0050 2023-03-27T10:11:41.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46401f070 con 0x7fa4680b0050 2023-03-27T10:11:41.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640036a0 con 0x7fa4680b0050 2023-03-27T10:11:41.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4680c9d40 con 0x7fa4680b0050 2023-03-27T10:11:41.790 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.787+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4680c9a60 con 0x7fa4680b0050 2023-03-27T10:11:41.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.788+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4680ca020 con 0x7fa4680b0050 2023-03-27T10:11:41.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.789+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7fa46402a020 con 0x7fa4680b0050 2023-03-27T10:11:41.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.790+0000 7fa45dffb700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa44c066e60 0x7fa44c069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:41.791 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.790+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa464085930 con 0x7fa4680b0050 2023-03-27T10:11:41.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.790+0000 7fa46cd9a700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa44c066e60 0x7fa44c069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:41.792 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.791+0000 7fa46cd9a700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa44c066e60 0x7fa44c069310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa46815c5c0 tx=0x7fa458007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:41.793 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:41.794+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7fa464052b50 con 0x7fa4680b0050 2023-03-27T10:11:42.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.054+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa468074290 con 0x7fa4680b0050 2023-03-27T10:11:42.054 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.055+0000 7fa45dffb700 1 -- 172.21.15.172:0/1485048024 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7fa464015090 con 0x7fa4680b0050 2023-03-27T10:11:42.055 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:11:42.055 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"b9fe5031-957d-4f6c-a6ac-e7da3c176686","modified":"2023-03-27T10:08:46.926768Z","created":"2023-03-27T10:08:46.926768Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3301","nonce":0},{"type":"v1","addr":"172.21.15.191:6790","nonce":0}]},"addr":"172.21.15.191:6790/0","public_addr":"172.21.15.191:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-03-27T10:11:42.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa44c066e60 msgr2=0x7fa44c069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa44c066e60 0x7fa44c069310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa46815c5c0 tx=0x7fa458007c90 comp rx=0 tx=0).stop 2023-03-27T10:11:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 msgr2=0x7fa468145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 0x7fa468145610 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa464009c10 tx=0x7fa464004750 comp rx=0 tx=0).stop 2023-03-27T10:11:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 shutdown_connections 2023-03-27T10:11:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7fa44c066e60 0x7fa44c069310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa46815a540 0x7fa4681509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4680b0050 0x7fa468145610 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 --2- 172.21.15.172:0/1485048024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa4680ce7d0 0x7fa4680c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 >> 172.21.15.172:0/1485048024 conn(0x7fa46806a1a0 msgr2=0x7fa4680ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 shutdown_connections 2023-03-27T10:11:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.057+0000 7fa46f7ff700 1 -- 172.21.15.172:0/1485048024 wait complete. 2023-03-27T10:11:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2023-03-27T10:11:42.075 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-03-27T10:11:42.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.262+0000 7ff31c3ff700 1 Processor -- start 2023-03-27T10:11:42.262 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.262+0000 7ff31c3ff700 1 -- start start 2023-03-27T10:11:42.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.263+0000 7ff31c3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 0x7ff31406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.263+0000 7ff31c3ff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140ce8a0 con 0x7ff314159070 2023-03-27T10:11:42.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.263+0000 7ff31c3ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140c9180 con 0x7ff31406fa10 2023-03-27T10:11:42.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.263+0000 7ff31c3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31406c9f0 con 0x7ff3140cd5e0 2023-03-27T10:11:42.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.263+0000 7ff31a19b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff314159070 0x7ff3140cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39470/0 (socket says 172.21.15.172:39470) 2023-03-27T10:11:42.263 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.263+0000 7ff31a19b700 1 -- 172.21.15.172:0/3432430390 learned_addr learned my addr 172.21.15.172:0/3432430390 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-03-27T10:11:42.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff31999a700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 0x7ff31406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864848917 0 0) 0x7ff310001110 con 0x7ff314159070 2023-03-27T10:11:42.265 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3000046c0 con 0x7ff314159070 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788260521 0 0) 0x7ff3000046c0 con 0x7ff314159070 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 msgr2=0x7ff31406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 0x7ff31406c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 >> v1:172.21.15.191:6789/0 conn(0x7ff31406fa10 legacy=0x7ff3140caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140cca40 con 0x7ff314159070 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1863550734 0 0) 0x7ff310001800 con 0x7ff314159070 2023-03-27T10:11:42.266 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 >> v1:172.21.15.172:6789/0 conn(0x7ff314159070 legacy=0x7ff3140cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 0x7ff300004b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff300005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff300005ea0 0x7ff300006310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31406c9f0 con 0x7ff3000050c0 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30000cc00 con 0x7ff300005ea0 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.264+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30000cdc0 con 0x7ff3140cd5e0 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff300005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.267 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31a19b700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 0x7ff300004b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31a99c700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff300005ea0 0x7ff300006310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 -- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 msgr2=0x7ff300004b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3140cd5e0 0x7ff300004b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 -- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff300005ea0 msgr2=0x7ff300006310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff300005ea0 0x7ff300006310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 -- 172.21.15.172:0/3432430390 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000046c0 con 0x7ff3000050c0 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff31999a700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff300005960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff304009b30 tx=0x7ff300006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5486c44f656acac8 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:42.268 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400e6c0 con 0x7ff3000050c0 2023-03-27T10:11:42.269 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30400e820 con 0x7ff3000050c0 2023-03-27T10:11:42.269 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.265+0000 7ff319199700 1 -- 172.21.15.172:0/3432430390 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400eb90 con 0x7ff3000050c0 2023-03-27T10:11:42.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31c3ff700 1 -- 172.21.15.172:0/3432430390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 msgr2=0x7ff300005960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.275 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/3432430390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff300005960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff304009b30 tx=0x7ff300006990 comp rx=0 tx=0).stop 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31a99c700 1 -- 172.21.15.172:0/3432430390 reap_dead start 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31c3ff700 1 -- 172.21.15.172:0/3432430390 shutdown_connections 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31c3ff700 1 -- 172.21.15.172:0/3432430390 >> 172.21.15.172:0/3432430390 conn(0x7ff31406a1a0 msgr2=0x7ff31406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31c3ff700 1 -- 172.21.15.172:0/3432430390 shutdown_connections 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.266+0000 7ff31c3ff700 1 -- 172.21.15.172:0/3432430390 wait complete. 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.268+0000 7ff31c3ff700 1 Processor -- start 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.268+0000 7ff31c3ff700 1 -- start start 2023-03-27T10:11:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31c3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff3141f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31c3ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3141e0a20 0x7ff314153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31c3ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3141e0e70 0x7ff314154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31c3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3141de150 con 0x7ff3000050c0 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31c3ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3141de3a0 con 0x7ff3141e0e70 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31c3ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3141de680 con 0x7ff3141e0a20 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a19b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff3141f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.277 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a19b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff3141f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40890/0 (socket says 172.21.15.172:40890) 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a19b700 1 -- 172.21.15.172:0/508444482 learned_addr learned my addr 172.21.15.172:0/508444482 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31999a700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3141e0a20 0x7ff314153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a19b700 1 -- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3141e0a20 msgr2=0x7ff314153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a19b700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3141e0a20 0x7ff314153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a99c700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3141e0e70 0x7ff314154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.269+0000 7ff31a19b700 1 -- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3141e0e70 msgr2=0x7ff314154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff31a19b700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3141e0e70 0x7ff314154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff31a19b700 1 -- 172.21.15.172:0/508444482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140c93d0 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff31a19b700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff3141f4230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff310001930 tx=0x7ff3100076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100077c0 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000f8d0 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3140cda50 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000fc60 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.270+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3140c96b0 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.271+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff314074300 con 0x7ff3000050c0 2023-03-27T10:11:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.272+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 85113+0+0 (secure 0 0 0) 0x7ff31001d460 con 0x7ff3000050c0 2023-03-27T10:11:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.273+0000 7ff30affd700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff2f8066e60 0x7ff2f8069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-27T10:11:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.273+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ff310084310 con 0x7ff3000050c0 2023-03-27T10:11:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.273+0000 7ff31999a700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff2f8066e60 0x7ff2f8069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-27T10:11:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.274+0000 7ff31999a700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff2f8066e60 0x7ff2f8069310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff3040090b0 tx=0x7ff304008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-27T10:11:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.277+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173280 (secure 0 0 0) 0x7ff3100514d0 con 0x7ff3000050c0 2023-03-27T10:11:42.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.539+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7ff31406cf70 con 0x7ff3000050c0 2023-03-27T10:11:42.540 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.540+0000 7ff30affd700 1 -- 172.21.15.172:0/508444482 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7ff310054af0 con 0x7ff3000050c0 2023-03-27T10:11:42.540 INFO:teuthology.orchestra.run.smithi172.stdout:[client.admin] 2023-03-27T10:11:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== 2023-03-27T10:11:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff2f8066e60 msgr2=0x7ff2f8069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff2f8066e60 0x7ff2f8069310 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff3040090b0 tx=0x7ff304008030 comp rx=0 tx=0).stop 2023-03-27T10:11:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 msgr2=0x7ff3141f4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-27T10:11:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff3141f4230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff310001930 tx=0x7ff3100076a0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 shutdown_connections 2023-03-27T10:11:42.542 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:6832/109700,v1:172.21.15.191:6833/109700] conn(0x7ff2f8066e60 0x7ff2f8069310 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff3141e0e70 0x7ff314154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000050c0 0x7ff3141f4230 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 --2- 172.21.15.172:0/508444482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff3141e0a20 0x7ff314153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-27T10:11:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 >> 172.21.15.172:0/508444482 conn(0x7ff31406a1a0 msgr2=0x7ff3140cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-27T10:11:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 shutdown_connections 2023-03-27T10:11:42.543 INFO:teuthology.orchestra.run.smithi172.stderr:2023-03-27T10:11:42.542+0000 7ff31c3ff700 1 -- 172.21.15.172:0/508444482 wait complete. 2023-03-27T10:11:42.559 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:11:42.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/tmp/tmp.Bd5h2Tmv1Lxfstests-dev/local.config 2023-03-27T10:11:42.624 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.172:6789:/test export TEST_DIR=/tmp/tmp.1tAbVmoPKttest export SCRATCH_DEV=172.21.15.172:6789:/scratch export SCRATCH_MNT=/tmp/tmp.4XPvpb2vjxscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA==" 2023-03-27T10:11:42.624 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-03-27T10:11:42.625 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/tmp/tmp.Bd5h2Tmv1Lxfstests-dev/ceph.exclude 2023-03-27T10:11:42.727 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo make) 2023-03-27T10:11:42.851 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize -cfi 2023-03-27T10:11:43.319 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: putting auxiliary files in '.'. 2023-03-27T10:11:43.319 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file './config.guess' 2023-03-27T10:11:43.328 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file './config.sub' 2023-03-27T10:11:43.337 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file './install-sh' 2023-03-27T10:11:43.347 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file './ltmain.sh' 2023-03-27T10:11:43.402 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-03-27T10:11:43.402 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-03-27T10:11:43.414 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-03-27T10:11:43.426 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-03-27T10:11:43.439 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-03-27T10:11:43.451 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-03-27T10:11:43.465 INFO:teuthology.orchestra.run.smithi172.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-03-27T10:11:43.468 INFO:teuthology.orchestra.run.smithi172.stdout:cp include/install-sh . 2023-03-27T10:11:43.470 INFO:teuthology.orchestra.run.smithi172.stdout:aclocal -I m4 2023-03-27T10:11:44.735 INFO:teuthology.orchestra.run.smithi172.stdout:autoheader 2023-03-27T10:11:45.091 INFO:teuthology.orchestra.run.smithi172.stdout:autoconf 2023-03-27T10:11:45.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:11:45.276 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:11:45.296 INFO:teuthology.orchestra.run.smithi172.stdout:./configure \ 2023-03-27T10:11:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: --libexecdir=/usr/lib \ 2023-03-27T10:11:45.296 INFO:teuthology.orchestra.run.smithi172.stdout: --exec_prefix=/var/lib 2023-03-27T10:11:45.647 INFO:teuthology.orchestra.run.smithi172.stdout:checking build system type... x86_64-pc-linux-gnu 2023-03-27T10:11:45.648 INFO:teuthology.orchestra.run.smithi172.stdout:checking host system type... x86_64-pc-linux-gnu 2023-03-27T10:11:45.650 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to print strings... printf 2023-03-27T10:11:45.651 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gcc... gcc 2023-03-27T10:11:45.800 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether the C compiler works... yes 2023-03-27T10:11:45.800 INFO:teuthology.orchestra.run.smithi172.stdout:checking for C compiler default output file name... a.out 2023-03-27T10:11:45.847 INFO:teuthology.orchestra.run.smithi172.stdout:checking for suffix of executables... 2023-03-27T10:11:45.905 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether we are cross compiling... no 2023-03-27T10:11:45.940 INFO:teuthology.orchestra.run.smithi172.stdout:checking for suffix of object files... o 2023-03-27T10:11:45.971 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether we are using the GNU C compiler... yes 2023-03-27T10:11:46.003 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether gcc accepts -g... yes 2023-03-27T10:11:46.048 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gcc option to accept ISO C89... none needed 2023-03-27T10:11:46.054 INFO:teuthology.orchestra.run.smithi172.stdout:checking for a sed that does not truncate output... /bin/sed 2023-03-27T10:11:46.059 INFO:teuthology.orchestra.run.smithi172.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-03-27T10:11:46.061 INFO:teuthology.orchestra.run.smithi172.stdout:checking for egrep... /bin/grep -E 2023-03-27T10:11:46.064 INFO:teuthology.orchestra.run.smithi172.stdout:checking for fgrep... /bin/grep -F 2023-03-27T10:11:46.071 INFO:teuthology.orchestra.run.smithi172.stdout:checking for ld used by gcc... /bin/ld 2023-03-27T10:11:46.075 INFO:teuthology.orchestra.run.smithi172.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-03-27T10:11:46.089 INFO:teuthology.orchestra.run.smithi172.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-03-27T10:11:46.126 INFO:teuthology.orchestra.run.smithi172.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-03-27T10:11:46.126 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether ln -s works... yes 2023-03-27T10:11:46.136 INFO:teuthology.orchestra.run.smithi172.stdout:checking the maximum length of command line arguments... 1572864 2023-03-27T10:11:46.142 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-03-27T10:11:46.142 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-03-27T10:11:46.142 INFO:teuthology.orchestra.run.smithi172.stdout:checking for /bin/ld option to reload object files... -r 2023-03-27T10:11:46.143 INFO:teuthology.orchestra.run.smithi172.stdout:checking for objdump... objdump 2023-03-27T10:11:46.143 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to recognize dependent libraries... pass_all 2023-03-27T10:11:46.143 INFO:teuthology.orchestra.run.smithi172.stdout:checking for dlltool... no 2023-03-27T10:11:46.143 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-03-27T10:11:46.144 INFO:teuthology.orchestra.run.smithi172.stdout:checking for ar... ar 2023-03-27T10:11:46.188 INFO:teuthology.orchestra.run.smithi172.stdout:checking for archiver @FILE support... @ 2023-03-27T10:11:46.188 INFO:teuthology.orchestra.run.smithi172.stdout:checking for strip... strip 2023-03-27T10:11:46.189 INFO:teuthology.orchestra.run.smithi172.stdout:checking for ranlib... ranlib 2023-03-27T10:11:46.189 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gawk... gawk 2023-03-27T10:11:46.290 INFO:teuthology.orchestra.run.smithi172.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-03-27T10:11:46.293 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sysroot... no 2023-03-27T10:11:46.299 INFO:teuthology.orchestra.run.smithi172.stdout:checking for a working dd... /bin/dd 2023-03-27T10:11:46.306 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-03-27T10:11:46.332 INFO:teuthology.orchestra.run.smithi172.stdout:checking for mt... no 2023-03-27T10:11:46.337 INFO:teuthology.orchestra.run.smithi172.stdout:checking if : is a manifest tool... no 2023-03-27T10:11:46.394 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to run the C preprocessor... gcc -E 2023-03-27T10:11:46.633 INFO:teuthology.orchestra.run.smithi172.stdout:checking for ANSI C header files... yes 2023-03-27T10:11:46.673 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/types.h... yes 2023-03-27T10:11:46.722 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/stat.h... yes 2023-03-27T10:11:46.770 INFO:teuthology.orchestra.run.smithi172.stdout:checking for stdlib.h... yes 2023-03-27T10:11:46.820 INFO:teuthology.orchestra.run.smithi172.stdout:checking for string.h... yes 2023-03-27T10:11:46.875 INFO:teuthology.orchestra.run.smithi172.stdout:checking for memory.h... yes 2023-03-27T10:11:46.923 INFO:teuthology.orchestra.run.smithi172.stdout:checking for strings.h... yes 2023-03-27T10:11:46.975 INFO:teuthology.orchestra.run.smithi172.stdout:checking for inttypes.h... yes 2023-03-27T10:11:47.025 INFO:teuthology.orchestra.run.smithi172.stdout:checking for stdint.h... yes 2023-03-27T10:11:47.084 INFO:teuthology.orchestra.run.smithi172.stdout:checking for unistd.h... yes 2023-03-27T10:11:47.142 INFO:teuthology.orchestra.run.smithi172.stdout:checking for dlfcn.h... yes 2023-03-27T10:11:47.149 INFO:teuthology.orchestra.run.smithi172.stdout:checking for objdir... .libs 2023-03-27T10:11:47.275 INFO:teuthology.orchestra.run.smithi172.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-03-27T10:11:47.275 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-03-27T10:11:47.311 INFO:teuthology.orchestra.run.smithi172.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-03-27T10:11:47.346 INFO:teuthology.orchestra.run.smithi172.stdout:checking if gcc static flag -static works... no 2023-03-27T10:11:47.394 INFO:teuthology.orchestra.run.smithi172.stdout:checking if gcc supports -c -o file.o... yes 2023-03-27T10:11:47.394 INFO:teuthology.orchestra.run.smithi172.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-03-27T10:11:47.407 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-03-27T10:11:47.453 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether -lc should be explicitly linked in... no 2023-03-27T10:11:47.548 INFO:teuthology.orchestra.run.smithi172.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-03-27T10:11:47.548 INFO:teuthology.orchestra.run.smithi172.stdout:checking how to hardcode library paths into programs... immediate 2023-03-27T10:11:47.560 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether stripping libraries is possible... yes 2023-03-27T10:11:47.561 INFO:teuthology.orchestra.run.smithi172.stdout:checking if libtool supports shared libraries... yes 2023-03-27T10:11:47.561 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether to build shared libraries... yes 2023-03-27T10:11:47.561 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether to build static libraries... yes 2023-03-27T10:11:47.571 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gcc... (cached) gcc 2023-03-27T10:11:47.605 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-03-27T10:11:47.606 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether gcc accepts -g... (cached) yes 2023-03-27T10:11:47.606 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-03-27T10:11:47.606 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gmake... /usr/bin/gmake 2023-03-27T10:11:47.606 INFO:teuthology.orchestra.run.smithi172.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-03-27T10:11:47.607 INFO:teuthology.orchestra.run.smithi172.stdout:checking for tar... /bin/tar 2023-03-27T10:11:47.607 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gzip... /bin/gzip 2023-03-27T10:11:47.621 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether gcc -MM is supported... yes 2023-03-27T10:11:47.626 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sort... /bin/sort 2023-03-27T10:11:47.626 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether ln -s works... yes 2023-03-27T10:11:47.626 INFO:teuthology.orchestra.run.smithi172.stdout:checking for rpm... /bin/rpm 2023-03-27T10:11:47.630 INFO:teuthology.orchestra.run.smithi172.stdout:checking for rpmbuild... no 2023-03-27T10:11:47.676 INFO:teuthology.orchestra.run.smithi172.stdout:checking assert.h usability... yes 2023-03-27T10:11:47.693 INFO:teuthology.orchestra.run.smithi172.stdout:checking assert.h presence... yes 2023-03-27T10:11:47.693 INFO:teuthology.orchestra.run.smithi172.stdout:checking for assert.h... yes 2023-03-27T10:11:47.746 INFO:teuthology.orchestra.run.smithi172.stdout:checking bstring.h usability... no 2023-03-27T10:11:47.767 INFO:teuthology.orchestra.run.smithi172.stdout:checking bstring.h presence... no 2023-03-27T10:11:47.767 INFO:teuthology.orchestra.run.smithi172.stdout:checking for bstring.h... no 2023-03-27T10:11:47.821 INFO:teuthology.orchestra.run.smithi172.stdout:checking libgen.h usability... yes 2023-03-27T10:11:47.836 INFO:teuthology.orchestra.run.smithi172.stdout:checking libgen.h presence... yes 2023-03-27T10:11:47.836 INFO:teuthology.orchestra.run.smithi172.stdout:checking for libgen.h... yes 2023-03-27T10:11:47.891 INFO:teuthology.orchestra.run.smithi172.stdout:checking dirent.h usability... yes 2023-03-27T10:11:47.907 INFO:teuthology.orchestra.run.smithi172.stdout:checking dirent.h presence... yes 2023-03-27T10:11:47.907 INFO:teuthology.orchestra.run.smithi172.stdout:checking for dirent.h... yes 2023-03-27T10:11:47.990 INFO:teuthology.orchestra.run.smithi172.stdout:checking errno.h usability... yes 2023-03-27T10:11:48.005 INFO:teuthology.orchestra.run.smithi172.stdout:checking errno.h presence... yes 2023-03-27T10:11:48.005 INFO:teuthology.orchestra.run.smithi172.stdout:checking for errno.h... yes 2023-03-27T10:11:48.059 INFO:teuthology.orchestra.run.smithi172.stdout:checking malloc.h usability... yes 2023-03-27T10:11:48.075 INFO:teuthology.orchestra.run.smithi172.stdout:checking malloc.h presence... yes 2023-03-27T10:11:48.076 INFO:teuthology.orchestra.run.smithi172.stdout:checking for malloc.h... yes 2023-03-27T10:11:48.127 INFO:teuthology.orchestra.run.smithi172.stdout:checking uuid.h usability... no 2023-03-27T10:11:48.149 INFO:teuthology.orchestra.run.smithi172.stdout:checking uuid.h presence... no 2023-03-27T10:11:48.149 INFO:teuthology.orchestra.run.smithi172.stdout:checking for uuid.h... no 2023-03-27T10:11:48.214 INFO:teuthology.orchestra.run.smithi172.stdout:checking uuid/uuid.h usability... yes 2023-03-27T10:11:48.231 INFO:teuthology.orchestra.run.smithi172.stdout:checking uuid/uuid.h presence... yes 2023-03-27T10:11:48.232 INFO:teuthology.orchestra.run.smithi172.stdout:checking for uuid/uuid.h... yes 2023-03-27T10:11:48.284 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/uuid.h usability... no 2023-03-27T10:11:48.306 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/uuid.h presence... no 2023-03-27T10:11:48.306 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/uuid.h... no 2023-03-27T10:11:48.354 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/file.h usability... yes 2023-03-27T10:11:48.369 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/file.h presence... yes 2023-03-27T10:11:48.370 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/file.h... yes 2023-03-27T10:11:48.423 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/fcntl.h usability... yes 2023-03-27T10:11:48.439 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/fcntl.h presence... yes 2023-03-27T10:11:48.439 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/fcntl.h... yes 2023-03-27T10:11:48.491 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/syssgi.h usability... no 2023-03-27T10:11:48.513 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/syssgi.h presence... no 2023-03-27T10:11:48.514 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/syssgi.h... no 2023-03-27T10:11:48.581 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/param.h usability... yes 2023-03-27T10:11:48.601 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/param.h presence... yes 2023-03-27T10:11:48.601 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/param.h... yes 2023-03-27T10:11:48.613 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/stat.h... (cached) yes 2023-03-27T10:11:48.667 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/statvfs.h usability... yes 2023-03-27T10:11:48.682 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/statvfs.h presence... yes 2023-03-27T10:11:48.682 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/statvfs.h... yes 2023-03-27T10:11:48.736 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/time.h usability... yes 2023-03-27T10:11:48.752 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/time.h presence... yes 2023-03-27T10:11:48.752 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/time.h... yes 2023-03-27T10:11:48.821 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/ioctl.h usability... yes 2023-03-27T10:11:48.836 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/ioctl.h presence... yes 2023-03-27T10:11:48.836 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/ioctl.h... yes 2023-03-27T10:11:48.892 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/wait.h usability... yes 2023-03-27T10:11:48.910 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/wait.h presence... yes 2023-03-27T10:11:48.910 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/wait.h... yes 2023-03-27T10:11:48.923 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/types.h... (cached) yes 2023-03-27T10:11:48.935 INFO:teuthology.orchestra.run.smithi172.stdout:checking for strings.h... (cached) yes 2023-03-27T10:11:48.989 INFO:teuthology.orchestra.run.smithi172.stdout:checking err.h usability... yes 2023-03-27T10:11:49.004 INFO:teuthology.orchestra.run.smithi172.stdout:checking err.h presence... yes 2023-03-27T10:11:49.004 INFO:teuthology.orchestra.run.smithi172.stdout:checking for err.h... yes 2023-03-27T10:11:49.057 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/falloc.h usability... yes 2023-03-27T10:11:49.071 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/falloc.h presence... yes 2023-03-27T10:11:49.072 INFO:teuthology.orchestra.run.smithi172.stdout:checking for linux/falloc.h... yes 2023-03-27T10:11:49.123 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-03-27T10:11:49.145 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-03-27T10:11:49.145 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/fs/xfs_fsops.h... no 2023-03-27T10:11:49.190 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/fs/xfs_itable.h usability... no 2023-03-27T10:11:49.212 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/fs/xfs_itable.h presence... no 2023-03-27T10:11:49.212 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/fs/xfs_itable.h... no 2023-03-27T10:11:49.257 INFO:teuthology.orchestra.run.smithi172.stdout:checking xfs/platform_defs.h usability... no 2023-03-27T10:11:49.279 INFO:teuthology.orchestra.run.smithi172.stdout:checking xfs/platform_defs.h presence... no 2023-03-27T10:11:49.279 INFO:teuthology.orchestra.run.smithi172.stdout:checking for xfs/platform_defs.h... no 2023-03-27T10:11:49.325 INFO:teuthology.orchestra.run.smithi172.stdout:checking btrfs/ioctl.h usability... no 2023-03-27T10:11:49.346 INFO:teuthology.orchestra.run.smithi172.stdout:checking btrfs/ioctl.h presence... no 2023-03-27T10:11:49.347 INFO:teuthology.orchestra.run.smithi172.stdout:checking for btrfs/ioctl.h... no 2023-03-27T10:11:49.392 INFO:teuthology.orchestra.run.smithi172.stdout:checking cifs/ioctl.h usability... no 2023-03-27T10:11:49.414 INFO:teuthology.orchestra.run.smithi172.stdout:checking cifs/ioctl.h presence... no 2023-03-27T10:11:49.414 INFO:teuthology.orchestra.run.smithi172.stdout:checking for cifs/ioctl.h... no 2023-03-27T10:11:49.467 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/mman.h usability... yes 2023-03-27T10:11:49.482 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/mman.h presence... yes 2023-03-27T10:11:49.482 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/mman.h... yes 2023-03-27T10:11:49.517 INFO:teuthology.orchestra.run.smithi172.stdout:checking for xfs/xfs_log_format.h... no 2023-03-27T10:11:49.579 INFO:teuthology.orchestra.run.smithi172.stdout:checking for uuid_compare... no 2023-03-27T10:11:49.634 INFO:teuthology.orchestra.run.smithi172.stdout:checking for uuid_compare in -luuid... yes 2023-03-27T10:11:49.738 INFO:teuthology.orchestra.run.smithi172.stdout:checking for xfs/xfs.h... yes 2023-03-27T10:11:49.767 INFO:teuthology.orchestra.run.smithi172.stdout:checking for xfs/libxfs.h... no 2023-03-27T10:11:49.802 INFO:teuthology.orchestra.run.smithi172.stdout:checking whether xlog_assign_lsn is declared... no 2023-03-27T10:11:49.852 INFO:teuthology.orchestra.run.smithi172.stdout:checking for xfs/xqm.h... yes 2023-03-27T10:11:49.929 INFO:teuthology.orchestra.run.smithi172.stdout:checking xfsctl from xfs/xfs.h... ok 2023-03-27T10:11:49.972 INFO:teuthology.orchestra.run.smithi172.stdout:checking xfs/handle.h usability... yes 2023-03-27T10:11:49.985 INFO:teuthology.orchestra.run.smithi172.stdout:checking xfs/handle.h presence... yes 2023-03-27T10:11:49.986 INFO:teuthology.orchestra.run.smithi172.stdout:checking for xfs/handle.h... yes 2023-03-27T10:11:50.050 INFO:teuthology.orchestra.run.smithi172.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-03-27T10:11:50.094 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/acl.h usability... yes 2023-03-27T10:11:50.111 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/acl.h presence... yes 2023-03-27T10:11:50.112 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/acl.h... yes 2023-03-27T10:11:50.165 INFO:teuthology.orchestra.run.smithi172.stdout:checking acl/libacl.h usability... yes 2023-03-27T10:11:50.182 INFO:teuthology.orchestra.run.smithi172.stdout:checking acl/libacl.h presence... yes 2023-03-27T10:11:50.182 INFO:teuthology.orchestra.run.smithi172.stdout:checking for acl/libacl.h... yes 2023-03-27T10:11:50.240 INFO:teuthology.orchestra.run.smithi172.stdout:checking for acl_init in -lacl... yes 2023-03-27T10:11:50.282 INFO:teuthology.orchestra.run.smithi172.stdout:checking gdbm-ndbm.h usability... no 2023-03-27T10:11:50.304 INFO:teuthology.orchestra.run.smithi172.stdout:checking gdbm-ndbm.h presence... no 2023-03-27T10:11:50.305 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gdbm-ndbm.h... no 2023-03-27T10:11:50.346 INFO:teuthology.orchestra.run.smithi172.stdout:checking gdbm/ndbm.h usability... no 2023-03-27T10:11:50.371 INFO:teuthology.orchestra.run.smithi172.stdout:checking gdbm/ndbm.h presence... no 2023-03-27T10:11:50.371 INFO:teuthology.orchestra.run.smithi172.stdout:checking for gdbm/ndbm.h... no 2023-03-27T10:11:50.411 INFO:teuthology.orchestra.run.smithi172.stdout:checking ndbm.h usability... no 2023-03-27T10:11:50.432 INFO:teuthology.orchestra.run.smithi172.stdout:checking ndbm.h presence... no 2023-03-27T10:11:50.432 INFO:teuthology.orchestra.run.smithi172.stdout:checking for ndbm.h... no 2023-03-27T10:11:50.478 INFO:teuthology.orchestra.run.smithi172.stdout:checking libaio.h usability... yes 2023-03-27T10:11:50.497 INFO:teuthology.orchestra.run.smithi172.stdout:checking libaio.h presence... yes 2023-03-27T10:11:50.498 INFO:teuthology.orchestra.run.smithi172.stdout:checking for libaio.h... yes 2023-03-27T10:11:50.540 INFO:teuthology.orchestra.run.smithi172.stdout:checking liburing.h usability... no 2023-03-27T10:11:50.561 INFO:teuthology.orchestra.run.smithi172.stdout:checking liburing.h presence... no 2023-03-27T10:11:50.562 INFO:teuthology.orchestra.run.smithi172.stdout:checking for liburing.h... no 2023-03-27T10:11:50.603 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/capability.h usability... no 2023-03-27T10:11:50.625 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/capability.h presence... no 2023-03-27T10:11:50.626 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/capability.h... no 2023-03-27T10:11:50.667 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/fiemap.h usability... yes 2023-03-27T10:11:50.682 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/fiemap.h presence... yes 2023-03-27T10:11:50.682 INFO:teuthology.orchestra.run.smithi172.stdout:checking for linux/fiemap.h... yes 2023-03-27T10:11:50.739 INFO:teuthology.orchestra.run.smithi172.stdout:checking for fallocate... yes 2023-03-27T10:11:50.797 INFO:teuthology.orchestra.run.smithi172.stdout:checking for open_by_handle_at... yes 2023-03-27T10:11:50.841 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/prctl.h usability... yes 2023-03-27T10:11:50.857 INFO:teuthology.orchestra.run.smithi172.stdout:checking sys/prctl.h presence... yes 2023-03-27T10:11:50.857 INFO:teuthology.orchestra.run.smithi172.stdout:checking for sys/prctl.h... yes 2023-03-27T10:11:50.901 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/fs.h usability... yes 2023-03-27T10:11:50.916 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/fs.h presence... yes 2023-03-27T10:11:50.916 INFO:teuthology.orchestra.run.smithi172.stdout:checking for linux/fs.h... yes 2023-03-27T10:11:50.956 INFO:teuthology.orchestra.run.smithi172.stdout:checking btrfsutil.h usability... no 2023-03-27T10:11:50.977 INFO:teuthology.orchestra.run.smithi172.stdout:checking btrfsutil.h presence... no 2023-03-27T10:11:50.978 INFO:teuthology.orchestra.run.smithi172.stdout:checking for btrfsutil.h... no 2023-03-27T10:11:51.037 INFO:teuthology.orchestra.run.smithi172.stdout:checking for copy_file_range... yes 2023-03-27T10:11:51.097 INFO:teuthology.orchestra.run.smithi172.stdout:checking for SEEK_DATA... yes 2023-03-27T10:11:51.174 INFO:teuthology.orchestra.run.smithi172.stdout:checking for BMV_OF_SHARED... yes 2023-03-27T10:11:51.240 INFO:teuthology.orchestra.run.smithi172.stdout:checking for nftw... yes 2023-03-27T10:11:51.299 INFO:teuthology.orchestra.run.smithi172.stdout:checking for RLIMIT_NOFILE... yes 2023-03-27T10:11:51.334 INFO:teuthology.orchestra.run.smithi172.stdout:checking for FIEXCHANGE_RANGE... no 2023-03-27T10:11:51.391 INFO:teuthology.orchestra.run.smithi172.stdout:checking for renameat2... yes 2023-03-27T10:11:51.450 INFO:teuthology.orchestra.run.smithi172.stdout:checking for reallocarray... yes 2023-03-27T10:11:51.479 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct mount_attr... no 2023-03-27T10:11:51.550 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_qgroup_limit... yes 2023-03-27T10:11:51.619 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-03-27T10:11:51.688 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-03-27T10:11:51.756 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-03-27T10:11:51.825 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-03-27T10:11:51.893 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-03-27T10:11:51.961 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-03-27T10:11:52.010 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/btrfs.h usability... yes 2023-03-27T10:11:52.026 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/btrfs.h presence... yes 2023-03-27T10:11:52.026 INFO:teuthology.orchestra.run.smithi172.stdout:checking for linux/btrfs.h... yes 2023-03-27T10:11:52.087 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/btrfs_tree.h usability... yes 2023-03-27T10:11:52.102 INFO:teuthology.orchestra.run.smithi172.stdout:checking linux/btrfs_tree.h presence... yes 2023-03-27T10:11:52.103 INFO:teuthology.orchestra.run.smithi172.stdout:checking for linux/btrfs_tree.h... yes 2023-03-27T10:11:52.169 INFO:teuthology.orchestra.run.smithi172.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-03-27T10:11:52.195 INFO:teuthology.orchestra.run.smithi172.stdout:configure: creating ./config.status 2023-03-27T10:11:52.993 INFO:teuthology.orchestra.run.smithi172.stdout:config.status: creating include/builddefs 2023-03-27T10:11:53.019 INFO:teuthology.orchestra.run.smithi172.stdout:config.status: creating include/config.h 2023-03-27T10:11:53.039 INFO:teuthology.orchestra.run.smithi172.stdout:config.status: executing libtool commands 2023-03-27T10:11:53.111 INFO:teuthology.orchestra.run.smithi172.stdout:Building include 2023-03-27T10:11:53.117 INFO:teuthology.orchestra.run.smithi172.stdout:Building lib 2023-03-27T10:11:53.123 INFO:teuthology.orchestra.run.smithi172.stdout: [LTDEP] 2023-03-27T10:11:53.316 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dataascii.lo 2023-03-27T10:11:53.504 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] databin.lo 2023-03-27T10:11:53.967 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] datapid.lo 2023-03-27T10:11:54.143 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] file_lock.lo 2023-03-27T10:11:54.365 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] forker.lo 2023-03-27T10:11:54.569 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] pattern.lo 2023-03-27T10:11:54.759 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] open_flags.lo 2023-03-27T10:11:54.974 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] random_range.lo 2023-03-27T10:11:55.267 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] string_to_tokens.lo 2023-03-27T10:11:55.441 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] str_to_bytes.lo 2023-03-27T10:11:55.644 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] tlibio.lo 2023-03-27T10:11:55.952 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] write_log.lo 2023-03-27T10:11:56.264 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] random.lo 2023-03-27T10:11:56.450 INFO:teuthology.orchestra.run.smithi172.stdout: [LD] 2023-03-27T10:11:56.577 INFO:teuthology.orchestra.run.smithi172.stdout:Building ltp 2023-03-27T10:11:56.583 INFO:teuthology.orchestra.run.smithi172.stdout: [DEP] 2023-03-27T10:11:56.799 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] doio 2023-03-27T10:11:57.519 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fsstress 2023-03-27T10:11:58.865 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fsx 2023-03-27T10:11:59.794 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] growfiles 2023-03-27T10:12:00.375 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] iogen 2023-03-27T10:12:00.811 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-stress 2023-03-27T10:12:01.305 INFO:teuthology.orchestra.run.smithi172.stdout:Building src 2023-03-27T10:12:01.313 INFO:teuthology.orchestra.run.smithi172.stdout: [DEP] 2023-03-27T10:12:03.736 INFO:teuthology.orchestra.run.smithi172.stdout: [DEP] 2023-03-27T10:12:03.784 INFO:teuthology.orchestra.run.smithi172.stdout: [DEP] 2023-03-27T10:12:03.799 INFO:teuthology.orchestra.run.smithi172.stdout: [DEP] 2023-03-27T10:12:04.132 INFO:teuthology.orchestra.run.smithi172.stdout: [DEP] 2023-03-27T10:12:04.169 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dirstress 2023-03-27T10:12:04.490 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fill 2023-03-27T10:12:04.725 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fill2 2023-03-27T10:12:05.035 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] getpagesize 2023-03-27T10:12:05.252 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] holes 2023-03-27T10:12:05.530 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] lstat64 2023-03-27T10:12:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] nametest 2023-03-27T10:12:06.118 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] permname 2023-03-27T10:12:06.400 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] randholes 2023-03-27T10:12:06.734 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] runas 2023-03-27T10:12:06.994 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] truncfile 2023-03-27T10:12:07.257 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] usemem 2023-03-27T10:12:07.489 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] mmapcat 2023-03-27T10:12:07.720 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] append_reader 2023-03-27T10:12:07.953 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] append_writer 2023-03-27T10:12:08.186 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dirperf 2023-03-27T10:12:08.488 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] metaperf 2023-03-27T10:12:08.823 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] devzero 2023-03-27T10:12:09.082 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] feature 2023-03-27T10:12:09.383 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] alloc 2023-03-27T10:12:09.679 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fault 2023-03-27T10:12:09.929 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fstest 2023-03-27T10:12:10.248 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_access_root 2023-03-27T10:12:10.484 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] godown 2023-03-27T10:12:10.738 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] resvtest 2023-03-27T10:12:11.008 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] writemod 2023-03-27T10:12:11.236 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] writev_on_pagefault 2023-03-27T10:12:11.478 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] makeextents 2023-03-27T10:12:11.772 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] itrash 2023-03-27T10:12:12.009 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] rename 2023-03-27T10:12:12.230 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] multi_open_unlink 2023-03-27T10:12:12.477 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] unwritten_sync 2023-03-27T10:12:12.744 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] genhashnames 2023-03-27T10:12:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_holes 2023-03-27T10:12:13.240 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_writev 2023-03-27T10:12:13.471 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_truncate_cmtime 2023-03-27T10:12:13.711 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dirhash_collide 2023-03-27T10:12:13.974 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_rename_overwrite 2023-03-27T10:12:14.199 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] holetest 2023-03-27T10:12:14.498 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_truncate_self 2023-03-27T10:12:14.743 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] af_unix 2023-03-27T10:12:14.979 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_stale_pmd 2023-03-27T10:12:15.214 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_cow_race 2023-03-27T10:12:15.450 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:12:15.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:12:15.463 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_fallocate 2023-03-27T10:12:15.698 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fsync-err 2023-03-27T10:12:15.965 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_write_ro 2023-03-27T10:12:16.200 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_ext4_dax_journal_corruption 2023-03-27T10:12:16.441 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_ext4_dax_inline_corruption 2023-03-27T10:12:16.680 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_ofd_locks 2023-03-27T10:12:16.963 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_collision 2023-03-27T10:12:17.242 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] mmap-write-concurrent 2023-03-27T10:12:17.494 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_get_file_time 2023-03-27T10:12:17.723 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_create_short_dirs 2023-03-27T10:12:17.972 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_create_long_dirs 2023-03-27T10:12:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_enospc 2023-03-27T10:12:18.487 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_writev_overlap 2023-03-27T10:12:18.738 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] checkpoint_journal 2023-03-27T10:12:18.974 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] mmap-rw-fault 2023-03-27T10:12:19.234 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] allocstale 2023-03-27T10:12:19.487 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_cow_memory_failure 2023-03-27T10:12:19.742 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fake-dump-rootino 2023-03-27T10:12:19.975 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dio-buf-fault 2023-03-27T10:12:20.211 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] xfsctl 2023-03-27T10:12:20.483 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] bstat 2023-03-27T10:12:20.772 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mtab 2023-03-27T10:12:21.038 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] getdevicesize 2023-03-27T10:12:21.263 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] preallo_rw_pattern_reader 2023-03-27T10:12:21.508 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] preallo_rw_pattern_writer 2023-03-27T10:12:21.752 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] ftrunc 2023-03-27T10:12:21.982 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] trunc 2023-03-27T10:12:22.230 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fs_perms 2023-03-27T10:12:22.477 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] testx 2023-03-27T10:12:22.691 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] looptest 2023-03-27T10:12:22.966 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] locktest 2023-03-27T10:12:23.351 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] unwritten_mmap 2023-03-27T10:12:23.600 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] bulkstat_unlink_test 2023-03-27T10:12:23.884 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] deduperace 2023-03-27T10:12:24.160 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] bulkstat_unlink_test_modified 2023-03-27T10:12:24.440 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_dir_offset 2023-03-27T10:12:24.674 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_futimens 2023-03-27T10:12:24.896 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_immutable 2023-03-27T10:12:25.568 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] stale_handle 2023-03-27T10:12:25.825 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] pwrite_mmap_blocked 2023-03-27T10:12:26.062 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_dir_offset2 2023-03-27T10:12:26.336 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] seek_sanity_test 2023-03-27T10:12:26.825 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] seek_copy_test 2023-03-27T10:12:27.083 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_readdir_1 2023-03-27T10:12:27.315 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_readdir_2 2023-03-27T10:12:27.549 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fsync-tester 2023-03-27T10:12:27.878 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] nsexec 2023-03-27T10:12:28.138 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] cloner 2023-03-27T10:12:28.399 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] renameat2 2023-03-27T10:12:28.650 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_getcwd 2023-03-27T10:12:28.892 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] e4compact 2023-03-27T10:12:29.175 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] test-nextquota 2023-03-27T10:12:29.430 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] punch-alternating 2023-03-27T10:12:29.687 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] attr-list-by-handle-cursor-test 2023-03-27T10:12:29.940 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] listxattr 2023-03-27T10:12:30.170 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dio-interleaved 2023-03-27T10:12:30.413 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_dir_type 2023-03-27T10:12:30.655 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] dio-invalidate-cache 2023-03-27T10:12:30.941 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] stat_test 2023-03-27T10:12:31.317 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_encrypted_d_revalidate 2023-03-27T10:12:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] attr_replace_test 2023-03-27T10:12:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] swapon 2023-03-27T10:12:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] mkswap 2023-03-27T10:12:32.296 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_attr_corruption 2023-03-27T10:12:32.530 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_open_tmpfiles 2023-03-27T10:12:32.794 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fscrypt-crypt-util 2023-03-27T10:12:33.494 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] bulkstat_null_ocount 2023-03-27T10:12:33.739 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] splice-test 2023-03-27T10:12:34.003 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] chprojid_fail 2023-03-27T10:12:34.250 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] detached_mounts_propagation 2023-03-27T10:12:34.518 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] ext4_resize 2023-03-27T10:12:34.750 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_readdir_3 2023-03-27T10:12:35.025 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] splice2pipe 2023-03-27T10:12:35.271 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] uuid_ioctl 2023-03-27T10:12:35.510 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fiemap-tester 2023-03-27T10:12:35.864 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_stripealign 2023-03-27T10:12:36.100 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] open_by_handle 2023-03-27T10:12:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] t_mmap_dio 2023-03-27T10:12:36.678 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] xfsfind 2023-03-27T10:12:36.958 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] fssum 2023-03-27T10:12:37.466 INFO:teuthology.orchestra.run.smithi172.stdout:Building log-writes 2023-03-27T10:12:37.475 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] replay-log 2023-03-27T10:12:37.872 INFO:teuthology.orchestra.run.smithi172.stdout:Building perf 2023-03-27T10:12:37.878 INFO:teuthology.orchestra.run.smithi172.stdout:Building aio-dio-regress 2023-03-27T10:12:37.888 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-append-write-fallocate-race 2023-03-27T10:12:38.150 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-fcntl-race 2023-03-27T10:12:38.401 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-subblock-eof-read 2023-03-27T10:12:38.634 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-append-write-read-race 2023-03-27T10:12:38.899 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-invalidate-readahead 2023-03-27T10:12:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-write-verify 2023-03-27T10:12:39.427 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-03-27T10:12:39.650 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-cycle-write 2023-03-27T10:12:39.919 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-extend-stat 2023-03-27T10:12:40.174 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-03-27T10:12:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aiocp 2023-03-27T10:12:40.703 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-hole-filling-race 2023-03-27T10:12:40.940 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-invalidate-failure 2023-03-27T10:12:41.188 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aiodio_sparse2 2023-03-27T10:12:41.490 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-last-ref-held-by-io 2023-03-27T10:12:41.750 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-eof-race 2023-03-27T10:12:42.019 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] aio-dio-cow-race 2023-03-27T10:12:42.261 INFO:teuthology.orchestra.run.smithi172.stdout:Building vfs 2023-03-27T10:12:42.270 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] vfstest 2023-03-27T10:12:44.227 INFO:teuthology.orchestra.run.smithi172.stdout: [CC] mount-idmapped 2023-03-27T10:12:44.685 INFO:teuthology.orchestra.run.smithi172.stdout:Building m4 2023-03-27T10:12:44.692 INFO:teuthology.orchestra.run.smithi172.stdout:Building common 2023-03-27T10:12:44.699 INFO:teuthology.orchestra.run.smithi172.stdout:Building tests 2023-03-27T10:12:44.709 INFO:teuthology.orchestra.run.smithi172.stdout:Building perf 2023-03-27T10:12:44.718 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/perf/group.list 2023-03-27T10:12:44.744 INFO:teuthology.orchestra.run.smithi172.stdout:Building ext4 2023-03-27T10:12:44.753 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ext4/group.list 2023-03-27T10:12:44.837 INFO:teuthology.orchestra.run.smithi172.stdout:Building ocfs2 2023-03-27T10:12:44.846 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ocfs2/group.list 2023-03-27T10:12:44.877 INFO:teuthology.orchestra.run.smithi172.stdout:Building overlay 2023-03-27T10:12:44.886 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/overlay/group.list 2023-03-27T10:12:44.972 INFO:teuthology.orchestra.run.smithi172.stdout:Building cifs 2023-03-27T10:12:44.981 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/cifs/group.list 2023-03-27T10:12:45.009 INFO:teuthology.orchestra.run.smithi172.stdout:Building generic 2023-03-27T10:12:45.020 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/generic/group.list 2023-03-27T10:12:45.242 INFO:teuthology.orchestra.run.smithi172.stdout:Building shared 2023-03-27T10:12:45.251 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/shared/group.list 2023-03-27T10:12:45.290 INFO:teuthology.orchestra.run.smithi172.stdout:Building xfs 2023-03-27T10:12:45.301 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/xfs/group.list 2023-03-27T10:12:45.525 INFO:teuthology.orchestra.run.smithi172.stdout:Building f2fs 2023-03-27T10:12:45.534 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/f2fs/group.list 2023-03-27T10:12:45.573 INFO:teuthology.orchestra.run.smithi172.stdout:Building udf 2023-03-27T10:12:45.582 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/udf/group.list 2023-03-27T10:12:45.609 INFO:teuthology.orchestra.run.smithi172.stdout:Building ceph 2023-03-27T10:12:45.618 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ceph/group.list 2023-03-27T10:12:45.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:12:45.634 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:12:45.650 INFO:teuthology.orchestra.run.smithi172.stdout:Building nfs 2023-03-27T10:12:45.660 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/nfs/group.list 2023-03-27T10:12:45.696 INFO:teuthology.orchestra.run.smithi172.stdout:Building btrfs 2023-03-27T10:12:45.706 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/btrfs/group.list 2023-03-27T10:12:45.838 INFO:teuthology.orchestra.run.smithi172.stdout:Building tmpfs 2023-03-27T10:12:45.847 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/tmpfs/group.list 2023-03-27T10:12:45.877 INFO:teuthology.orchestra.run.smithi172.stdout:Building selftest 2023-03-27T10:12:45.886 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/selftest/group.list 2023-03-27T10:12:45.917 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo make install) 2023-03-27T10:12:46.001 INFO:teuthology.orchestra.run.smithi172.stdout:Building include 2023-03-27T10:12:46.007 INFO:teuthology.orchestra.run.smithi172.stdout:Building lib 2023-03-27T10:12:46.014 INFO:teuthology.orchestra.run.smithi172.stdout:Building ltp 2023-03-27T10:12:46.022 INFO:teuthology.orchestra.run.smithi172.stdout:Building src 2023-03-27T10:12:46.079 INFO:teuthology.orchestra.run.smithi172.stdout:Building log-writes 2023-03-27T10:12:46.085 INFO:teuthology.orchestra.run.smithi172.stdout:Building perf 2023-03-27T10:12:46.092 INFO:teuthology.orchestra.run.smithi172.stdout:Building aio-dio-regress 2023-03-27T10:12:46.099 INFO:teuthology.orchestra.run.smithi172.stdout:Building vfs 2023-03-27T10:12:46.106 INFO:teuthology.orchestra.run.smithi172.stdout:Building m4 2023-03-27T10:12:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Building common 2023-03-27T10:12:46.120 INFO:teuthology.orchestra.run.smithi172.stdout:Building tests 2023-03-27T10:12:46.130 INFO:teuthology.orchestra.run.smithi172.stdout:Building perf 2023-03-27T10:12:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/perf/group.list 2023-03-27T10:12:46.166 INFO:teuthology.orchestra.run.smithi172.stdout:Building ext4 2023-03-27T10:12:46.175 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ext4/group.list 2023-03-27T10:12:46.258 INFO:teuthology.orchestra.run.smithi172.stdout:Building ocfs2 2023-03-27T10:12:46.267 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ocfs2/group.list 2023-03-27T10:12:46.297 INFO:teuthology.orchestra.run.smithi172.stdout:Building overlay 2023-03-27T10:12:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/overlay/group.list 2023-03-27T10:12:46.391 INFO:teuthology.orchestra.run.smithi172.stdout:Building cifs 2023-03-27T10:12:46.400 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/cifs/group.list 2023-03-27T10:12:46.428 INFO:teuthology.orchestra.run.smithi172.stdout:Building generic 2023-03-27T10:12:46.440 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/generic/group.list 2023-03-27T10:12:46.657 INFO:teuthology.orchestra.run.smithi172.stdout:Building shared 2023-03-27T10:12:46.666 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/shared/group.list 2023-03-27T10:12:46.705 INFO:teuthology.orchestra.run.smithi172.stdout:Building xfs 2023-03-27T10:12:46.716 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/xfs/group.list 2023-03-27T10:12:46.932 INFO:teuthology.orchestra.run.smithi172.stdout:Building f2fs 2023-03-27T10:12:46.941 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/f2fs/group.list 2023-03-27T10:12:46.980 INFO:teuthology.orchestra.run.smithi172.stdout:Building udf 2023-03-27T10:12:46.989 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/udf/group.list 2023-03-27T10:12:47.014 INFO:teuthology.orchestra.run.smithi172.stdout:Building ceph 2023-03-27T10:12:47.023 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ceph/group.list 2023-03-27T10:12:47.056 INFO:teuthology.orchestra.run.smithi172.stdout:Building nfs 2023-03-27T10:12:47.065 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/nfs/group.list 2023-03-27T10:12:47.097 INFO:teuthology.orchestra.run.smithi172.stdout:Building btrfs 2023-03-27T10:12:47.107 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/btrfs/group.list 2023-03-27T10:12:47.235 INFO:teuthology.orchestra.run.smithi172.stdout:Building tmpfs 2023-03-27T10:12:47.244 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/tmpfs/group.list 2023-03-27T10:12:47.274 INFO:teuthology.orchestra.run.smithi172.stdout:Building selftest 2023-03-27T10:12:47.283 INFO:teuthology.orchestra.run.smithi172.stdout: [GROUP] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/selftest/group.list 2023-03-27T10:12:47.310 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-03-27T10:12:47.313 INFO:teuthology.orchestra.run.smithi172.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-27T10:12:47.313 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-03-27T10:12:47.316 INFO:teuthology.orchestra.run.smithi172.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-27T10:12:47.316 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-03-27T10:12:47.320 INFO:teuthology.orchestra.run.smithi172.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-03-27T10:12:47.340 INFO:teuthology.orchestra.run.smithi172.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-03-27T10:12:47.500 INFO:teuthology.orchestra.run.smithi172.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-03-27T10:12:47.521 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-03-27T10:12:47.548 INFO:teuthology.orchestra.run.smithi172.stdout:Building log-writes 2023-03-27T10:12:47.555 INFO:teuthology.orchestra.run.smithi172.stdout:Building perf 2023-03-27T10:12:47.561 INFO:teuthology.orchestra.run.smithi172.stdout:Building aio-dio-regress 2023-03-27T10:12:47.568 INFO:teuthology.orchestra.run.smithi172.stdout:Building vfs 2023-03-27T10:12:47.574 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake -C log-writes install 2023-03-27T10:12:47.576 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-03-27T10:12:47.597 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-03-27T10:12:47.618 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake -C perf install 2023-03-27T10:12:47.620 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-03-27T10:12:47.641 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-03-27T10:12:47.693 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-03-27T10:12:47.696 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-03-27T10:12:47.717 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aio-last-ref-held-by-io aio-dio-eof-race aio-dio-cow-race /var/lib/xfstests/src/aio-dio-regress 2023-03-27T10:12:47.843 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake -C vfs install 2023-03-27T10:12:47.845 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-03-27T10:12:47.866 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-03-27T10:12:47.894 INFO:teuthology.orchestra.run.smithi172.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-03-27T10:12:47.915 INFO:teuthology.orchestra.run.smithi172.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-03-27T10:12:50.586 INFO:teuthology.orchestra.run.smithi172.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-03-27T10:12:50.784 INFO:teuthology.orchestra.run.smithi172.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-03-27T10:12:50.835 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-03-27T10:12:50.837 INFO:teuthology.orchestra.run.smithi172.stdout:gmake[1]: Nothing to be done for 'install'. 2023-03-27T10:12:50.838 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-03-27T10:12:50.840 INFO:teuthology.orchestra.run.smithi172.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-03-27T10:12:50.860 INFO:teuthology.orchestra.run.smithi172.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-03-27T10:12:51.172 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-03-27T10:12:51.174 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/btrfs/ install 2023-03-27T10:12:51.178 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-03-27T10:12:51.199 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-03-27T10:12:53.064 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-03-27T10:12:53.084 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 240.out 095.out 140.out 265.out 208.out 008.out 040.out 104.out 004.out 021.out 233.out 194.out 152.out 055.out 133.out 109.out 188.out 033.out 252.out 270.out 237.out 088.out 257.out 202.out 137.out 210.out 102.out 125.out 037.out 035.out 243.out 192.out 282.out 267.out 178.out 284.out 052.out 062.out 256.out 207.out 228.out 065.out 247.out 273.out 168.out 251.out 036.out 087.out 089.out 258.out 215.out 115.out 015.out 250.out 191.out 046.out 051.out 011.out 177.out 219.out 119.out 244.out 128.out 232.out 028.out 248.out 162.out 147.out 242.out 143.out 276.out 189.out 220.out 148.out 120.out 020.out 002.out 171.out 261.out 135.out 142.out 092.out 072.out 048.out 130.out 038.out 129.out 029.out 229.out 211.out 111.out 155.out 134.out 170.out 260.out 157.out 034.out 161.out 246.out 175.out 216.out 116.out 043.out 110.out 010.out 001.out 114.out 138.out 074.out 277.out 187.out 184.out 153.out 146.out 160.out 291.out 274.out 264.out 071.out 061.out 239.out 047.out 200.out 100.out 139.out 286.out 269.out 039.out 222.out 196.out 098.out 290.out 080.out 070.out 060.out 206.out 106.out 006.out 167.out 217.out 117.out 017.out 159.out 158.out 085.out 057.out 212.out 204.out 059.out 254.out 279.out 281.out 225.out 235.out 007.out 253.out 025.out 124.out 024.out 172.out 063.out 058.out 169.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 068.out 045.out 186.out 209.out 053.out 255.out 164.out 154.out 094.out 241.out 084.out 165.out 141.out 214.out 014.out 176.out 278.out 041.out 016.out 156.out 067.out 005.out 223.out 086.out 123.out 179.out 236.out 227.out 032.out 182.out 205.out 136.out 144.out 096.out 198.out 108.out 190.out 280.out 050.out 105.out 185.out 091.out 266.out 285.out 183.out 056.out 201.out 019.out 101.out 079.out 151.out 231.out 081.out 075.out 069.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 272.out 078.out 173.out 259.out 132.out 093.out 197.out 263.out 127.out 230.out 027.out 299.out 023.out 073.out 030.out 203.out 103.out 003.out 245.out 145.out 249.out 122.out 234.out 022.out 174.out 066.out 009.out 090.out 224.out 181.out 076.out 149.out 064.out 077.out 218.out 118.out 018.out 238.out 107.out 262.out 054.out 150.out 049.out 082.out 226.out 126.out 026.out 166.out 180.out 268.out 275.out 221.out 121.out 112.out 012.out 195.out /var/lib/xfstests/tests/btrfs 2023-03-27T10:12:54.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ceph/ install 2023-03-27T10:12:54.955 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-03-27T10:12:54.976 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-03-27T10:12:55.022 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-03-27T10:12:55.042 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-03-27T10:12:55.089 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/cifs/ install 2023-03-27T10:12:55.092 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-03-27T10:12:55.112 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-03-27T10:12:55.133 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-03-27T10:12:55.153 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-03-27T10:12:55.174 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ext4/ install 2023-03-27T10:12:55.177 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-03-27T10:12:55.197 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-03-27T10:12:55.645 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-03-27T10:12:55.666 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 005.out 308.out 026.out 008.out 050.out 040.out 305.out 006.out 021.out 016.out 017.out 012.out 009.out 054.out 033.out 303.out 056.out 004.out 046.out 025.out 057.out 302.out 020.out 002.out 044.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 052.out 042.out 047.out 029.out 304.out 030.out 003.out 015.out 043.out 053.out 035.out 055.out 059.out 018.out 301.out 010.out 058.out 022.out 007.out 045.out 014.out 036.out 271.out 051.out 011.out 041.out 037.out 307.out 019.out 034.out 028.out 023.out /var/lib/xfstests/tests/ext4 2023-03-27T10:12:56.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/f2fs/ install 2023-03-27T10:12:56.137 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-03-27T10:12:56.158 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-03-27T10:12:56.185 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-03-27T10:12:56.205 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-03-27T10:12:56.233 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/generic/ install 2023-03-27T10:12:56.238 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-03-27T10:12:56.259 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-03-27T10:13:00.921 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-03-27T10:13:00.941 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 050.out.default 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 035.cfg 050.cfg 377.out 537.out 443.out 683.out 497.out 033.out 385.out 702.out 696.out 088.out 597.out 097.out 202.out 137.out 210.out 102.out 034.out 110.out 389.out 646.out 592.out 148.out 282.out 267.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 328.out 207.out 228.out 171.out 183.out 157.out 247.out 273.out 356.out 520.out 474.out 420.out 043.out 509.out 006.out 397.out 460.out 632.out 311.out 532.out 591.out 064.out 719.out 111.out 723.out 519.out 011.out 319.out 246.out 332.out 119.out 423.out 323.out 718.out 638.out 616.out 516.out 416.out 216.out 116.out 358.out 338.out 287.out 238.out 533.out 295.out 138.out 277.out 153.out 160.out 291.out 274.out 061.out 239.out 620.out 047.out 530.out 258.out 379.out 691.out 039.out 173.out 310.out 498.out 665.out 098.out 426.out 690.out 220.out 706.out 606.out 506.out 406.out 306.out 106.out 447.out 217.out 191.out 117.out 688.out 357.out 485.out 182.out 442.out 188.out 026.out 556.out 099.out 177.out 281.out 524.out 174.out 542.out 324.out 655.out 224.out 313.out 124.out 142.out 672.out 278.out 058.out 384.out 296.out 042.out 626.out 593.out 271.out 456.out 399.out 375.out 437.out 263.out 364.out 209.out 255.out 558.out 341.out 094.out 337.out 712.out 241.out 089.out 540.out 458.out 614.out 514.out 025.out 414.out 200.out 314.out 440.out 014.out 342.out 041.out 016.out 340.out 649.out 572.out 576.out 586.out 492.out 549.out 633.out 280.out 240.out 543.out 140.out 065.out 348.out 608.out 568.out 508.out 408.out 308.out 373.out 670.out 604.out 040.out 104.out 349.out 476.out 087.out 233.out 639.out 236.out 186.out 539.out 276.out 711.out 221.out 439.out 376.out 587.out 339.out 294.out 352.out 139.out 481.out 082.out 317.out 552.out 480.out 017.out 120.out 067.out 193.out 452.out 252.out 077.out 167.out 206.out 624.out 663.out 709.out 199.out 651.out 184.out 409.out 466.out 309.out 495.out 725.out 109.out 625.out 283.out 488.out 673.out 390.out 325.out 465.out 225.out 322.out 636.out 125.out 715.out 279.out 615.out 222.out 650.out 152.out 658.out 315.out 563.out 143.out 451.out 551.out 015.out 392.out 682.out 595.out 578.out 642.out 550.out 052.out 062.out 716.out 351.out 298.out 571.out 583.out 450.out 463.out 674.out 251.out 176.out 069.out 644.out 446.out 489.out 487.out 544.out 395.out 515.out 415.out 344.out 215.out 115.out 250.out 244.out 391.out 681.out 594.out 605.out 156.out 536.out 577.out 030.out 436.out 128.out 637.out 336.out 234.out 144.out 505.out 667.out 136.out 363.out 496.out 198.out 108.out 008.out 680.out 705.out 178.out 405.out 305.out 205.out 105.out 005.out 367.out 523.out 517.out 619.out 727.out 685.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 003.out 695.out 079.out 237.out 151.out 473.out 163.out 127.out 661.out 664.out 187.out 027.out 478.out 612.out 584.out 462.out 623.out 350.out 132.out 037.out 693.out 483.out 499.out 112.out 044.out 660.out 063.out 561.out 343.out 648.out 362.out 387.out 194.out 335.out 721.out 289.out 699.out 284.out 333.out 477.out 621.out 290.out 560.out 419.out 581.out 076.out 707.out 647.out 457.out 493.out 007.out 448.out 262.out 380.out 093.out 479.out 662.out 547.out 192.out 326.out 668.out 413.out 126.out 555.out 580.out 021.out 694.out 347.out 675.out 361.out 564.out 066.out 455.out 432.out 585.out 162.out 686.out 147.out 288.out 197.out 396.out 051.out 145.out 429.out 355.out 381.out 360.out 374.out 261.out 045.out 292.out 304.out 482.out 372.out 046.out 726.out 378.out 534.out 231.out 434.out 503.out 526.out 329.out 229.out 129.out 441.out 371.out 243.out 671.out 134.out 190.out 260.out 226.out 095.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 032.out 266.out 146.out 398.out 366.out 161.out 427.out 590.out 470.out 484.out 491.out 185.out 656.out 677.out 285.out 631.out 654.out 359.out 501.out 401.out 155.out 431.out 635.out 494.out 687.out 722.out 331.out 613.out 513.out 554.out 131.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 596.out 272.out 268.out 627.out 573.out 430.out 569.out 454.out 259.out 692.out 449.out 327.out 330.out 643.out 227.out 010.out 230.out 071.out 083.out 130.out 219.out 370.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 004.out 386.out 521.out 055.out 275.out 461.out 334.out 622.out 724.out 522.out 422.out 394.out 598.out 249.out 122.out 689.out 166.out 022.out 424.out 346.out 684.out 490.out 090.out 353.out 181.out 676.out 149.out 618.out 518.out 018.out 418.out 318.out 024.out 218.out 118.out 575.out 232.out 172.out 168.out 293.out 060.out 469.out 054.out 059.out 049.out 657.out 180.out 270.out 421.out 299.out 321.out 057.out 512.out 412.out 312.out 121.out 538.out 256.out 012.out 195.out 028.out 438.out 471.out 070.out 433.out 720.out 565.out 248.out 445.out 316.out 525.out 242.out 679.out 320.out 629.out 602.out 502.out 402.out 302.out 020.out 529.out 002.out 717.out 617.out 417.out 365.out 092.out 369.out 475.out 072.out 068.out 154.out 038.out 084.out 056.out 611.out 511.out 411.out 029.out 211.out 257.out 170.out 053.out 133.out 286.out 713.out 245.out 175.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 410.out 548.out 701.out 601.out 301.out 201.out 101.out 001.out 214.out 048.out 589.out 074.out 164.out 697.out 641.out 091.out 081.out 634.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 368.out 100.out 464.out 354.out 541.out 086.out 269.out 546.out 652.out 698.out 553.out 196.out 444.out 080.out 708.out 609.out 507.out 407.out 307.out 208.out 107.out 009.out 567.out 150.out 557.out 453.out 666.out 078.out 159.out 566.out 582.out 383.out 574.out 085.out 704.out 588.out 212.out 504.out 404.out 189.out 204.out 535.out 425.out 467.out 254.out 531.out 073.out 235.out 703.out 253.out 165.out 264.out 678.out 141.out 265.out 169.out 114.out 640.out 579.out 096.out 297.out 393.out 599.out /var/lib/xfstests/tests/generic 2023-03-27T10:13:05.669 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/nfs/ install 2023-03-27T10:13:05.671 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-03-27T10:13:05.692 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-03-27T10:13:05.712 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-03-27T10:13:05.733 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-03-27T10:13:05.754 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/ocfs2/ install 2023-03-27T10:13:05.756 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-03-27T10:13:05.777 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-03-27T10:13:05.797 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-03-27T10:13:05.818 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-03-27T10:13:05.839 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/overlay/ install 2023-03-27T10:13:05.842 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-03-27T10:13:05.863 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-03-27T10:13:06.489 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-03-27T10:13:06.509 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 051.out 101.out 034.out 048.out 037.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 077.out 072.out 078.out 063.out 058.out 062.out 038.out 036.out 042.out 052.out 067.out 029.out 010.out 111.out 027.out 112.out 073.out 068.out 030.out 103.out 003.out 017.out 055.out 053.out 116.out 043.out 059.out 014.out 018.out 110.out 057.out 076.out 022.out 106.out 006.out 115.out 045.out 001.out 064.out 114.out 074.out 024.out 071.out 061.out 035.out 011.out 041.out 047.out 100.out 019.out 105.out 104.out 028.out 069.out 023.out 049.out 032.out 039.out 005.out 008.out 065.out 026.out 056.out 070.out 108.out 050.out 040.out 107.out 009.out 075.out 004.out 021.out 046.out 016.out 025.out 066.out 012.out 109.out 007.out 033.out 054.out 044.out /var/lib/xfstests/tests/overlay 2023-03-27T10:13:07.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/perf/ install 2023-03-27T10:13:07.143 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-03-27T10:13:07.163 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-03-27T10:13:07.184 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-03-27T10:13:07.204 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-03-27T10:13:07.225 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/selftest/ install 2023-03-27T10:13:07.228 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-03-27T10:13:07.248 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-03-27T10:13:07.301 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-03-27T10:13:07.322 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 006.out 005.out 003.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-03-27T10:13:07.375 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/shared/ install 2023-03-27T10:13:07.377 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-03-27T10:13:07.397 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-03-27T10:13:07.431 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-03-27T10:13:07.451 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-03-27T10:13:07.485 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/tmpfs/ install 2023-03-27T10:13:07.488 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-03-27T10:13:07.509 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-03-27T10:13:07.529 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-03-27T10:13:07.550 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-03-27T10:13:07.570 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/udf/ install 2023-03-27T10:13:07.573 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-03-27T10:13:07.593 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-03-27T10:13:07.614 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-03-27T10:13:07.634 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-03-27T10:13:07.655 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/tests/xfs/ install 2023-03-27T10:13:07.661 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-03-27T10:13:07.681 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-03-27T10:13:12.102 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-03-27T10:13:12.122 INFO:teuthology.orchestra.run.smithi172.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 096.out.internal 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 349.out 067.out 537.out 497.out 337.out 385.out 489.out 460.out 088.out 097.out 296.out 137.out 102.out 343.out 574.out 389.out 593.out 243.out 592.out 148.out 284.out 282.out 267.out 072.out 472.out 468.out 528.out 769.out 428.out 328.out 207.out 228.out 128.out 171.out 183.out 157.out 247.out 273.out 520.out 555.out 709.out 109.out 595.out 506.out 313.out 789.out 195.out 732.out 397.out 532.out 191.out 281.out 064.out 719.out 723.out 519.out 011.out 131.out 319.out 467.out 332.out 119.out 775.out 323.out 260.out 095.out 034.out 757.out 161.out 246.out 518.out 416.out 116.out 043.out 358.out 338.out 287.out 238.out 533.out 295.out 138.out 189.out 263.out 765.out 187.out 153.out 160.out 291.out 061.out 239.out 047.out 772.out 530.out 258.out 379.out 322.out 039.out 173.out 526.out 498.out 742.out 098.out 426.out 290.out 220.out 060.out 406.out 306.out 206.out 106.out 006.out 447.out 003.out 217.out 120.out 117.out 357.out 783.out 485.out 589.out 442.out 188.out 030.out 342.out 177.out 174.out 771.out 324.out 224.out 050.out 767.out 124.out 142.out 278.out 063.out 058.out 741.out 384.out 262.out 042.out 377.out 193.out 799.out 271.out 456.out 399.out 770.out 437.out 309.out 441.out 255.out 740.out 356.out 766.out 341.out 094.out 712.out 241.out 089.out 540.out 256.out 514.out 516.out 414.out 314.out 440.out 074.out 056.out 041.out 340.out 156.out 572.out 393.out 586.out 521.out 240.out 549.out 092.out 280.out 543.out 140.out 348.out 249.out 568.out 185.out 508.out 408.out 308.out 208.out 380.out 040.out 104.out 582.out 735.out 383.out 085.out 066.out 588.out 212.out 504.out 404.out 776.out 204.out 535.out 795.out 733.out 487.out 254.out 335.out 387.out 107.out 556.out 253.out 165.out 264.out 784.out 373.out 265.out 169.out 579.out 018.out 793.out 476.out 087.out 739.out 068.out 233.out 752.out 736.out 236.out 773.out 186.out 539.out 279.out 133.out 711.out 439.out 376.out 587.out 339.out 294.out 352.out 139.out 481.out 082.out 390.out 552.out 781.out 017.out 768.out 444.out 452.out 020.out 252.out 585.out 751.out 563.out 167.out 164.out 794.out 199.out 184.out 509.out 409.out 466.out 495.out 785.out 424.out 222.out 283.out 750.out 297.out 325.out 465.out 225.out 744.out 125.out 715.out 581.out 152.out 774.out 122.out 551.out 015.out 792.out 075.out 748.out 578.out 550.out 052.out 062.out 716.out 577.out 571.out 583.out 451.out 425.out 450.out 463.out 542.out 176.out 069.out 762.out 544.out 728.out 395.out 515.out 415.out 315.out 344.out 215.out 115.out 351.out 250.out 391.out 363.out 244.out 475.out 536.out 436.out 480.out 336.out 086.out 144.out 505.out 405.out 205.out 136.out 496.out 198.out 008.out 790.out 178.out 305.out 458.out 105.out 005.out 523.out 761.out 025.out 517.out 423.out 150.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 079.out 237.out 151.out 760.out 591.out 473.out 163.out 127.out 796.out 232.out 038.out 584.out 462.out 350.out 132.out 037.out 251.out 483.out 499.out 112.out 044.out 561.out 758.out 362.out 194.out 438.out 076.out 289.out 545.out 333.out 477.out 548.out 560.out 419.out 474.out 235.out 461.out 445.out 786.out 007.out 448.out 093.out 479.out 547.out 192.out 221.out 326.out 226.out 078.out 413.out 126.out 026.out 580.out 021.out 488.out 347.out 275.out 361.out 564.out 788.out 455.out 747.out 558.out 162.out 083.out 147.out 288.out 197.out 396.out 446.out 051.out 145.out 143.out 355.out 360.out 101.out 261.out 734.out 755.out 292.out 304.out 482.out 372.out 046.out 272.out 729.out 378.out 484.out 534.out 434.out 503.out 403.out 329.out 334.out 155.out 234.out 134.out 190.out 368.out 722.out 486.out 223.out 123.out 179.out 023.out 032.out 798.out 277.out 146.out 398.out 366.out 427.out 590.out 470.out 491.out 749.out 016.out 227.out 731.out 782.out 374.out 154.out 285.out 359.out 531.out 301.out 431.out 266.out 331.out 791.out 743.out 457.out 231.out 081.out 513.out 554.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 726.out 182.out 727.out 268.out 754.out 573.out 430.out 454.out 259.out 210.out 449.out 327.out 330.out 777.out 493.out 010.out 230.out 027.out 764.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 103.out 345.out 004.out 386.out 055.out 035.out 245.out 724.out 522.out 787.out 745.out 422.out 394.out 159.out 432.out 524.out 381.out 166.out 022.out 346.out 045.out 435.out 090.out 353.out 375.out 181.out 566.out 718.out 149.out 443.out 418.out 318.out 024.out 218.out 118.out 575.out 780.out 172.out 168.out 293.out 392.out 469.out 054.out 059.out 049.out 738.out 721.out 180.out 270.out 421.out 299.out 321.out 057.out 512.out 494.out 412.out 312.out 121.out 538.out 797.out 012.out 028.out 070.out 433.out 720.out 565.out 248.out 316.out 525.out 242.out 576.out 420.out 478.out 320.out 077.out 502.out 402.out 302.out 202.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 492.out 369.out 759.out 778.out 229.out 737.out 084.out 129.out 594.out 511.out 411.out 029.out 311.out 211.out 111.out 257.out 170.out 053.out 065.out 713.out 756.out 175.out 714.out 559.out 710.out 036.out 510.out 274.out 410.out 310.out 501.out 401.out 110.out 201.out 001.out 141.out 214.out 048.out 276.out 114.out 753.out 014.out 459.out 091.out 746.out 800.out 500.out 400.out 300.out 200.out 100.out 464.out 354.out 471.out 286.out 541.out 779.out 269.out 546.out 099.out 553.out 763.out 298.out 196.out 490.out 080.out 708.out 507.out 407.out 307.out 209.out 108.out 009.out 567.out 557.out 453.out 364.out 725.out /var/lib/xfstests/tests/xfs 2023-03-27T10:13:15.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:13:15.822 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:13:16.620 INFO:teuthology.orchestra.run.smithi172.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-03-27T10:13:16.641 INFO:teuthology.orchestra.run.smithi172.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-03-27T10:13:16.661 INFO:teuthology.orchestra.run.smithi172.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-03-27T10:13:16.682 INFO:teuthology.orchestra.run.smithi172.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-03-27T10:13:16.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-27T10:13:16.706 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec ls tests/generic) 2023-03-27T10:13:16.749 INFO:teuthology.orchestra.run.smithi172.stdout:001 2023-03-27T10:13:16.749 INFO:teuthology.orchestra.run.smithi172.stdout:001.out 2023-03-27T10:13:16.749 INFO:teuthology.orchestra.run.smithi172.stdout:002 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:002.out 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:003 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:003.out 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:004 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:004.out 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:005 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:005.out 2023-03-27T10:13:16.750 INFO:teuthology.orchestra.run.smithi172.stdout:006 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:006.out 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:007 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:007.out 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:008 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:008.out 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:009 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:009.out 2023-03-27T10:13:16.751 INFO:teuthology.orchestra.run.smithi172.stdout:010 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:010.out 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:011 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:011.out 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:012 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:012.out 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:013 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:013.out 2023-03-27T10:13:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:014 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:014.out 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:015 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:015.out 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:016 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:016.out 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:017 2023-03-27T10:13:16.753 INFO:teuthology.orchestra.run.smithi172.stdout:017.out 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:018 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:018.out 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:019 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:019.out 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:020 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:020.out 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:021 2023-03-27T10:13:16.754 INFO:teuthology.orchestra.run.smithi172.stdout:021.out 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:022 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:022.out 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:023 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:023.out 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:024 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:024.out 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:025 2023-03-27T10:13:16.755 INFO:teuthology.orchestra.run.smithi172.stdout:025.out 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:026 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:026.out 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:027 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:027.out 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:028 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:028.out 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:029 2023-03-27T10:13:16.756 INFO:teuthology.orchestra.run.smithi172.stdout:029.out 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:030 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:030.out 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:031 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:031.out 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:032 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:032.out 2023-03-27T10:13:16.757 INFO:teuthology.orchestra.run.smithi172.stdout:033 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:033.out 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:034 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:034.out 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:035 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:035.cfg 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:035.out.default 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:035.out.nfs 2023-03-27T10:13:16.758 INFO:teuthology.orchestra.run.smithi172.stdout:036 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:036.out 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:037 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:037.out 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:038 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:038.out 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:039 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:039.out 2023-03-27T10:13:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:040 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:040.out 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:041 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:041.out 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:042 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:042.out 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:043 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:043.out 2023-03-27T10:13:16.760 INFO:teuthology.orchestra.run.smithi172.stdout:044 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:044.out 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:045 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:045.out 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:046 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:046.out 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:047 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:047.out 2023-03-27T10:13:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:048 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:048.out 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:049 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:049.out 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:050 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:050.cfg 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:050.out.default 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:050.out.nojournal 2023-03-27T10:13:16.762 INFO:teuthology.orchestra.run.smithi172.stdout:050.out.xfsquota 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:051 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:051.out 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:052 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:052.out 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:053 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:053.out 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:054 2023-03-27T10:13:16.763 INFO:teuthology.orchestra.run.smithi172.stdout:054.out 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:055 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:055.out 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:056 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:056.out 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:057 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:057.out 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:058 2023-03-27T10:13:16.764 INFO:teuthology.orchestra.run.smithi172.stdout:058.out 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:059 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:059.out 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:060 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:060.out 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:061 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:061.out 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:062 2023-03-27T10:13:16.765 INFO:teuthology.orchestra.run.smithi172.stdout:062.out 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:063 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:063.out 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:064 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:064.out 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:065 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:065.out 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:066 2023-03-27T10:13:16.766 INFO:teuthology.orchestra.run.smithi172.stdout:066.out 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:067 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:067.out 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:068 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:068.out 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:069 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:069.out 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:070 2023-03-27T10:13:16.767 INFO:teuthology.orchestra.run.smithi172.stdout:070.out 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:071 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:071.out 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:072 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:072.out 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:073 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:073.out 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:074 2023-03-27T10:13:16.768 INFO:teuthology.orchestra.run.smithi172.stdout:074.out 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:075 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:075.out 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:076 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:076.out 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:077 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:077.out 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:078 2023-03-27T10:13:16.769 INFO:teuthology.orchestra.run.smithi172.stdout:078.out 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:079 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:079.out 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:080 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:080.out 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:081 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:081.out 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:082 2023-03-27T10:13:16.770 INFO:teuthology.orchestra.run.smithi172.stdout:082.out 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:083 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:083.out 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:084 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:084.out 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:085 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:085.out 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:086 2023-03-27T10:13:16.771 INFO:teuthology.orchestra.run.smithi172.stdout:086.out 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:087 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:087.out 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:088 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:088.out 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:089 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:089.out 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:090 2023-03-27T10:13:16.772 INFO:teuthology.orchestra.run.smithi172.stdout:090.out 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:091 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:091.out 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:092 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:092.out 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:093 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:093.out 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:094 2023-03-27T10:13:16.773 INFO:teuthology.orchestra.run.smithi172.stdout:094.out 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:095 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:095.out 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:096 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:096.out 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:097 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:097.out 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:098 2023-03-27T10:13:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:098.out 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:099 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:099.out 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:100 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:100.out 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:101 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:101.out 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:102 2023-03-27T10:13:16.775 INFO:teuthology.orchestra.run.smithi172.stdout:102.out 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:103 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:103.out 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:104 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:104.out 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:105 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:105.out 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:106 2023-03-27T10:13:16.776 INFO:teuthology.orchestra.run.smithi172.stdout:106.out 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:107 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:107.out 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:108 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:108.out 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:109 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:109.out 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:110 2023-03-27T10:13:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:110.out 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:111 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:111.out 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:112 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:112.out 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:113 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:113.out 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:114 2023-03-27T10:13:16.778 INFO:teuthology.orchestra.run.smithi172.stdout:114.out 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:115 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:115.out 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:116 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:116.out 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:117 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:117.out 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:118 2023-03-27T10:13:16.779 INFO:teuthology.orchestra.run.smithi172.stdout:118.out 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:119 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:119.out 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:120 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:120.out 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:121 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:121.out 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:122 2023-03-27T10:13:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:122.out 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:123 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:123.out 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:124 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:124.out 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:125 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:125.out 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:126 2023-03-27T10:13:16.781 INFO:teuthology.orchestra.run.smithi172.stdout:126.out 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:127 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:127.out 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:128 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:128.out 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:129 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:129.out 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:130 2023-03-27T10:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:130.out 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:131 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:131.out 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:132 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:132.out 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:133 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:133.out 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:134 2023-03-27T10:13:16.783 INFO:teuthology.orchestra.run.smithi172.stdout:134.out 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:135 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:135.out 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:136 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:136.out 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:137 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:137.out 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:138 2023-03-27T10:13:16.784 INFO:teuthology.orchestra.run.smithi172.stdout:138.out 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:139 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:139.out 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:140 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:140.out 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:141 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:141.out 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:142 2023-03-27T10:13:16.785 INFO:teuthology.orchestra.run.smithi172.stdout:142.out 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:143 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:143.out 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:144 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:144.out 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:145 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:145.out 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:146 2023-03-27T10:13:16.786 INFO:teuthology.orchestra.run.smithi172.stdout:146.out 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:147 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:147.out 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:148 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:148.out 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:149 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:149.out 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:150 2023-03-27T10:13:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:150.out 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:151 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:151.out 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:152 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:152.out 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:153 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:153.out 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:154 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:154.out 2023-03-27T10:13:16.788 INFO:teuthology.orchestra.run.smithi172.stdout:155 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:155.out 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:156 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:156.out 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:157 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:157.out 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:158 2023-03-27T10:13:16.789 INFO:teuthology.orchestra.run.smithi172.stdout:158.out 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:159 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:159.out 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:160 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:160.out 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:161 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:161.out 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:162 2023-03-27T10:13:16.790 INFO:teuthology.orchestra.run.smithi172.stdout:162.out 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:163 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:163.out 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:164 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:164.out 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:165 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:165.out 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:166 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:166.out 2023-03-27T10:13:16.791 INFO:teuthology.orchestra.run.smithi172.stdout:167 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:167.out 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:168 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:168.out 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:169 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:169.out 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:170 2023-03-27T10:13:16.792 INFO:teuthology.orchestra.run.smithi172.stdout:170.out 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:171 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:171.out 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:172 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:172.out 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:173 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:173.out 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:174 2023-03-27T10:13:16.793 INFO:teuthology.orchestra.run.smithi172.stdout:174.out 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:175 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:175.out 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:176 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:176.out 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:177 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:177.out 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:178 2023-03-27T10:13:16.794 INFO:teuthology.orchestra.run.smithi172.stdout:178.out 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:179 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:179.out 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:180 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:180.out 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:181 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:181.out 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:182 2023-03-27T10:13:16.795 INFO:teuthology.orchestra.run.smithi172.stdout:182.out 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:183 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:183.out 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:184 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:184.out 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:185 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:185.out 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:186 2023-03-27T10:13:16.796 INFO:teuthology.orchestra.run.smithi172.stdout:186.out 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:187 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:187.out 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:188 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:188.out 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:189 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:189.out 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:190 2023-03-27T10:13:16.797 INFO:teuthology.orchestra.run.smithi172.stdout:190.out 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:191 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:191.out 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:192 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:192.out 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:193 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:193.out 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:194 2023-03-27T10:13:16.798 INFO:teuthology.orchestra.run.smithi172.stdout:194.out 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:195 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:195.out 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:196 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:196.out 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:197 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:197.out 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:198 2023-03-27T10:13:16.799 INFO:teuthology.orchestra.run.smithi172.stdout:198.out 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:199 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:199.out 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:200 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:200.out 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:201 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:201.out 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:202 2023-03-27T10:13:16.800 INFO:teuthology.orchestra.run.smithi172.stdout:202.out 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:203 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:203.out 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:204 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:204.out 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:205 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:205.out 2023-03-27T10:13:16.801 INFO:teuthology.orchestra.run.smithi172.stdout:206 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:206.out 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:207 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:207.out 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:208 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:208.out 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:209 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:209.out 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:210 2023-03-27T10:13:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:210.out 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:211 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:211.out 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:212 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:212.out 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:213 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:213.out 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:214 2023-03-27T10:13:16.803 INFO:teuthology.orchestra.run.smithi172.stdout:214.out 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:215 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:215.out 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:216 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:216.out 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:217 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:217.out 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:218 2023-03-27T10:13:16.804 INFO:teuthology.orchestra.run.smithi172.stdout:218.out 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:219 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:219.out 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:220 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:220.out 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:221 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:221.out 2023-03-27T10:13:16.805 INFO:teuthology.orchestra.run.smithi172.stdout:222 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:222.out 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:223 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:223.out 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:224 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:224.out 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:225 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:225.out 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:226 2023-03-27T10:13:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:226.out 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:227 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:227.out 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:228 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:228.out 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:229 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:229.out 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:230 2023-03-27T10:13:16.807 INFO:teuthology.orchestra.run.smithi172.stdout:230.out 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:231 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:231.out 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:232 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:232.out 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:233 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:233.out 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:234 2023-03-27T10:13:16.808 INFO:teuthology.orchestra.run.smithi172.stdout:234.out 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:235 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:235.out 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:236 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:236.out 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:237 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:237.out 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:238 2023-03-27T10:13:16.809 INFO:teuthology.orchestra.run.smithi172.stdout:238.out 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:239 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:239.out 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:240 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:240.out 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:241 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:241.out 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:242 2023-03-27T10:13:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:242.out 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:243 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:243.out 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:244 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:244.out 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:245 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:245.out 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:246 2023-03-27T10:13:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:246.out 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:247 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:247.out 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:248 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:248.out 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:249 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:249.out 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:250 2023-03-27T10:13:16.812 INFO:teuthology.orchestra.run.smithi172.stdout:250.out 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:251 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:251.out 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:252 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:252.out 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:253 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:253.out 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:254 2023-03-27T10:13:16.813 INFO:teuthology.orchestra.run.smithi172.stdout:254.out 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:255 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:255.out 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:256 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:256.out 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:257 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:257.out 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:258 2023-03-27T10:13:16.814 INFO:teuthology.orchestra.run.smithi172.stdout:258.out 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:259 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:259.out 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:260 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:260.out 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:261 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:261.out 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:262 2023-03-27T10:13:16.815 INFO:teuthology.orchestra.run.smithi172.stdout:262.out 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:263 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:263.out 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:264 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:264.out 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:265 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:265.out 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:266 2023-03-27T10:13:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:266.out 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:267 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:267.out 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:268 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:268.out 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:269 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:269.out 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:270 2023-03-27T10:13:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:270.out 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:271 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:271.out 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:272 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:272.out 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:273 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:273.out 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:274 2023-03-27T10:13:16.818 INFO:teuthology.orchestra.run.smithi172.stdout:274.out 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:275 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:275.out 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:276 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:276.out 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:277 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:277.out 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:278 2023-03-27T10:13:16.819 INFO:teuthology.orchestra.run.smithi172.stdout:278.out 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:279 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:279.out 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:280 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:280.out 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:281 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:281.out 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:282 2023-03-27T10:13:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:282.out 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:283 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:283.out 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:284 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:284.out 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:285 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:285.out 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:286 2023-03-27T10:13:16.821 INFO:teuthology.orchestra.run.smithi172.stdout:286.out 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:287 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:287.out 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:288 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:288.out 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:289 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:289.out 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:290 2023-03-27T10:13:16.822 INFO:teuthology.orchestra.run.smithi172.stdout:290.out 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:291 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:291.out 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:292 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:292.out 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:293 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:293.out 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:294 2023-03-27T10:13:16.823 INFO:teuthology.orchestra.run.smithi172.stdout:294.out 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:295 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:295.out 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:296 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:296.out 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:297 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:297.out 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:298 2023-03-27T10:13:16.824 INFO:teuthology.orchestra.run.smithi172.stdout:298.out 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:299 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:299.out 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:300 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:300.out 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:301 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:301.out 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:302 2023-03-27T10:13:16.825 INFO:teuthology.orchestra.run.smithi172.stdout:302.out 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:303 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:303.out 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:304 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:304.out 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:305 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:305.out 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:306 2023-03-27T10:13:16.826 INFO:teuthology.orchestra.run.smithi172.stdout:306.out 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:307 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:307.out 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:308 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:308.out 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:309 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:309.out 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:310 2023-03-27T10:13:16.827 INFO:teuthology.orchestra.run.smithi172.stdout:310.out 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:311 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:311.out 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:312 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:312.out 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:313 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:313.out 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:314 2023-03-27T10:13:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:314.out 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:315 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:315.out 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:316 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:316.out 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:317 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:317.out 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:318 2023-03-27T10:13:16.829 INFO:teuthology.orchestra.run.smithi172.stdout:318.out 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:319 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:319.out 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:320 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:320.out 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:321 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:321.out 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:322 2023-03-27T10:13:16.830 INFO:teuthology.orchestra.run.smithi172.stdout:322.out 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:323 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:323.out 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:324 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:324.out 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:325 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:325.out 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:326 2023-03-27T10:13:16.831 INFO:teuthology.orchestra.run.smithi172.stdout:326.out 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:327 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:327.out 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:328 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:328.out 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:329 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:329.out 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:330 2023-03-27T10:13:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:330.out 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:331 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:331.out 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:332 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:332.out 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:333 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:333.out 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:334 2023-03-27T10:13:16.833 INFO:teuthology.orchestra.run.smithi172.stdout:334.out 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:335 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:335.out 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:336 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:336.out 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:337 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:337.out 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:338 2023-03-27T10:13:16.834 INFO:teuthology.orchestra.run.smithi172.stdout:338.out 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:339 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:339.out 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:340 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:340.out 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:341 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:341.out 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:342 2023-03-27T10:13:16.835 INFO:teuthology.orchestra.run.smithi172.stdout:342.out 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:343 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:343.out 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:344 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:344.out 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:345 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:345.out 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:346 2023-03-27T10:13:16.836 INFO:teuthology.orchestra.run.smithi172.stdout:346.out 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:347 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:347.out 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:348 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:348.out 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:349 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:349.out 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:350 2023-03-27T10:13:16.837 INFO:teuthology.orchestra.run.smithi172.stdout:350.out 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:351 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:351.out 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:352 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:352.out 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:353 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:353.out 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:354 2023-03-27T10:13:16.838 INFO:teuthology.orchestra.run.smithi172.stdout:354.out 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:355 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:355.out 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:356 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:356.out 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:357 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:357.out 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:358 2023-03-27T10:13:16.839 INFO:teuthology.orchestra.run.smithi172.stdout:358.out 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:359 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:359.out 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:360 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:360.out 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:361 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:361.out 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:362 2023-03-27T10:13:16.840 INFO:teuthology.orchestra.run.smithi172.stdout:362.out 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:363 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:363.out 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:364 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:364.out 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:365 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:365.out 2023-03-27T10:13:16.841 INFO:teuthology.orchestra.run.smithi172.stdout:366 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:366.out 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:367 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:367.out 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:368 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:368.out 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:369 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:369.out 2023-03-27T10:13:16.842 INFO:teuthology.orchestra.run.smithi172.stdout:370 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:370.out 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:371 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:371.out 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:372 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:372.out 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:373 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:373.out 2023-03-27T10:13:16.843 INFO:teuthology.orchestra.run.smithi172.stdout:374 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:374.out 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:375 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:375.out 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:376 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:376.out 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:377 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:377.out 2023-03-27T10:13:16.844 INFO:teuthology.orchestra.run.smithi172.stdout:378 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:378.out 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:379 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:379.out 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:380 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:380.out 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:381 2023-03-27T10:13:16.845 INFO:teuthology.orchestra.run.smithi172.stdout:381.out 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:382 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:382.out 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:383 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:383.out 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:384 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:384.out 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:385 2023-03-27T10:13:16.846 INFO:teuthology.orchestra.run.smithi172.stdout:385.out 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:386 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:386.out 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:387 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:387.out 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:388 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:388.out 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:389 2023-03-27T10:13:16.847 INFO:teuthology.orchestra.run.smithi172.stdout:389.out 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:390 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:390.out 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:391 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:391.out 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:392 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:392.out 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:393 2023-03-27T10:13:16.848 INFO:teuthology.orchestra.run.smithi172.stdout:393.out 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:394 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:394.out 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:395 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:395.out 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:396 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:396.out 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:397 2023-03-27T10:13:16.849 INFO:teuthology.orchestra.run.smithi172.stdout:397.out 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:398 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:398.out 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:399 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:399.out 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:400 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:400.out 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:401 2023-03-27T10:13:16.850 INFO:teuthology.orchestra.run.smithi172.stdout:401.out 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:402 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:402.out 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:403 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:403.out 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:404 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:404.out 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:405 2023-03-27T10:13:16.851 INFO:teuthology.orchestra.run.smithi172.stdout:405.out 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:406 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:406.out 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:407 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:407.out 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:408 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:408.out 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:409 2023-03-27T10:13:16.852 INFO:teuthology.orchestra.run.smithi172.stdout:409.out 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:410 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:410.out 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:411 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:411.out 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:412 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:412.out 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:413 2023-03-27T10:13:16.853 INFO:teuthology.orchestra.run.smithi172.stdout:413.out 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:414 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:414.out 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:415 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:415.out 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:416 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:416.out 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:417 2023-03-27T10:13:16.854 INFO:teuthology.orchestra.run.smithi172.stdout:417.out 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:418 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:418.out 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:419 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:419.out 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:420 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:420.out 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:421 2023-03-27T10:13:16.855 INFO:teuthology.orchestra.run.smithi172.stdout:421.out 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:422 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:422.out 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:423 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:423.out 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:424 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:424.out 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:425 2023-03-27T10:13:16.856 INFO:teuthology.orchestra.run.smithi172.stdout:425.out 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:426 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:426.out 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:427 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:427.out 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:428 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:428.out 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:429 2023-03-27T10:13:16.857 INFO:teuthology.orchestra.run.smithi172.stdout:429.out 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:430 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:430.out 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:431 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:431.out 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:432 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:432.out 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:433 2023-03-27T10:13:16.858 INFO:teuthology.orchestra.run.smithi172.stdout:433.out 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:434 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:434.out 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:435 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:435.out 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:436 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:436.out 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:437 2023-03-27T10:13:16.859 INFO:teuthology.orchestra.run.smithi172.stdout:437.out 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:438 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:438.out 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:439 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:439.out 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:440 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:440.out 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:441 2023-03-27T10:13:16.860 INFO:teuthology.orchestra.run.smithi172.stdout:441.out 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:442 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:442.out 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:443 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:443.out 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:444 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:444.out 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:445 2023-03-27T10:13:16.861 INFO:teuthology.orchestra.run.smithi172.stdout:445.out 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:446 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:446.out 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:447 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:447.out 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:448 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:448.out 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:449 2023-03-27T10:13:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:449.out 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:450 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:450.out 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:451 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:451.out 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:452 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:452.out 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:453 2023-03-27T10:13:16.863 INFO:teuthology.orchestra.run.smithi172.stdout:453.out 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:454 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:454.out 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:455 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:455.out 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:456 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:456.out 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:457 2023-03-27T10:13:16.864 INFO:teuthology.orchestra.run.smithi172.stdout:457.out 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:458 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:458.out 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:459 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:459.out 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:460 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:460.out 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:461 2023-03-27T10:13:16.865 INFO:teuthology.orchestra.run.smithi172.stdout:461.out 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:462 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:462.out 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:463 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:463.out 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:464 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:464.out 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:465 2023-03-27T10:13:16.866 INFO:teuthology.orchestra.run.smithi172.stdout:465.out 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:466 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:466.out 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:467 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:467.out 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:468 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:468.out 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:469 2023-03-27T10:13:16.867 INFO:teuthology.orchestra.run.smithi172.stdout:469.out 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:470 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:470.out 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:471 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:471.out 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:472 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:472.out 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:473 2023-03-27T10:13:16.868 INFO:teuthology.orchestra.run.smithi172.stdout:473.out 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:474 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:474.out 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:475 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:475.out 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:476 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:476.out 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:477 2023-03-27T10:13:16.869 INFO:teuthology.orchestra.run.smithi172.stdout:477.out 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:478 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:478.out 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:479 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:479.out 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:480 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:480.out 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:481 2023-03-27T10:13:16.870 INFO:teuthology.orchestra.run.smithi172.stdout:481.out 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:482 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:482.out 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:483 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:483.out 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:484 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:484.out 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:485 2023-03-27T10:13:16.871 INFO:teuthology.orchestra.run.smithi172.stdout:485.out 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:486 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:486.out 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:487 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:487.out 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:488 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:488.out 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:489 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:489.out 2023-03-27T10:13:16.872 INFO:teuthology.orchestra.run.smithi172.stdout:490 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:490.out 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:491 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:491.out 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:492 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:492.out 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:493 2023-03-27T10:13:16.873 INFO:teuthology.orchestra.run.smithi172.stdout:493.out 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:494 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:494.out 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:495 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:495.out 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:496 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:496.out 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:497 2023-03-27T10:13:16.874 INFO:teuthology.orchestra.run.smithi172.stdout:497.out 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:498 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:498.out 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:499 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:499.out 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:500 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:500.out 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:501 2023-03-27T10:13:16.875 INFO:teuthology.orchestra.run.smithi172.stdout:501.out 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:502 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:502.out 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:503 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:503.out 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:504 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:504.out 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:505 2023-03-27T10:13:16.876 INFO:teuthology.orchestra.run.smithi172.stdout:505.out 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:506 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:506.out 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:507 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:507.out 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:508 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:508.out 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:509 2023-03-27T10:13:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:509.out 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:510 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:510.out 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:511 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:511.out 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:512 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:512.out 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:513 2023-03-27T10:13:16.878 INFO:teuthology.orchestra.run.smithi172.stdout:513.out 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:514 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:514.out 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:515 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:515.out 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:516 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:516.out 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:517 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:517.out 2023-03-27T10:13:16.879 INFO:teuthology.orchestra.run.smithi172.stdout:518 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:518.out 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:519 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:519.out 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:520 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:520.out 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:521 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:521.out 2023-03-27T10:13:16.880 INFO:teuthology.orchestra.run.smithi172.stdout:522 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:522.out 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:523 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:523.out 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:524 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:524.out 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:525 2023-03-27T10:13:16.881 INFO:teuthology.orchestra.run.smithi172.stdout:525.out 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:526 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:526.out 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:527 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:527.out 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:528 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:528.out 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:529 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:529.out 2023-03-27T10:13:16.882 INFO:teuthology.orchestra.run.smithi172.stdout:530 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:530.out 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:531 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:531.out 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:532 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:532.out 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:533 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:533.out 2023-03-27T10:13:16.883 INFO:teuthology.orchestra.run.smithi172.stdout:534 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:534.out 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:535 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:535.out 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:536 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:536.out 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:537 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:537.out 2023-03-27T10:13:16.884 INFO:teuthology.orchestra.run.smithi172.stdout:538 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:538.out 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:539 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:539.out 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:540 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:540.out 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:541 2023-03-27T10:13:16.885 INFO:teuthology.orchestra.run.smithi172.stdout:541.out 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:542 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:542.out 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:543 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:543.out 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:544 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:544.out 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:545 2023-03-27T10:13:16.886 INFO:teuthology.orchestra.run.smithi172.stdout:545.out 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:546 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:546.out 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:547 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:547.out 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:548 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:548.out 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:549 2023-03-27T10:13:16.887 INFO:teuthology.orchestra.run.smithi172.stdout:549.out 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:550 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:550.out 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:551 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:551.out 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:552 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:552.out 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:553 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:553.out 2023-03-27T10:13:16.888 INFO:teuthology.orchestra.run.smithi172.stdout:554 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:554.out 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:555 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:555.out 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:556 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:556.out 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:557 2023-03-27T10:13:16.889 INFO:teuthology.orchestra.run.smithi172.stdout:557.out 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:558 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:558.out 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:559 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:559.out 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:560 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:560.out 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:561 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:561.out 2023-03-27T10:13:16.890 INFO:teuthology.orchestra.run.smithi172.stdout:562 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:562.out 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:563 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:563.out 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:564 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:564.out 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:565 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:565.out 2023-03-27T10:13:16.891 INFO:teuthology.orchestra.run.smithi172.stdout:566 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:566.out 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:567 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:567.out 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:568 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:568.out 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:569 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:569.out 2023-03-27T10:13:16.892 INFO:teuthology.orchestra.run.smithi172.stdout:570 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:570.out 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:571 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:571.out 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:572 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:572.out 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:573 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:573.out 2023-03-27T10:13:16.893 INFO:teuthology.orchestra.run.smithi172.stdout:574 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:574.out 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:575 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:575.out 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:576 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:576.out 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:577 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:577.out 2023-03-27T10:13:16.894 INFO:teuthology.orchestra.run.smithi172.stdout:578 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:578.out 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:579 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:579.out 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:580 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:580.out 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:581 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:581.out 2023-03-27T10:13:16.895 INFO:teuthology.orchestra.run.smithi172.stdout:582 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:582.out 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:583 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:583.out 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:584 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:584.out 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:585 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:585.out 2023-03-27T10:13:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:586 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:586.out 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:587 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:587.out 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:588 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:588.out 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:589 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:589.out 2023-03-27T10:13:16.897 INFO:teuthology.orchestra.run.smithi172.stdout:590 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:590.out 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:591 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:591.out 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:592 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:592.out 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:593 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:593.out 2023-03-27T10:13:16.898 INFO:teuthology.orchestra.run.smithi172.stdout:594 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:594.out 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:595 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:595.out 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:596 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:596.out 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:597 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:597.out 2023-03-27T10:13:16.899 INFO:teuthology.orchestra.run.smithi172.stdout:598 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:598.out 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:599 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:599.out 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:600 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:600.out 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:601 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:601.out 2023-03-27T10:13:16.900 INFO:teuthology.orchestra.run.smithi172.stdout:602 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:602.out 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:603 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:603.out 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:604 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:604.out 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:605 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:605.out 2023-03-27T10:13:16.901 INFO:teuthology.orchestra.run.smithi172.stdout:606 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:606.out 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:607 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:607.out 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:608 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:608.out 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:609 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:609.out 2023-03-27T10:13:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:610 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:610.out 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:611 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:611.out 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:612 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:612.out 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:613 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:613.out 2023-03-27T10:13:16.903 INFO:teuthology.orchestra.run.smithi172.stdout:614 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:614.out 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:615 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:615.out 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:616 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:616.out 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:617 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:617.out 2023-03-27T10:13:16.904 INFO:teuthology.orchestra.run.smithi172.stdout:618 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:618.out 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:619 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:619.out 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:620 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:620.out 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:621 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:621.out 2023-03-27T10:13:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:622 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:622.out 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:623 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:623.out 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:624 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:624.out 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:625 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:625.out 2023-03-27T10:13:16.906 INFO:teuthology.orchestra.run.smithi172.stdout:626 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:626.out 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:627 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:627.out 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:628 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:628.out 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:629 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:629.out 2023-03-27T10:13:16.907 INFO:teuthology.orchestra.run.smithi172.stdout:630 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:630.out 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:631 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:631.out 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:632 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:632.out 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:633 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:633.out 2023-03-27T10:13:16.908 INFO:teuthology.orchestra.run.smithi172.stdout:634 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:634.out 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:635 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:635.out 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:636 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:636.out 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:637 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:637.out 2023-03-27T10:13:16.909 INFO:teuthology.orchestra.run.smithi172.stdout:638 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:638.out 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:639 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:639.out 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:640 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:640.out 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:641 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:641.out 2023-03-27T10:13:16.910 INFO:teuthology.orchestra.run.smithi172.stdout:642 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:642.out 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:643 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:643.out 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:644 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:644.out 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:645 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:645.out 2023-03-27T10:13:16.911 INFO:teuthology.orchestra.run.smithi172.stdout:646 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:646.out 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:647 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:647.out 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:648 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:648.out 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:649 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:649.out 2023-03-27T10:13:16.912 INFO:teuthology.orchestra.run.smithi172.stdout:650 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:650.out 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:651 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:651.out 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:652 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:652.out 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:653 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:653.out 2023-03-27T10:13:16.913 INFO:teuthology.orchestra.run.smithi172.stdout:654 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:654.out 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:655 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:655.out 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:656 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:656.out 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:657 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:657.out 2023-03-27T10:13:16.914 INFO:teuthology.orchestra.run.smithi172.stdout:658 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:658.out 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:659 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:659.out 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:660 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:660.out 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:661 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:661.out 2023-03-27T10:13:16.915 INFO:teuthology.orchestra.run.smithi172.stdout:662 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:662.out 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:663 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:663.out 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:664 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:664.out 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:665 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:665.out 2023-03-27T10:13:16.916 INFO:teuthology.orchestra.run.smithi172.stdout:666 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:666.out 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:667 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:667.out 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:668 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:668.out 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:669 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:669.out 2023-03-27T10:13:16.917 INFO:teuthology.orchestra.run.smithi172.stdout:670 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:670.out 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:671 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:671.out 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:672 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:672.out 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:673 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:673.out 2023-03-27T10:13:16.918 INFO:teuthology.orchestra.run.smithi172.stdout:674 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:674.out 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:675 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:675.out 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:676 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:676.out 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:677 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:677.out 2023-03-27T10:13:16.919 INFO:teuthology.orchestra.run.smithi172.stdout:678 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:678.out 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:679 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:679.out 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:680 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:680.out 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:681 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:681.out 2023-03-27T10:13:16.920 INFO:teuthology.orchestra.run.smithi172.stdout:682 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:682.out 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:683 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:683.out 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:684 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:684.out 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:685 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:685.out 2023-03-27T10:13:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:686 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:686.out 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:687 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:687.out 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:688 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:688.out 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:689 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:689.out 2023-03-27T10:13:16.922 INFO:teuthology.orchestra.run.smithi172.stdout:690 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:690.out 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:691 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:691.out 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:692 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:692.out 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:693 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:693.out 2023-03-27T10:13:16.923 INFO:teuthology.orchestra.run.smithi172.stdout:694 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:694.out 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:695 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:695.out 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:696 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:696.out 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:697 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:697.out 2023-03-27T10:13:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:698 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:698.out 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:699 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:699.out 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:700 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:700.out 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:701 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:701.out 2023-03-27T10:13:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:702 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:702.out 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:703 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:703.out 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:704 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:704.out 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:705 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:705.out 2023-03-27T10:13:16.926 INFO:teuthology.orchestra.run.smithi172.stdout:706 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:706.out 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:707 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:707.out 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:708 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:708.out 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:709 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:709.out 2023-03-27T10:13:16.927 INFO:teuthology.orchestra.run.smithi172.stdout:710 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:710.out 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:711 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:711.out 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:712 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:712.out 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:713 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:713.out 2023-03-27T10:13:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:714 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:714.out 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:715 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:715.out 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:716 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:716.out 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:717 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:717.out 2023-03-27T10:13:16.929 INFO:teuthology.orchestra.run.smithi172.stdout:718 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:718.out 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:719 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:719.out 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:720 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:720.out 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:721 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:721.out 2023-03-27T10:13:16.930 INFO:teuthology.orchestra.run.smithi172.stdout:722 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:722.out 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:723 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:723.out 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:724 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:724.out 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:725 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:725.out 2023-03-27T10:13:16.931 INFO:teuthology.orchestra.run.smithi172.stdout:726 2023-03-27T10:13:16.932 INFO:teuthology.orchestra.run.smithi172.stdout:726.out 2023-03-27T10:13:16.932 INFO:teuthology.orchestra.run.smithi172.stdout:727 2023-03-27T10:13:16.932 INFO:teuthology.orchestra.run.smithi172.stdout:727.out 2023-03-27T10:13:16.932 INFO:teuthology.orchestra.run.smithi172.stdout:group.list 2023-03-27T10:13:16.932 INFO:teuthology.orchestra.run.smithi172.stdout:Makefile 2023-03-27T10:13:16.933 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-03-27T10:13:17.421 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:13:17.432 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:13:17.433 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:13:17.435 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:13:17.436 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:24.851 INFO:teuthology.orchestra.run.smithi172.stdout:generic/001 7s 2023-03-27T10:13:24.863 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/001 2023-03-27T10:13:24.863 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:13:24.868 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:25.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:13:25.010 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-03-27T10:13:25.413 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:13:25.424 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:13:25.425 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:13:25.428 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:13:25.428 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:26.216 INFO:teuthology.orchestra.run.smithi172.stdout:generic/002 1s 2023-03-27T10:13:26.228 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/002 2023-03-27T10:13:26.228 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:13:26.235 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:26.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:13:26.312 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-03-27T10:13:26.717 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:13:26.728 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:13:26.729 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:13:26.732 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:13:26.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:37.148 INFO:teuthology.orchestra.run.smithi172.stdout:generic/003 - output mismatch (see /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/results//generic/003.out.bad) 2023-03-27T10:13:37.153 INFO:teuthology.orchestra.run.smithi172.stdout: --- tests/generic/003.out 2023-03-27 10:11:11.291575922 +0000 2023-03-27T10:13:37.153 INFO:teuthology.orchestra.run.smithi172.stdout: +++ /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/results//generic/003.out.bad 2023-03-27 10:13:37.147096868 +0000 2023-03-27T10:13:37.153 INFO:teuthology.orchestra.run.smithi172.stdout: @@ -1,2 +1,6 @@ 2023-03-27T10:13:37.154 INFO:teuthology.orchestra.run.smithi172.stdout: QA output created by 003 2023-03-27T10:13:37.154 INFO:teuthology.orchestra.run.smithi172.stdout: +ERROR: access time has not been updated after accessing file1 first time 2023-03-27T10:13:37.154 INFO:teuthology.orchestra.run.smithi172.stdout: +ERROR: access time has not been updated after accessing file2 2023-03-27T10:13:37.154 INFO:teuthology.orchestra.run.smithi172.stdout: +ERROR: access time has not been updated after accessing file3 second time 2023-03-27T10:13:37.154 INFO:teuthology.orchestra.run.smithi172.stdout: +ERROR: access time has not been updated after accessing file3 third time 2023-03-27T10:13:37.154 INFO:teuthology.orchestra.run.smithi172.stdout: Silence is golden 2023-03-27T10:13:37.158 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/003 2023-03-27T10:13:37.158 INFO:teuthology.orchestra.run.smithi172.stdout:Failures: generic/003 2023-03-27T10:13:37.159 INFO:teuthology.orchestra.run.smithi172.stdout:Failed 1 of 1 tests 2023-03-27T10:13:37.164 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:37.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T10:13:37.183 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-27T10:13:37.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-27T10:13:37.184 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-03-27T10:13:37.592 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:13:37.603 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:13:37.604 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:13:37.606 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:13:37.607 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:38.091 INFO:teuthology.orchestra.run.smithi172.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-03-27T10:13:38.100 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/004 2023-03-27T10:13:38.100 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/004 2023-03-27T10:13:38.100 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:13:38.105 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:38.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:13:38.139 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-03-27T10:13:38.541 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:13:38.552 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:13:38.553 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:13:38.555 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:13:38.555 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:39.280 INFO:teuthology.orchestra.run.smithi172.stdout:generic/005 1s 2023-03-27T10:13:39.291 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/005 2023-03-27T10:13:39.292 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:13:39.297 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:39.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:13:39.394 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-03-27T10:13:39.804 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:13:39.815 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:13:39.816 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:13:39.818 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:13:39.818 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:13:45.966 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:13:45.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:14:02.918 INFO:teuthology.orchestra.run.smithi172.stdout:generic/006 22s 2023-03-27T10:14:02.929 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/006 2023-03-27T10:14:02.929 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:14:02.934 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:02.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:14:02.993 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-03-27T10:14:03.612 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:14:03.623 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:14:03.624 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:14:03.626 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:14:03.626 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:16.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:14:16.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:14:46.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:14:46.359 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:14:52.619 INFO:teuthology.orchestra.run.smithi172.stdout:generic/007 49s 2023-03-27T10:14:52.630 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/007 2023-03-27T10:14:52.630 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:14:52.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:52.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:14:52.721 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-03-27T10:14:53.191 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:14:53.208 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:14:53.210 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:14:53.214 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:14:53.214 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:53.834 INFO:teuthology.orchestra.run.smithi172.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T10:14:53.843 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/008 2023-03-27T10:14:53.843 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/008 2023-03-27T10:14:53.843 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:14:53.848 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:53.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:14:53.895 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-03-27T10:14:54.301 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:14:54.312 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:14:54.313 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:14:54.315 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:14:54.315 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:54.880 INFO:teuthology.orchestra.run.smithi172.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T10:14:54.889 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/009 2023-03-27T10:14:54.890 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/009 2023-03-27T10:14:54.890 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:14:54.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:54.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:14:54.942 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-03-27T10:14:55.353 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:14:55.385 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:14:55.387 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:14:55.390 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:14:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:55.854 INFO:teuthology.orchestra.run.smithi172.stdout:generic/010 [not run] /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/src/dbtest not built 2023-03-27T10:14:55.863 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/010 2023-03-27T10:14:55.864 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/010 2023-03-27T10:14:55.864 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:14:55.869 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:14:55.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:14:55.908 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-03-27T10:14:56.299 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:14:56.310 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:14:56.311 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:14:56.313 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:14:56.313 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:15:16.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:15:16.457 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:15:38.534 INFO:teuthology.orchestra.run.smithi172.stdout:generic/011 42s 2023-03-27T10:15:38.545 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/011 2023-03-27T10:15:38.545 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:15:38.551 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:15:38.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:15:38.679 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-03-27T10:15:39.154 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:15:39.165 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:15:39.166 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:15:39.169 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:15:39.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:15:39.791 INFO:teuthology.orchestra.run.smithi172.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:15:39.800 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/012 2023-03-27T10:15:39.800 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/012 2023-03-27T10:15:39.800 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:15:39.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:15:39.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:15:39.883 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-03-27T10:15:40.284 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:15:40.294 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:15:40.295 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:15:40.298 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:15:40.298 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:15:46.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:15:46.562 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:16:17.610 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:16:17.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:16:48.187 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:16:48.223 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:16:52.342 INFO:teuthology.orchestra.run.smithi172.stdout:generic/013 72s 2023-03-27T10:16:55.180 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/013 2023-03-27T10:16:55.180 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:16:55.190 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:16:55.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:16:55.238 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-03-27T10:16:55.860 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:16:55.880 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:16:55.881 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:16:55.884 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:16:55.884 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:17:20.130 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:17:20.136 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:17:50.885 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:17:50.898 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:18:21.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:18:21.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:18:51.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:18:51.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:19:21.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:19:21.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:19:51.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:19:51.761 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:20:21.928 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:20:21.937 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:20:52.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:20:52.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:21:18.922 INFO:teuthology.orchestra.run.smithi172.stdout:generic/014 262s 2023-03-27T10:21:18.938 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/014 2023-03-27T10:21:18.938 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:18.946 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:19.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:19.010 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-03-27T10:21:19.610 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:19.627 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:19.628 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:19.631 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:19.631 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:20.264 INFO:teuthology.orchestra.run.smithi172.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T10:21:20.276 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/015 2023-03-27T10:21:20.276 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/015 2023-03-27T10:21:20.276 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:20.284 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:20.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:20.334 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-03-27T10:21:20.928 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:20.944 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:20.945 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:20.948 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:20.948 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:21.858 INFO:teuthology.orchestra.run.smithi172.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:21:21.871 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/016 2023-03-27T10:21:21.871 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/016 2023-03-27T10:21:21.871 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:21.878 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:22.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:22.028 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-03-27T10:21:22.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:21:22.353 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:21:22.704 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:22.724 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:22.725 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:22.729 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:22.730 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:23.427 INFO:teuthology.orchestra.run.smithi172.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T10:21:23.439 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/017 2023-03-27T10:21:23.439 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/017 2023-03-27T10:21:23.439 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:23.447 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:23.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:23.495 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-03-27T10:21:24.104 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:24.121 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:24.128 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:24.131 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:25.007 INFO:teuthology.orchestra.run.smithi172.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-03-27T10:21:25.040 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/018 2023-03-27T10:21:25.041 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/018 2023-03-27T10:21:25.041 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:25.049 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:25.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:25.100 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-03-27T10:21:25.681 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:25.697 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:25.699 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:25.702 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:25.702 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:26.360 INFO:teuthology.orchestra.run.smithi172.stdout:generic/019 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:21:26.374 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/019 2023-03-27T10:21:26.374 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/019 2023-03-27T10:21:26.374 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:26.382 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:26.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:26.422 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-03-27T10:21:27.030 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:27.046 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:27.046 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:27.051 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:27.051 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:38.547 INFO:teuthology.orchestra.run.smithi172.stdout:generic/020 11s 2023-03-27T10:21:38.564 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/020 2023-03-27T10:21:38.564 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:38.573 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:38.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:38.686 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-03-27T10:21:39.402 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:39.421 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:39.423 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:39.426 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:39.426 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:40.306 INFO:teuthology.orchestra.run.smithi172.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:21:40.318 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/021 2023-03-27T10:21:40.318 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/021 2023-03-27T10:21:40.318 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:40.327 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:40.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:40.431 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-03-27T10:21:41.135 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:41.157 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:41.161 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:41.162 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:41.162 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:42.074 INFO:teuthology.orchestra.run.smithi172.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:21:42.087 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/022 2023-03-27T10:21:42.088 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/022 2023-03-27T10:21:42.088 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:21:42.096 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:42.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:21:42.235 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-03-27T10:21:42.914 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:21:42.928 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:21:42.929 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:21:42.932 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:21:42.932 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:21:52.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:21:52.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:22:18.337 INFO:teuthology.orchestra.run.smithi172.stdout:generic/023 35s 2023-03-27T10:22:18.354 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/023 2023-03-27T10:22:18.354 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:18.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:18.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:18.516 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-03-27T10:22:19.212 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:19.230 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:19.232 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:19.235 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:19.235 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:19.920 INFO:teuthology.orchestra.run.smithi172.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-03-27T10:22:19.934 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/024 2023-03-27T10:22:19.934 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/024 2023-03-27T10:22:19.934 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:19.942 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:20.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:20.070 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-03-27T10:22:20.790 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:20.804 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:20.806 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:20.809 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:20.809 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:21.710 INFO:teuthology.orchestra.run.smithi172.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-03-27T10:22:21.724 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/025 2023-03-27T10:22:21.724 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/025 2023-03-27T10:22:21.724 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:21.737 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:21.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:21.887 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-03-27T10:22:22.594 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:22.610 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:22.612 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:22.616 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:22.616 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:23.352 INFO:teuthology.orchestra.run.smithi172.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-03-27T10:22:23.366 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/026 2023-03-27T10:22:23.366 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/026 2023-03-27T10:22:23.367 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:23.373 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:23.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:23.431 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-03-27T10:22:23.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:22:23.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:22:24.013 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:24.029 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:24.030 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:24.036 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:24.036 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:24.649 INFO:teuthology.orchestra.run.smithi172.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T10:22:24.662 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/027 2023-03-27T10:22:24.662 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/027 2023-03-27T10:22:24.662 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:24.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:24.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:24.708 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-03-27T10:22:25.278 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:25.296 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:25.297 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:25.302 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:25.302 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:31.009 INFO:teuthology.orchestra.run.smithi172.stdout:generic/028 5s 2023-03-27T10:22:31.027 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/028 2023-03-27T10:22:31.028 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:31.036 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:31.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:31.096 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-03-27T10:22:31.688 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:31.709 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:31.711 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:31.714 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:34.959 INFO:teuthology.orchestra.run.smithi172.stdout:generic/029 3s 2023-03-27T10:22:34.977 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/029 2023-03-27T10:22:34.977 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:34.985 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:35.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:35.013 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-03-27T10:22:35.623 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:35.640 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:35.642 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:35.645 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:35.645 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:37.862 INFO:teuthology.orchestra.run.smithi172.stdout:generic/030 2s 2023-03-27T10:22:37.884 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/030 2023-03-27T10:22:37.884 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:37.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:37.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:37.922 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-03-27T10:22:38.540 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:38.555 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:38.556 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:38.559 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:38.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:39.410 INFO:teuthology.orchestra.run.smithi172.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-27T10:22:39.424 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/031 2023-03-27T10:22:39.424 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/031 2023-03-27T10:22:39.424 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:39.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:39.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:39.492 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-03-27T10:22:40.087 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:40.107 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:40.108 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:40.112 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:40.112 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:40.795 INFO:teuthology.orchestra.run.smithi172.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:22:40.809 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/032 2023-03-27T10:22:40.809 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/032 2023-03-27T10:22:40.809 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:40.817 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:40.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:40.875 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-03-27T10:22:41.480 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:41.497 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:41.497 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:41.500 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:41.500 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:42.360 INFO:teuthology.orchestra.run.smithi172.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T10:22:42.372 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/033 2023-03-27T10:22:42.372 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/033 2023-03-27T10:22:42.372 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:42.379 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:42.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:42.450 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-03-27T10:22:43.094 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:43.108 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:43.111 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:43.115 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:43.115 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:43.798 INFO:teuthology.orchestra.run.smithi172.stdout:generic/034 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:22:43.809 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/034 2023-03-27T10:22:43.810 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/034 2023-03-27T10:22:43.810 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:43.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:43.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:43.867 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-03-27T10:22:44.476 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:44.493 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:44.494 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:44.496 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:44.497 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:45.309 INFO:teuthology.orchestra.run.smithi172.stdout:generic/035 1s 2023-03-27T10:22:45.331 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/035 2023-03-27T10:22:45.332 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:45.338 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:45.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:45.455 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-03-27T10:22:46.189 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:46.206 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:46.208 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:46.210 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:46.211 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:53.831 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:22:53.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:22:57.011 INFO:teuthology.orchestra.run.smithi172.stdout:generic/036 11s 2023-03-27T10:22:57.023 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/036 2023-03-27T10:22:57.023 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:22:57.028 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:22:57.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:22:57.169 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-03-27T10:22:57.717 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:22:57.728 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:22:57.729 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:22:57.731 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:22:57.731 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:04.366 INFO:teuthology.orchestra.run.smithi172.stdout:generic/037 7s 2023-03-27T10:23:04.378 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/037 2023-03-27T10:23:04.378 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:04.383 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:04.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:04.402 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-03-27T10:23:04.802 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:04.814 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:04.816 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:04.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:05.294 INFO:teuthology.orchestra.run.smithi172.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:23:05.302 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/038 2023-03-27T10:23:05.303 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/038 2023-03-27T10:23:05.303 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:05.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:05.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:05.346 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-03-27T10:23:05.753 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:05.764 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:05.765 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:05.767 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:05.768 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:06.269 INFO:teuthology.orchestra.run.smithi172.stdout:generic/039 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:06.277 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/039 2023-03-27T10:23:06.278 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/039 2023-03-27T10:23:06.278 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:06.283 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:06.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:06.319 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-03-27T10:23:06.724 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:06.735 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:06.736 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:06.738 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:06.738 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:07.230 INFO:teuthology.orchestra.run.smithi172.stdout:generic/040 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:07.239 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/040 2023-03-27T10:23:07.239 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/040 2023-03-27T10:23:07.239 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:07.244 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:07.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:07.282 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-03-27T10:23:07.686 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:07.697 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:07.698 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:07.700 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:07.700 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:08.187 INFO:teuthology.orchestra.run.smithi172.stdout:generic/041 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:08.196 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/041 2023-03-27T10:23:08.196 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/041 2023-03-27T10:23:08.196 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:08.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:08.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:08.237 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-03-27T10:23:08.640 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:08.651 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:08.652 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:08.654 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:08.654 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:09.392 INFO:teuthology.orchestra.run.smithi172.stdout:generic/042 [not run] ceph does not support shutdown 2023-03-27T10:23:09.414 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/042 2023-03-27T10:23:09.415 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/042 2023-03-27T10:23:09.415 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:09.420 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:09.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:09.459 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-03-27T10:23:09.858 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:09.869 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:09.870 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:09.873 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:09.873 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:10.464 INFO:teuthology.orchestra.run.smithi172.stdout:generic/043 [not run] ceph does not support shutdown 2023-03-27T10:23:10.486 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/043 2023-03-27T10:23:10.486 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/043 2023-03-27T10:23:10.486 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:10.492 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:10.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:10.529 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-03-27T10:23:10.932 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:10.943 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:10.944 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:10.946 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:10.946 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:11.546 INFO:teuthology.orchestra.run.smithi172.stdout:generic/044 [not run] ceph does not support shutdown 2023-03-27T10:23:11.577 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/044 2023-03-27T10:23:11.577 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/044 2023-03-27T10:23:11.577 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:11.582 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:11.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:11.619 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-03-27T10:23:12.027 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:12.038 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:12.040 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:12.042 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:12.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:12.626 INFO:teuthology.orchestra.run.smithi172.stdout:generic/045 [not run] ceph does not support shutdown 2023-03-27T10:23:12.651 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/045 2023-03-27T10:23:12.651 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/045 2023-03-27T10:23:12.651 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:12.656 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:12.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:12.698 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-03-27T10:23:13.101 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:13.112 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:13.113 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:13.115 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:13.115 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:13.702 INFO:teuthology.orchestra.run.smithi172.stdout:generic/046 [not run] ceph does not support shutdown 2023-03-27T10:23:13.726 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/046 2023-03-27T10:23:13.727 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/046 2023-03-27T10:23:13.727 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:13.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:13.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:13.774 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-03-27T10:23:14.181 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:14.192 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:14.193 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:14.196 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:14.196 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:14.797 INFO:teuthology.orchestra.run.smithi172.stdout:generic/047 [not run] ceph does not support shutdown 2023-03-27T10:23:14.829 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/047 2023-03-27T10:23:14.830 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/047 2023-03-27T10:23:14.830 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:14.835 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:14.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:14.871 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-03-27T10:23:15.276 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:15.287 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:15.288 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:15.290 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:15.290 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:15.887 INFO:teuthology.orchestra.run.smithi172.stdout:generic/048 [not run] ceph does not support shutdown 2023-03-27T10:23:15.912 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/048 2023-03-27T10:23:15.913 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/048 2023-03-27T10:23:15.913 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:15.918 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:15.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:15.963 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-03-27T10:23:16.369 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:16.380 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:16.381 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:16.383 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:16.383 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:16.968 INFO:teuthology.orchestra.run.smithi172.stdout:generic/049 [not run] ceph does not support shutdown 2023-03-27T10:23:17.002 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/049 2023-03-27T10:23:17.002 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/049 2023-03-27T10:23:17.002 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:17.007 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:17.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:17.047 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-03-27T10:23:17.446 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:17.457 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:17.458 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:17.461 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:17.462 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:18.060 INFO:teuthology.orchestra.run.smithi172.stdout:generic/050 [not run] ceph does not support shutdown 2023-03-27T10:23:18.084 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/050 2023-03-27T10:23:18.084 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/050 2023-03-27T10:23:18.085 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:18.089 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:18.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:18.135 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-03-27T10:23:18.543 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:18.554 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:18.554 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:18.557 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:18.557 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:19.160 INFO:teuthology.orchestra.run.smithi172.stdout:generic/051 [not run] ceph does not support shutdown 2023-03-27T10:23:19.170 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/051 2023-03-27T10:23:19.170 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/051 2023-03-27T10:23:19.170 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:19.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:19.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:19.207 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-03-27T10:23:19.615 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:19.626 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:19.627 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:19.630 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:19.630 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:20.245 INFO:teuthology.orchestra.run.smithi172.stdout:generic/052 [not run] ceph does not support shutdown 2023-03-27T10:23:20.280 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/052 2023-03-27T10:23:20.280 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/052 2023-03-27T10:23:20.280 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:20.285 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:20.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:20.328 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-03-27T10:23:20.731 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:20.742 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:20.743 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:20.746 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:20.746 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:21.814 INFO:teuthology.orchestra.run.smithi172.stdout:generic/053 1s 2023-03-27T10:23:21.867 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/053 2023-03-27T10:23:21.868 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:21.875 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:21.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:21.912 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-03-27T10:23:22.337 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:22.348 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:22.349 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:22.351 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:22.352 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:22.980 INFO:teuthology.orchestra.run.smithi172.stdout:generic/054 [not run] ceph does not support shutdown 2023-03-27T10:23:23.006 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/054 2023-03-27T10:23:23.006 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/054 2023-03-27T10:23:23.006 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:23.011 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:23.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:23.043 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-03-27T10:23:23.445 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:23.456 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:23.457 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:23.460 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:23.460 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:24.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:23:24.014 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:23:24.061 INFO:teuthology.orchestra.run.smithi172.stdout:generic/055 [not run] ceph does not support shutdown 2023-03-27T10:23:24.084 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/055 2023-03-27T10:23:24.085 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/055 2023-03-27T10:23:24.085 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:24.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:24.123 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-03-27T10:23:24.561 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:24.572 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:24.573 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:24.576 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:24.576 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:25.079 INFO:teuthology.orchestra.run.smithi172.stdout:generic/056 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:25.088 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/056 2023-03-27T10:23:25.089 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/056 2023-03-27T10:23:25.089 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:25.094 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:25.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:25.131 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-03-27T10:23:25.538 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:25.549 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:25.550 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:25.553 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:25.553 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:26.045 INFO:teuthology.orchestra.run.smithi172.stdout:generic/057 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:26.053 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/057 2023-03-27T10:23:26.054 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/057 2023-03-27T10:23:26.054 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:26.059 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:26.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:26.100 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-03-27T10:23:26.510 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:26.521 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:26.522 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:26.524 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:26.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:27.135 INFO:teuthology.orchestra.run.smithi172.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:23:27.144 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/058 2023-03-27T10:23:27.144 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/058 2023-03-27T10:23:27.144 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:27.149 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:27.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:27.301 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-03-27T10:23:27.847 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:27.858 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:27.859 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:27.862 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:27.862 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:28.338 INFO:teuthology.orchestra.run.smithi172.stdout:generic/059 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:28.346 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/059 2023-03-27T10:23:28.347 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/059 2023-03-27T10:23:28.347 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:28.352 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:28.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:28.388 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-03-27T10:23:28.797 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:28.809 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:28.810 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:28.812 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:28.812 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:29.429 INFO:teuthology.orchestra.run.smithi172.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:23:29.437 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/060 2023-03-27T10:23:29.438 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/060 2023-03-27T10:23:29.438 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:29.443 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:29.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:29.582 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-03-27T10:23:30.121 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:30.132 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:30.133 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:30.136 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:30.136 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:30.742 INFO:teuthology.orchestra.run.smithi172.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:23:30.751 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/061 2023-03-27T10:23:30.751 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/061 2023-03-27T10:23:30.751 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:30.756 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:30.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:30.903 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-03-27T10:23:31.431 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:31.442 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:31.443 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:31.445 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:31.445 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:33.786 INFO:teuthology.orchestra.run.smithi172.stdout:generic/062 2s 2023-03-27T10:23:33.849 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/062 2023-03-27T10:23:33.850 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:33.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:33.900 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-03-27T10:23:34.418 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:34.429 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:34.430 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:34.432 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:34.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:35.099 INFO:teuthology.orchestra.run.smithi172.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:23:35.108 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/063 2023-03-27T10:23:35.108 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/063 2023-03-27T10:23:35.109 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:35.114 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:35.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:35.236 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-03-27T10:23:35.809 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:35.820 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:35.821 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:35.823 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:35.823 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:36.310 INFO:teuthology.orchestra.run.smithi172.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T10:23:36.319 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/064 2023-03-27T10:23:36.319 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/064 2023-03-27T10:23:36.319 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:36.324 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:36.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:36.367 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-03-27T10:23:36.770 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:36.781 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:36.782 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:36.784 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:36.784 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:37.271 INFO:teuthology.orchestra.run.smithi172.stdout:generic/065 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:37.280 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/065 2023-03-27T10:23:37.280 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/065 2023-03-27T10:23:37.280 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:37.285 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:37.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:37.322 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-03-27T10:23:37.727 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:37.738 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:37.739 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:37.741 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:37.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:38.229 INFO:teuthology.orchestra.run.smithi172.stdout:generic/066 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:38.238 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/066 2023-03-27T10:23:38.238 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/066 2023-03-27T10:23:38.238 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:38.243 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:38.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:38.275 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-03-27T10:23:38.679 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:38.690 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:38.691 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:38.693 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:38.694 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:39.218 INFO:teuthology.orchestra.run.smithi172.stdout:generic/067 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:23:39.227 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/067 2023-03-27T10:23:39.227 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/067 2023-03-27T10:23:39.228 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:39.232 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:39.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:39.268 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-03-27T10:23:39.674 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:39.685 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:39.686 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:39.688 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:39.688 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:40.192 INFO:teuthology.orchestra.run.smithi172.stdout:generic/068 [not run] ceph does not support freezing 2023-03-27T10:23:40.201 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/068 2023-03-27T10:23:40.201 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/068 2023-03-27T10:23:40.202 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:23:40.207 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:40.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:23:40.245 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-03-27T10:23:40.648 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:23:40.659 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:23:40.660 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:23:40.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:23:54.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:23:54.118 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:24:01.841 INFO:teuthology.orchestra.run.smithi172.stdout:generic/069 21s 2023-03-27T10:24:01.863 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/069 2023-03-27T10:24:01.864 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:24:01.878 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:01.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:24:01.919 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-03-27T10:24:02.336 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:24:02.347 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:24:02.348 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:24:02.350 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:24:02.351 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:24.279 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:24:24.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:24:29.222 INFO:teuthology.orchestra.run.smithi172.stdout:generic/070 27s 2023-03-27T10:24:29.238 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/070 2023-03-27T10:24:29.238 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:24:29.245 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:29.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:24:29.393 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-03-27T10:24:30.091 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:24:30.107 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:24:30.108 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:24:30.111 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:24:30.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:30.792 INFO:teuthology.orchestra.run.smithi172.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T10:24:30.805 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/071 2023-03-27T10:24:30.806 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/071 2023-03-27T10:24:30.806 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:24:30.814 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:30.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:24:30.868 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-03-27T10:24:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:24:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:24:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:24:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:24:31.497 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:32.323 INFO:teuthology.orchestra.run.smithi172.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-27T10:24:32.338 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/072 2023-03-27T10:24:32.338 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/072 2023-03-27T10:24:32.338 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:24:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:32.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:24:32.417 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-03-27T10:24:33.021 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:24:33.037 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:24:33.038 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:24:33.042 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:24:33.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:33.746 INFO:teuthology.orchestra.run.smithi172.stdout:generic/073 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:24:33.758 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/073 2023-03-27T10:24:33.758 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/073 2023-03-27T10:24:33.758 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:24:33.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:33.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:24:33.812 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-03-27T10:24:34.410 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:24:34.426 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:24:34.427 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:24:34.432 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:24:34.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:24:54.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:24:54.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:24:54.679 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T10:24:54.680+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 214838) UID: 0 2023-03-27T10:24:54.680 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T10:24:54.681+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 214838) UID: 0 2023-03-27T10:25:22.494 INFO:teuthology.orchestra.run.smithi172.stdout:generic/074 48s 2023-03-27T10:25:22.515 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/074 2023-03-27T10:25:22.516 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:25:22.528 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:25:23.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:25:23.341 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-03-27T10:25:24.193 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:25:24.212 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:25:24.217 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:25:24.220 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:25:24.220 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:00.104 INFO:teuthology.orchestra.run.smithi172.stdout:generic/075 36s 2023-03-27T10:26:00.125 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/075 2023-03-27T10:26:00.125 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:00.133 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:00.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:00.298 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-03-27T10:26:01.098 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:01.116 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:01.118 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:01.123 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:01.123 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:01.853 INFO:teuthology.orchestra.run.smithi172.stdout:generic/076 [not run] require 172.21.15.172:6789:/scratch to be local device 2023-03-27T10:26:01.873 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/076 2023-03-27T10:26:01.874 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/076 2023-03-27T10:26:01.874 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:01.885 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:01.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:01.939 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-03-27T10:26:02.645 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:02.667 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:02.669 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:02.672 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:02.672 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:04.652 INFO:teuthology.orchestra.run.smithi172.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T10:26:04.669 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/077 2023-03-27T10:26:04.670 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/077 2023-03-27T10:26:04.670 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:04.675 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:04.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:04.810 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-03-27T10:26:05.652 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:05.677 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:05.679 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:05.686 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:05.687 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:06.509 INFO:teuthology.orchestra.run.smithi172.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-03-27T10:26:06.521 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/078 2023-03-27T10:26:06.521 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/078 2023-03-27T10:26:06.522 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:06.530 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:06.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:06.664 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-03-27T10:26:07.551 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:07.569 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:07.570 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:07.573 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:07.573 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:08.485 INFO:teuthology.orchestra.run.smithi172.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-03-27T10:26:08.502 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/079 2023-03-27T10:26:08.502 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/079 2023-03-27T10:26:08.502 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:08.509 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:08.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:08.585 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-03-27T10:26:09.157 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:09.180 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:09.182 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:09.185 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:09.185 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:12.040 INFO:teuthology.orchestra.run.smithi172.stdout:generic/080 3s 2023-03-27T10:26:12.060 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/080 2023-03-27T10:26:12.061 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:12.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:12.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:12.157 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-03-27T10:26:12.817 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:12.844 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:12.847 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:12.849 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:12.850 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:13.651 INFO:teuthology.orchestra.run.smithi172.stdout:generic/081 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:26:13.665 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/081 2023-03-27T10:26:13.665 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/081 2023-03-27T10:26:13.665 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:13.673 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:13.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:13.737 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-03-27T10:26:14.418 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:14.439 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:14.441 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:14.444 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:14.444 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:15.233 INFO:teuthology.orchestra.run.smithi172.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T10:26:15.249 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/082 2023-03-27T10:26:15.249 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/082 2023-03-27T10:26:15.249 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:15.256 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:15.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:15.312 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-03-27T10:26:15.988 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:16.006 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:16.008 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:16.010 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:16.010 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:16.724 INFO:teuthology.orchestra.run.smithi172.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T10:26:16.740 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/083 2023-03-27T10:26:16.740 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/083 2023-03-27T10:26:16.740 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:16.745 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:16.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:16.788 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-03-27T10:26:17.450 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:17.463 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:17.464 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:17.468 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:17.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:23.831 INFO:teuthology.orchestra.run.smithi172.stdout:generic/084 6s 2023-03-27T10:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/084 2023-03-27T10:26:23.890 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:23.907 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:23.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:23.974 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-03-27T10:26:24.644 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:24.662 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:24.665 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:24.667 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:24.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:25.479 INFO:teuthology.orchestra.run.smithi172.stdout:generic/085 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:26:25.490 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/085 2023-03-27T10:26:25.490 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/085 2023-03-27T10:26:25.490 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:25.499 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:25.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:25.555 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-03-27T10:26:26.220 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:26.239 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:26.241 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:26.247 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:26.247 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:26.997 INFO:teuthology.orchestra.run.smithi172.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:26:27.011 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/086 2023-03-27T10:26:27.011 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/086 2023-03-27T10:26:27.011 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:27.021 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:27.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:27.085 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-03-27T10:26:27.735 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:27.749 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:27.750 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:27.752 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:27.752 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:28.551 INFO:teuthology.orchestra.run.smithi172.stdout:generic/087 1s 2023-03-27T10:26:28.577 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/087 2023-03-27T10:26:28.577 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:28.587 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:28.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:28.786 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-03-27T10:26:29.586 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:29.608 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:29.610 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:29.612 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:29.613 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:generic/088 1s 2023-03-27T10:26:30.458 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/088 2023-03-27T10:26:30.459 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:26:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:26:30.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:26:30.640 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-03-27T10:26:31.461 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:26:31.483 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:26:31.484 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:26:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:26:31.489 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:28:05.483 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:28:05.488 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:28:35.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:28:35.634 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:29:05.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:29:05.816 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:29:37.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:29:37.047 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:30:07.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:30:07.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:30:38.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:30:38.809 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:30:38.898 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T10:30:38.899+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 224164) UID: 0 2023-03-27T10:30:38.899 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T10:30:38.899+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 224164) UID: 0 2023-03-27T10:33:55.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:33:55.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:34:25.390 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:34:25.394 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:34:38.364 INFO:teuthology.orchestra.run.smithi172.stdout:generic/089 487s 2023-03-27T10:34:38.380 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/089 2023-03-27T10:34:38.380 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:34:38.394 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:34:39.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:34:39.319 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-03-27T10:34:40.357 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:34:40.368 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:34:40.369 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:34:40.371 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:34:40.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:34:40.908 INFO:teuthology.orchestra.run.smithi172.stdout:generic/090 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:34:40.917 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/090 2023-03-27T10:34:40.918 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/090 2023-03-27T10:34:40.918 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:34:40.923 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:34:40.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:34:40.962 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-03-27T10:34:41.366 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:34:41.378 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:34:41.379 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:34:41.381 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:34:41.381 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:34:55.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:34:55.621 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:34:55.703 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T10:34:55.703+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 227280) UID: 0 2023-03-27T10:34:55.704 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T10:34:55.703+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 227280) UID: 0 2023-03-27T10:36:31.271 INFO:teuthology.orchestra.run.smithi172.stdout:generic/091 110s 2023-03-27T10:36:31.282 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/091 2023-03-27T10:36:31.283 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:31.288 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:31.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:31.438 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-03-27T10:36:32.050 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:32.061 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:32.062 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:32.064 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:32.543 INFO:teuthology.orchestra.run.smithi172.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:36:32.552 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/092 2023-03-27T10:36:32.552 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/092 2023-03-27T10:36:32.553 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:32.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:32.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:32.598 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-03-27T10:36:33.013 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:33.024 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:33.025 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:33.027 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:33.027 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:33.944 INFO:teuthology.orchestra.run.smithi172.stdout:generic/093 0s 2023-03-27T10:36:33.955 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/093 2023-03-27T10:36:33.956 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:33.961 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:34.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:34.092 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-03-27T10:36:34.748 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:34.760 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:34.761 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:34.763 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:34.763 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:35.296 INFO:teuthology.orchestra.run.smithi172.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T10:36:35.305 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/094 2023-03-27T10:36:35.306 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/094 2023-03-27T10:36:35.306 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:35.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:35.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:35.430 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-03-27T10:36:36.096 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:36.106 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:36.107 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:36.110 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:36.110 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:53.941 INFO:teuthology.orchestra.run.smithi172.stdout:generic/095 17s 2023-03-27T10:36:53.952 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/095 2023-03-27T10:36:53.952 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:53.957 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:53.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:53.977 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-03-27T10:36:54.391 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:54.402 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:54.403 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:54.405 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:54.405 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:55.007 INFO:teuthology.orchestra.run.smithi172.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T10:36:55.016 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/096 2023-03-27T10:36:55.016 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/096 2023-03-27T10:36:55.017 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:55.022 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:55.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:55.062 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-03-27T10:36:55.465 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:55.476 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:55.477 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:55.479 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:55.480 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:56.520 INFO:teuthology.orchestra.run.smithi172.stdout:generic/097 1s 2023-03-27T10:36:56.532 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/097 2023-03-27T10:36:56.532 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:56.537 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:56.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:56.582 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-03-27T10:36:56.985 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:56.996 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:56.996 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:56.999 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:56.999 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:59.457 INFO:teuthology.orchestra.run.smithi172.stdout:generic/098 2s 2023-03-27T10:36:59.469 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/098 2023-03-27T10:36:59.470 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:36:59.475 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:36:59.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:36:59.494 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-03-27T10:36:59.905 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:36:59.916 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:36:59.917 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:36:59.919 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:36:59.920 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:01.296 INFO:teuthology.orchestra.run.smithi172.stdout:generic/099 1s 2023-03-27T10:37:01.309 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/099 2023-03-27T10:37:01.309 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:01.314 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:01.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:01.496 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-03-27T10:37:02.103 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:02.114 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:02.115 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:02.117 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:25.763 INFO:teuthology.orchestra.run.smithi172.stdout:generic/100 23s 2023-03-27T10:37:25.787 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/100 2023-03-27T10:37:25.788 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:25.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:26.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:26.958 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-03-27T10:37:27.378 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:27.389 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:27.390 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:27.392 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:27.393 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:27.878 INFO:teuthology.orchestra.run.smithi172.stdout:generic/101 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:37:27.887 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/101 2023-03-27T10:37:27.887 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/101 2023-03-27T10:37:27.887 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:27.892 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:27.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:27.928 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-03-27T10:37:28.335 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:28.346 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:28.347 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:28.349 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:28.349 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:28.966 INFO:teuthology.orchestra.run.smithi172.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T10:37:28.975 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/102 2023-03-27T10:37:28.975 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/102 2023-03-27T10:37:28.976 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:28.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:29.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:29.015 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-03-27T10:37:29.421 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:29.432 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:29.433 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:29.435 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:29.436 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:29.938 INFO:teuthology.orchestra.run.smithi172.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T10:37:29.947 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/103 2023-03-27T10:37:29.947 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/103 2023-03-27T10:37:29.947 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:29.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:30.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:30.089 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-03-27T10:37:30.749 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:30.760 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:30.761 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:30.763 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:30.764 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:31.253 INFO:teuthology.orchestra.run.smithi172.stdout:generic/104 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:37:31.262 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/104 2023-03-27T10:37:31.262 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/104 2023-03-27T10:37:31.263 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:31.267 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:31.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:31.305 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-03-27T10:37:31.711 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:31.722 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:31.723 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:31.725 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:32.674 INFO:teuthology.orchestra.run.smithi172.stdout:generic/105 1s 2023-03-27T10:37:33.049 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/105 2023-03-27T10:37:33.049 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:33.054 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:33.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:33.074 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-03-27T10:37:33.478 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:33.489 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:33.490 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:33.492 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:33.492 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:34.008 INFO:teuthology.orchestra.run.smithi172.stdout:generic/106 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:37:34.017 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/106 2023-03-27T10:37:34.017 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/106 2023-03-27T10:37:34.017 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:34.023 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:34.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:34.068 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-03-27T10:37:34.474 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:34.486 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:34.486 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:34.489 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:34.489 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:34.989 INFO:teuthology.orchestra.run.smithi172.stdout:generic/107 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:37:34.998 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/107 2023-03-27T10:37:34.998 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/107 2023-03-27T10:37:34.999 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:35.004 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:35.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:35.040 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-03-27T10:37:35.450 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:35.462 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:35.462 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:35.465 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:35.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:36.142 INFO:teuthology.orchestra.run.smithi172.stdout:generic/108 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T10:37:36.150 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/108 2023-03-27T10:37:36.151 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/108 2023-03-27T10:37:36.151 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:36.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:36.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:36.198 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-03-27T10:37:36.605 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:36.616 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:36.617 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:36.619 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:36.619 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:40.410 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:37:40.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:37:45.826 INFO:teuthology.orchestra.run.smithi172.stdout:generic/109 9s 2023-03-27T10:37:45.839 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/109 2023-03-27T10:37:45.840 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:37:45.846 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:37:45.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:37:45.867 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-03-27T10:37:46.713 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:37:46.724 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:37:46.725 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:37:46.727 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:37:46.727 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:08.598 INFO:teuthology.orchestra.run.smithi172.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T10:38:08.607 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/110 2023-03-27T10:38:08.608 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/110 2023-03-27T10:38:08.608 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:08.613 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:08.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:08.752 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-03-27T10:38:09.385 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:09.395 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:09.396 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:09.398 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:09.398 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:09.918 INFO:teuthology.orchestra.run.smithi172.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T10:38:09.927 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/111 2023-03-27T10:38:09.927 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/111 2023-03-27T10:38:09.927 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:09.932 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:10.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:10.112 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-03-27T10:38:10.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:38:10.538 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:38:10.725 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:10.735 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:10.736 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:10.738 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:10.739 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:28.724 INFO:teuthology.orchestra.run.smithi172.stdout:generic/112 18s 2023-03-27T10:38:28.735 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/112 2023-03-27T10:38:28.736 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:28.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:28.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:28.895 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-03-27T10:38:29.493 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:29.504 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:29.505 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:29.507 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:42.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:38:42.312 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:38:46.521 INFO:teuthology.orchestra.run.smithi172.stdout:generic/113 17s 2023-03-27T10:38:46.533 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/113 2023-03-27T10:38:46.533 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:46.539 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:46.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:46.667 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-03-27T10:38:47.301 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:47.318 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:47.318 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:47.321 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:47.321 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:47.876 INFO:teuthology.orchestra.run.smithi172.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-03-27T10:38:47.885 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/114 2023-03-27T10:38:47.885 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/114 2023-03-27T10:38:47.885 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:47.890 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:47.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:47.931 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-03-27T10:38:48.337 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:48.348 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:48.349 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:48.351 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:48.352 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:48.868 INFO:teuthology.orchestra.run.smithi172.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T10:38:48.876 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/115 2023-03-27T10:38:48.877 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/115 2023-03-27T10:38:48.877 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:48.882 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:49.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:49.073 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-03-27T10:38:49.675 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:49.686 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:49.687 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:49.689 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:49.689 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:50.208 INFO:teuthology.orchestra.run.smithi172.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T10:38:50.217 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/116 2023-03-27T10:38:50.218 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/116 2023-03-27T10:38:50.218 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:38:50.223 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:38:50.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:38:50.351 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-03-27T10:38:50.973 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:38:50.984 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:38:50.985 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:38:50.987 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:38:50.987 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:04.586 INFO:teuthology.orchestra.run.smithi172.stdout:generic/117 13s 2023-03-27T10:39:04.598 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/117 2023-03-27T10:39:04.598 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:04.603 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:04.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:04.623 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-03-27T10:39:05.031 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:05.042 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:05.043 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:05.045 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:05.046 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:05.926 INFO:teuthology.orchestra.run.smithi172.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T10:39:05.935 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/118 2023-03-27T10:39:05.935 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/118 2023-03-27T10:39:05.935 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:05.940 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:06.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:06.097 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-03-27T10:39:06.801 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:06.812 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:06.813 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:06.816 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:06.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:07.342 INFO:teuthology.orchestra.run.smithi172.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T10:39:07.351 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/119 2023-03-27T10:39:07.352 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/119 2023-03-27T10:39:07.352 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:07.357 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:07.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:07.529 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-03-27T10:39:08.136 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:08.148 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:08.149 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:08.151 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:08.151 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:12.664 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:39:12.669 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:39:24.332 INFO:teuthology.orchestra.run.smithi172.stdout:generic/120 16s 2023-03-27T10:39:24.344 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/120 2023-03-27T10:39:24.344 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:24.349 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:24.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:24.368 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-03-27T10:39:24.772 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:24.783 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:24.784 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:24.786 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:24.787 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:25.319 INFO:teuthology.orchestra.run.smithi172.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T10:39:25.328 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/121 2023-03-27T10:39:25.328 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/121 2023-03-27T10:39:25.328 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:25.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:25.460 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-03-27T10:39:26.101 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:26.112 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:26.113 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:26.115 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:26.115 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:26.650 INFO:teuthology.orchestra.run.smithi172.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T10:39:26.659 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/122 2023-03-27T10:39:26.659 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/122 2023-03-27T10:39:26.659 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:26.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:26.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:26.806 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-03-27T10:39:27.417 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:27.428 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:27.429 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:27.431 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:28.290 INFO:teuthology.orchestra.run.smithi172.stdout:generic/123 1s 2023-03-27T10:39:28.303 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/123 2023-03-27T10:39:28.303 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:28.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:28.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:28.452 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-03-27T10:39:29.075 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:29.086 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:29.087 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:29.090 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:29.090 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:32.711 INFO:teuthology.orchestra.run.smithi172.stdout:generic/124 3s 2023-03-27T10:39:32.751 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/124 2023-03-27T10:39:32.751 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:39:32.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:33.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:39:33.112 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-03-27T10:39:33.842 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:39:33.853 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:39:33.854 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:39:33.856 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:39:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:39:42.789 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:39:42.794 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:40:13.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:40:13.020 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:40:35.588 INFO:teuthology.orchestra.run.smithi172.stdout:generic/125 61s 2023-03-27T10:40:35.600 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/125 2023-03-27T10:40:35.600 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:40:35.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:40:35.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:40:35.701 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-03-27T10:40:36.347 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:40:36.358 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:40:36.359 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:40:36.361 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:40:36.361 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:40:37.083 INFO:teuthology.orchestra.run.smithi172.stdout:generic/126 1s 2023-03-27T10:40:37.095 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/126 2023-03-27T10:40:37.095 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:40:37.100 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:40:37.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:40:37.254 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-03-27T10:40:37.893 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:40:37.904 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:40:37.905 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:40:37.907 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:40:37.908 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:40:43.124 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:40:43.128 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:41:13.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:41:13.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:41:43.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:41:43.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:42:13.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:42:13.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:42:43.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:42:43.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:43:13.833 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:43:13.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:43:43.923 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:43:43.928 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:44:14.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:44:14.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:44:44.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:44:44.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:45:14.245 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:45:14.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:45:44.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:45:44.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:46:14.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:46:14.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:46:44.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:46:44.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:47:15.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:47:15.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:47:45.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:47:45.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:48:15.595 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:48:15.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:48:45.705 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:48:45.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:49:15.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:49:15.831 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:49:46.168 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:49:46.174 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:50:16.332 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:50:16.337 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:50:41.546 INFO:teuthology.orchestra.run.smithi172.stdout:generic/127 603s 2023-03-27T10:50:41.557 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/127 2023-03-27T10:50:41.557 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:50:41.562 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:50:41.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:50:41.705 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-03-27T10:50:42.325 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:50:42.337 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:50:42.338 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:50:42.340 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:50:42.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:50:43.718 INFO:teuthology.orchestra.run.smithi172.stdout:generic/128 1s 2023-03-27T10:50:43.729 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/128 2023-03-27T10:50:43.730 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T10:50:43.735 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:50:43.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T10:50:43.754 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-03-27T10:50:44.169 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T10:50:44.177 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T10:50:44.178 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T10:50:44.180 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T10:50:44.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T10:50:46.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:50:46.449 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:51:16.734 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:51:16.740 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:51:46.903 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:51:46.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:52:17.084 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:52:17.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:52:47.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:52:47.288 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:53:17.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:53:17.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:53:47.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:53:47.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:54:17.986 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:54:18.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:54:48.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:54:48.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:55:19.384 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:55:19.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:55:51.910 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:55:51.915 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:56:22.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:56:22.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:56:52.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:56:52.317 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:57:22.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:57:22.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:57:53.121 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:57:53.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:58:23.403 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:58:23.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:58:53.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:58:53.725 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:59:23.950 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:59:23.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:59:54.236 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T10:59:54.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:00:24.474 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:00:24.487 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:00:54.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:00:54.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:01:24.966 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:01:24.971 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:01:55.881 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:01:55.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:02:26.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:02:26.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:02:56.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:02:56.458 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:03:26.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:03:26.708 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:03:56.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:03:56.980 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:04:27.236 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:04:27.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:04:57.479 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:04:57.488 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:05:27.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:05:27.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:06:00.002 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:06:00.033 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:06:30.262 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:06:30.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:07:00.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:07:00.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:07:00.640 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T11:07:00.641+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121073) UID: 0 2023-03-27T11:07:00.641 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T11:07:00.641+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121073) UID: 0 2023-03-27T11:07:00.642 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T11:07:00.641+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121073) UID: 0 2023-03-27T11:07:00.642 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T11:07:00.641+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121073) UID: 0 2023-03-27T11:10:12.158 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:10:12.167 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:10:12.481 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T11:10:12.476+0000 7f0dc85f8700 -1 Fail to open '/proc/121128/cmdline' error = (2) No such file or directory 2023-03-27T11:10:12.482 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T11:10:12.482+0000 7f0dc85f8700 -1 received signal: Hangup from (PID: 121128) UID: 0 2023-03-27T11:10:12.482 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T11:10:12.479+0000 7f345fdf8700 -1 Fail to open '/proc/121128/cmdline' error = (2) No such file or directory 2023-03-27T11:10:12.482 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T11:10:12.479+0000 7f345fdf8700 -1 received signal: Hangup from (PID: 121128) UID: 0 2023-03-27T11:10:12.483 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T11:10:12.473+0000 7f7d32ff8700 -1 Fail to open '/proc/121128/cmdline' error = (2) No such file or directory 2023-03-27T11:10:12.483 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T11:10:12.473+0000 7f7d32ff8700 -1 received signal: Hangup from (PID: 121128) UID: 0 2023-03-27T11:10:12.483 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T11:10:12.482+0000 7feee0bf8700 -1 Fail to open '/proc/121128/cmdline' error = (2) No such file or directory 2023-03-27T11:10:12.483 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T11:10:12.482+0000 7feee0bf8700 -1 received signal: Hangup from (PID: 121128) UID: 0 2023-03-27T11:12:17.262 INFO:teuthology.orchestra.run.smithi172.stdout:generic/129 1293s 2023-03-27T11:12:17.349 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/129 2023-03-27T11:12:17.349 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:12:17.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:17.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:12:17.395 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-03-27T11:12:17.964 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:12:17.975 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:12:17.976 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:12:17.978 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:12:17.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:32.847 INFO:teuthology.orchestra.run.smithi172.stdout:generic/130 14s 2023-03-27T11:12:32.884 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/130 2023-03-27T11:12:32.884 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:12:32.903 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:32.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:12:32.960 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-03-27T11:12:33.382 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:12:33.393 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:12:33.394 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:12:33.396 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:12:33.396 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:35.083 INFO:teuthology.orchestra.run.smithi172.stdout:generic/131 2s 2023-03-27T11:12:35.100 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/131 2023-03-27T11:12:35.101 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:12:35.109 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:35.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:12:35.270 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-03-27T11:12:36.047 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:12:36.062 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:12:36.063 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:12:36.065 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:12:36.066 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:51.121 INFO:teuthology.orchestra.run.smithi172.stdout:generic/132 15s 2023-03-27T11:12:51.132 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/132 2023-03-27T11:12:51.132 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:12:51.138 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:12:51.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:12:51.157 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-03-27T11:12:51.561 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:12:51.572 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:12:51.573 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:12:51.575 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:12:51.575 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:13:27.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:13:27.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:13:28.125 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T11:13:28.128+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 268471) UID: 0 2023-03-27T11:13:28.125 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T11:13:28.128+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 268471) UID: 0 2023-03-27T11:13:28.126 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T11:13:28.128+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 268471) UID: 0 2023-03-27T11:13:28.126 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T11:13:28.128+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 268471) UID: 0 2023-03-27T11:16:00.853 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:16:00.859 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:16:30.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:16:30.967 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:17:01.102 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:17:01.107 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:17:21.553 INFO:teuthology.orchestra.run.smithi172.stdout:generic/133 270s 2023-03-27T11:17:21.815 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/133 2023-03-27T11:17:21.815 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:21.820 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:21.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:21.983 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-03-27T11:17:22.734 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:22.745 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:22.746 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:22.749 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:22.749 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:23.290 INFO:teuthology.orchestra.run.smithi172.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:23.299 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/134 2023-03-27T11:17:23.299 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/134 2023-03-27T11:17:23.300 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:23.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:23.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:23.452 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-03-27T11:17:24.083 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:24.094 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:24.095 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:24.097 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:25.325 INFO:teuthology.orchestra.run.smithi172.stdout:generic/135 1s 2023-03-27T11:17:25.336 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/135 2023-03-27T11:17:25.336 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:25.341 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:25.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:25.360 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-03-27T11:17:25.765 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:25.777 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:25.778 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:25.780 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:25.780 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:26.300 INFO:teuthology.orchestra.run.smithi172.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T11:17:26.309 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/136 2023-03-27T11:17:26.309 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/136 2023-03-27T11:17:26.309 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:26.314 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:26.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:26.470 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-03-27T11:17:27.092 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:27.103 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:27.104 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:27.107 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:27.107 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:27.618 INFO:teuthology.orchestra.run.smithi172.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:27.627 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/137 2023-03-27T11:17:27.627 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/137 2023-03-27T11:17:27.627 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:27.632 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:27.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:27.784 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-03-27T11:17:28.401 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:28.412 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:28.414 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:28.416 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:28.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:28.929 INFO:teuthology.orchestra.run.smithi172.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:28.938 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/138 2023-03-27T11:17:28.938 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/138 2023-03-27T11:17:28.938 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:28.943 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:29.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:29.071 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-03-27T11:17:29.710 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:29.721 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:29.722 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:29.725 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:29.725 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:30.237 INFO:teuthology.orchestra.run.smithi172.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:30.246 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/139 2023-03-27T11:17:30.246 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/139 2023-03-27T11:17:30.247 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:30.251 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:30.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:30.403 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-03-27T11:17:31.027 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:31.038 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:31.039 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:31.041 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:31.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:31.199 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:17:31.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:17:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/140 2023-03-27T11:17:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/140 2023-03-27T11:17:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:31.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:31.711 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-03-27T11:17:32.353 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:32.364 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:32.365 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:32.367 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:33.066 INFO:teuthology.orchestra.run.smithi172.stdout:generic/141 1s 2023-03-27T11:17:33.080 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/141 2023-03-27T11:17:33.080 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:33.083 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:33.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:33.102 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-03-27T11:17:33.513 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:33.524 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:33.525 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:33.527 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:33.528 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:34.038 INFO:teuthology.orchestra.run.smithi172.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:34.047 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/142 2023-03-27T11:17:34.048 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/142 2023-03-27T11:17:34.048 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:34.053 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:34.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:34.218 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-03-27T11:17:34.845 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:34.856 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:34.857 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:34.859 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:34.859 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:35.370 INFO:teuthology.orchestra.run.smithi172.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:35.379 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/143 2023-03-27T11:17:35.379 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/143 2023-03-27T11:17:35.379 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:35.384 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:35.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:35.534 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-03-27T11:17:36.159 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:36.170 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:36.171 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:36.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:36.705 INFO:teuthology.orchestra.run.smithi172.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:36.714 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/144 2023-03-27T11:17:36.714 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/144 2023-03-27T11:17:36.715 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:36.720 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:36.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:36.867 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-03-27T11:17:37.498 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:37.510 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:37.511 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:37.513 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:37.514 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:38.018 INFO:teuthology.orchestra.run.smithi172.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:38.027 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/145 2023-03-27T11:17:38.027 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/145 2023-03-27T11:17:38.028 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:38.032 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:38.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:38.151 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-03-27T11:17:38.799 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:38.810 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:38.811 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:38.813 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:38.813 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:39.321 INFO:teuthology.orchestra.run.smithi172.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:39.330 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/146 2023-03-27T11:17:39.331 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/146 2023-03-27T11:17:39.331 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:39.336 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:39.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:39.474 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-03-27T11:17:40.129 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:40.141 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:40.142 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:40.144 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:40.144 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:40.665 INFO:teuthology.orchestra.run.smithi172.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:40.674 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/147 2023-03-27T11:17:40.674 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/147 2023-03-27T11:17:40.674 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:40.680 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:40.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:40.816 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-03-27T11:17:41.454 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:41.465 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:41.466 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:41.469 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:41.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:41.987 INFO:teuthology.orchestra.run.smithi172.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/148 2023-03-27T11:17:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/148 2023-03-27T11:17:41.996 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:42.002 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:42.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:42.142 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-03-27T11:17:42.778 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:42.789 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:42.790 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:42.793 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:42.793 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:43.308 INFO:teuthology.orchestra.run.smithi172.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:43.317 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/149 2023-03-27T11:17:43.317 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/149 2023-03-27T11:17:43.317 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:43.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:43.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:43.474 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-03-27T11:17:44.119 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:44.130 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:44.131 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:44.133 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:44.133 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:44.650 INFO:teuthology.orchestra.run.smithi172.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:44.659 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/150 2023-03-27T11:17:44.659 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/150 2023-03-27T11:17:44.660 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:44.665 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:44.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:44.782 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-03-27T11:17:45.434 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:45.445 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:45.446 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:45.449 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:45.449 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:45.966 INFO:teuthology.orchestra.run.smithi172.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:45.975 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/151 2023-03-27T11:17:45.975 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/151 2023-03-27T11:17:45.975 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:45.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:46.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:46.121 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-03-27T11:17:46.752 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:46.763 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:46.764 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:46.767 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:46.767 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:47.274 INFO:teuthology.orchestra.run.smithi172.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:47.283 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/152 2023-03-27T11:17:47.283 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/152 2023-03-27T11:17:47.284 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:47.289 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:47.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:47.430 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-03-27T11:17:48.056 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:48.068 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:48.069 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:48.071 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:48.071 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:48.592 INFO:teuthology.orchestra.run.smithi172.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:48.601 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/153 2023-03-27T11:17:48.601 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/153 2023-03-27T11:17:48.601 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:48.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:48.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:48.745 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-03-27T11:17:49.390 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:49.401 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:49.402 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:49.405 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:49.405 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:49.915 INFO:teuthology.orchestra.run.smithi172.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:49.924 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/154 2023-03-27T11:17:49.925 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/154 2023-03-27T11:17:49.925 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:49.930 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:50.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:50.099 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-03-27T11:17:50.703 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:50.714 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:50.715 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:50.718 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:50.718 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:51.241 INFO:teuthology.orchestra.run.smithi172.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:51.249 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/155 2023-03-27T11:17:51.250 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/155 2023-03-27T11:17:51.250 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:51.255 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:51.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:51.392 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-03-27T11:17:52.039 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:52.050 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:52.051 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:52.054 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:52.054 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:52.569 INFO:teuthology.orchestra.run.smithi172.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/156 2023-03-27T11:17:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/156 2023-03-27T11:17:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:52.583 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:52.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:52.717 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-03-27T11:17:53.363 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:53.374 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:53.375 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:53.378 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:53.902 INFO:teuthology.orchestra.run.smithi172.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:17:53.911 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/157 2023-03-27T11:17:53.911 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/157 2023-03-27T11:17:53.911 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:53.916 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:54.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:54.060 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-03-27T11:17:54.684 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:54.695 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:54.696 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:54.699 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:54.699 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:55.213 INFO:teuthology.orchestra.run.smithi172.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T11:17:55.223 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/158 2023-03-27T11:17:55.223 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/158 2023-03-27T11:17:55.223 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:55.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:55.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:55.385 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-03-27T11:17:56.007 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:56.018 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:56.019 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:56.021 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:56.021 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:56.506 INFO:teuthology.orchestra.run.smithi172.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-03-27T11:17:56.515 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/159 2023-03-27T11:17:56.516 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/159 2023-03-27T11:17:56.516 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:56.521 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:56.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:56.562 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-03-27T11:17:56.972 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:56.983 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:56.984 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:56.986 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:57.474 INFO:teuthology.orchestra.run.smithi172.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-03-27T11:17:57.483 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/160 2023-03-27T11:17:57.483 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/160 2023-03-27T11:17:57.484 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:57.489 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:57.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:57.539 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-03-27T11:17:57.948 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:57.959 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:57.960 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:57.962 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:57.962 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:58.779 INFO:teuthology.orchestra.run.smithi172.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:17:58.836 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/161 2023-03-27T11:17:58.836 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/161 2023-03-27T11:17:58.837 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:17:58.867 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:17:59.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:17:59.050 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-03-27T11:17:59.455 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:17:59.466 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:17:59.467 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:17:59.470 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:17:59.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:00.153 INFO:teuthology.orchestra.run.smithi172.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-27T11:18:00.246 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/162 2023-03-27T11:18:00.246 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/162 2023-03-27T11:18:00.247 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:00.263 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:00.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:00.552 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-03-27T11:18:00.980 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:00.991 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:00.992 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:00.995 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:00.995 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:01.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:18:01.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:18:01.660 INFO:teuthology.orchestra.run.smithi172.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-27T11:18:01.755 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/163 2023-03-27T11:18:01.755 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/163 2023-03-27T11:18:01.755 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:01.762 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:02.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:02.043 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-03-27T11:18:02.498 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:02.509 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:02.510 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:02.512 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:02.512 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:03.307 INFO:teuthology.orchestra.run.smithi172.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:03.346 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/164 2023-03-27T11:18:03.346 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/164 2023-03-27T11:18:03.346 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:03.352 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:03.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:03.539 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-03-27T11:18:03.973 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:03.984 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:03.985 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:03.988 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:03.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:04.813 INFO:teuthology.orchestra.run.smithi172.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:04.847 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/165 2023-03-27T11:18:04.853 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/165 2023-03-27T11:18:04.854 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:04.867 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:05.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:05.066 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-03-27T11:18:05.479 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:05.490 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:05.491 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:05.493 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:05.494 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:06.357 INFO:teuthology.orchestra.run.smithi172.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:06.387 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/166 2023-03-27T11:18:06.387 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/166 2023-03-27T11:18:06.387 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:06.405 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:06.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:06.602 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-03-27T11:18:07.009 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:07.020 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:07.021 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:07.023 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:07.023 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:07.821 INFO:teuthology.orchestra.run.smithi172.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/167 2023-03-27T11:18:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/167 2023-03-27T11:18:07.866 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:07.884 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:08.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:08.083 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-03-27T11:18:08.494 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:08.505 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:08.506 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:08.508 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:08.508 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:09.331 INFO:teuthology.orchestra.run.smithi172.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:09.380 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/168 2023-03-27T11:18:09.380 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/168 2023-03-27T11:18:09.381 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:09.388 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:09.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:09.571 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-03-27T11:18:09.992 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:10.003 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:10.004 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:10.006 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:10.007 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:10.921 INFO:teuthology.orchestra.run.smithi172.stdout:generic/169 0s 2023-03-27T11:18:10.933 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/169 2023-03-27T11:18:10.933 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:10.938 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:10.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:10.958 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-03-27T11:18:11.370 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:11.381 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:11.382 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:11.384 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:11.384 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:12.160 INFO:teuthology.orchestra.run.smithi172.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:12.200 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/170 2023-03-27T11:18:12.200 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/170 2023-03-27T11:18:12.201 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:12.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:12.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:12.455 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-03-27T11:18:12.870 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:12.881 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:12.882 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:12.884 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:12.884 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:13.731 INFO:teuthology.orchestra.run.smithi172.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:13.786 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/171 2023-03-27T11:18:13.786 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/171 2023-03-27T11:18:13.786 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:13.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:13.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:13.959 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-03-27T11:18:14.367 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:14.378 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:14.379 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:14.381 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:14.381 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:15.191 INFO:teuthology.orchestra.run.smithi172.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:15.261 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/172 2023-03-27T11:18:15.261 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/172 2023-03-27T11:18:15.261 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:15.280 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:15.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:15.482 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-03-27T11:18:15.890 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:15.901 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:15.902 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:15.905 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:15.905 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:16.698 INFO:teuthology.orchestra.run.smithi172.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:16.738 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/173 2023-03-27T11:18:16.739 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/173 2023-03-27T11:18:16.739 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:16.746 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:16.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:16.975 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-03-27T11:18:17.390 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:17.401 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:17.402 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:17.404 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:17.404 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:18.221 INFO:teuthology.orchestra.run.smithi172.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:18.263 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/174 2023-03-27T11:18:18.263 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/174 2023-03-27T11:18:18.263 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:18.270 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:18.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:18.500 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-03-27T11:18:18.907 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:18.918 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:18.919 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:18.922 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:18.922 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:19.741 INFO:teuthology.orchestra.run.smithi172.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:19.767 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/175 2023-03-27T11:18:19.772 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/175 2023-03-27T11:18:19.772 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:19.800 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:19.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:19.977 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-03-27T11:18:20.385 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:20.397 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:20.398 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:20.400 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:20.400 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:21.243 INFO:teuthology.orchestra.run.smithi172.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:21.288 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/176 2023-03-27T11:18:21.288 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/176 2023-03-27T11:18:21.288 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:21.298 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:21.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:21.448 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-03-27T11:18:21.874 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:21.885 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:21.886 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:21.888 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:21.888 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:22.596 INFO:teuthology.orchestra.run.smithi172.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T11:18:22.605 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/177 2023-03-27T11:18:22.605 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/177 2023-03-27T11:18:22.606 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:22.611 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:22.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:22.781 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-03-27T11:18:23.397 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:23.408 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:23.409 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:23.412 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:23.412 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:23.924 INFO:teuthology.orchestra.run.smithi172.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:18:23.933 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/178 2023-03-27T11:18:23.934 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/178 2023-03-27T11:18:23.934 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:23.939 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:24.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:24.068 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-03-27T11:18:24.726 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:24.736 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:24.738 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:24.740 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:24.740 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:25.257 INFO:teuthology.orchestra.run.smithi172.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:18:25.266 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/179 2023-03-27T11:18:25.267 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/179 2023-03-27T11:18:25.267 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:25.272 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:25.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:25.413 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-03-27T11:18:26.049 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:26.060 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:26.061 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:26.063 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:26.063 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:26.583 INFO:teuthology.orchestra.run.smithi172.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:18:26.592 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/180 2023-03-27T11:18:26.593 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/180 2023-03-27T11:18:26.593 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:26.598 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:26.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:26.759 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-03-27T11:18:27.362 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:27.374 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:27.374 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:27.376 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:27.377 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:27.890 INFO:teuthology.orchestra.run.smithi172.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:18:27.899 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/181 2023-03-27T11:18:27.899 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/181 2023-03-27T11:18:27.899 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:27.904 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:28.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:28.017 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-03-27T11:18:28.656 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:28.667 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:28.668 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:28.670 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:28.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:29.187 INFO:teuthology.orchestra.run.smithi172.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T11:18:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/182 2023-03-27T11:18:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/182 2023-03-27T11:18:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:29.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:29.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:29.372 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-03-27T11:18:29.974 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:29.985 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:29.986 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:29.988 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:29.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:30.814 INFO:teuthology.orchestra.run.smithi172.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:30.857 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/183 2023-03-27T11:18:30.857 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/183 2023-03-27T11:18:30.857 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:30.874 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:31.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:31.038 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-03-27T11:18:31.450 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:31.461 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:31.463 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:31.465 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:31.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:31.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:18:31.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:18:31.998 INFO:teuthology.orchestra.run.smithi172.stdout:generic/184 0s 2023-03-27T11:18:32.009 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/184 2023-03-27T11:18:32.010 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:32.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:32.050 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-03-27T11:18:32.460 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:32.471 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:32.472 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:32.474 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:32.475 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:33.318 INFO:teuthology.orchestra.run.smithi172.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:33.353 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/185 2023-03-27T11:18:33.353 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/185 2023-03-27T11:18:33.354 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:33.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:33.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:33.553 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-03-27T11:18:33.961 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:33.973 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:33.974 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:33.976 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:33.976 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:34.776 INFO:teuthology.orchestra.run.smithi172.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:34.821 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/186 2023-03-27T11:18:34.821 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/186 2023-03-27T11:18:34.821 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:34.872 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:35.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:35.049 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-03-27T11:18:35.465 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:35.476 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:35.477 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:35.480 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:35.480 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:36.274 INFO:teuthology.orchestra.run.smithi172.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:36.329 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/187 2023-03-27T11:18:36.329 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/187 2023-03-27T11:18:36.329 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:36.336 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:36.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:36.526 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-03-27T11:18:36.939 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:36.950 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:36.951 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:36.953 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:36.954 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:37.737 INFO:teuthology.orchestra.run.smithi172.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:37.770 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/188 2023-03-27T11:18:37.770 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/188 2023-03-27T11:18:37.770 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:37.779 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:38.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:38.029 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-03-27T11:18:38.441 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:38.452 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:38.453 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:38.455 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:38.455 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:39.304 INFO:teuthology.orchestra.run.smithi172.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:39.398 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/189 2023-03-27T11:18:39.398 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/189 2023-03-27T11:18:39.398 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:39.415 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:39.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:39.542 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-03-27T11:18:39.952 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:39.963 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:39.964 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:39.967 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:39.967 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:40.762 INFO:teuthology.orchestra.run.smithi172.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:40.826 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/190 2023-03-27T11:18:40.826 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/190 2023-03-27T11:18:40.826 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:40.838 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:41.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:41.040 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-03-27T11:18:41.454 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:41.465 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:41.466 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:41.469 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:41.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:42.276 INFO:teuthology.orchestra.run.smithi172.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:42.330 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/191 2023-03-27T11:18:42.330 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/191 2023-03-27T11:18:42.330 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:42.337 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:42.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:42.485 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-03-27T11:18:42.923 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:42.934 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:42.935 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:42.937 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:42.937 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:48.737 INFO:teuthology.orchestra.run.smithi172.stdout:generic/192 - output mismatch (see /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/results//generic/192.out.bad) 2023-03-27T11:18:48.743 INFO:teuthology.orchestra.run.smithi172.stdout: --- tests/generic/192.out 2023-03-27 10:11:11.318575279 +0000 2023-03-27T11:18:48.743 INFO:teuthology.orchestra.run.smithi172.stdout: +++ /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/results//generic/192.out.bad 2023-03-27 11:18:48.738913748 +0000 2023-03-27T11:18:48.743 INFO:teuthology.orchestra.run.smithi172.stdout: @@ -1,5 +1,6 @@ 2023-03-27T11:18:48.743 INFO:teuthology.orchestra.run.smithi172.stdout: QA output created by 192 2023-03-27T11:18:48.743 INFO:teuthology.orchestra.run.smithi172.stdout: sleep for 5 seconds 2023-03-27T11:18:48.743 INFO:teuthology.orchestra.run.smithi172.stdout: test 2023-03-27T11:18:48.744 INFO:teuthology.orchestra.run.smithi172.stdout: -delta1 is in range 2023-03-27T11:18:48.744 INFO:teuthology.orchestra.run.smithi172.stdout: +delta1 has value of 0 2023-03-27T11:18:48.744 INFO:teuthology.orchestra.run.smithi172.stdout: +delta1 is NOT in range 5 .. 7 2023-03-27T11:18:48.744 INFO:teuthology.orchestra.run.smithi172.stdout: delta2 is in range 2023-03-27T11:18:48.748 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/192 2023-03-27T11:18:48.748 INFO:teuthology.orchestra.run.smithi172.stdout:Failures: generic/192 2023-03-27T11:18:48.748 INFO:teuthology.orchestra.run.smithi172.stdout:Failed 1 of 1 tests 2023-03-27T11:18:48.753 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:48.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T11:18:48.795 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-27T11:18:48.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-27T11:18:48.796 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-03-27T11:18:49.204 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:49.215 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:49.216 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:49.219 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:49.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:51.009 INFO:teuthology.orchestra.run.smithi172.stdout:generic/193 2s 2023-03-27T11:18:51.020 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/193 2023-03-27T11:18:51.020 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:51.025 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:51.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:51.212 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-03-27T11:18:51.811 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:51.822 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:51.823 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:51.825 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:51.825 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:52.627 INFO:teuthology.orchestra.run.smithi172.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:52.682 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/194 2023-03-27T11:18:52.682 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/194 2023-03-27T11:18:52.682 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:52.712 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:52.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:52.897 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-03-27T11:18:53.302 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:53.313 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:53.314 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:53.316 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:53.316 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:54.176 INFO:teuthology.orchestra.run.smithi172.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:54.219 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/195 2023-03-27T11:18:54.220 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/195 2023-03-27T11:18:54.220 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:54.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:54.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:54.410 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-03-27T11:18:54.818 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:54.830 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:54.831 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:54.833 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:54.833 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:55.668 INFO:teuthology.orchestra.run.smithi172.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:55.715 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/196 2023-03-27T11:18:55.715 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/196 2023-03-27T11:18:55.715 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:55.749 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:55.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:55.956 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-03-27T11:18:56.369 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:56.380 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:56.381 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:56.384 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:56.384 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:57.220 INFO:teuthology.orchestra.run.smithi172.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:18:57.267 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/197 2023-03-27T11:18:57.267 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/197 2023-03-27T11:18:57.267 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:57.275 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:57.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:57.475 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-03-27T11:18:57.884 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:57.895 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:57.896 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:57.899 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:57.899 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:59.094 INFO:teuthology.orchestra.run.smithi172.stdout:generic/198 1s 2023-03-27T11:18:59.105 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/198 2023-03-27T11:18:59.105 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:18:59.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:18:59.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:18:59.296 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-03-27T11:18:59.978 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:18:59.989 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:18:59.990 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:18:59.992 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:18:59.992 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:00.840 INFO:teuthology.orchestra.run.smithi172.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:00.878 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/199 2023-03-27T11:19:00.878 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/199 2023-03-27T11:19:00.878 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:00.897 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:01.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:01.065 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-03-27T11:19:01.480 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:01.490 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:01.492 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:01.494 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:01.494 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:01.885 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:19:01.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:19:02.316 INFO:teuthology.orchestra.run.smithi172.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:02.357 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/200 2023-03-27T11:19:02.357 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/200 2023-03-27T11:19:02.357 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:02.372 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:02.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:02.574 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-03-27T11:19:02.988 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:02.999 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:03.000 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:03.002 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:03.003 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:03.832 INFO:teuthology.orchestra.run.smithi172.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:03.886 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/201 2023-03-27T11:19:03.886 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/201 2023-03-27T11:19:03.886 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:03.899 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:04.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:04.098 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-03-27T11:19:04.502 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:04.513 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:04.514 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:04.516 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:04.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:05.337 INFO:teuthology.orchestra.run.smithi172.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:05.391 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/202 2023-03-27T11:19:05.391 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/202 2023-03-27T11:19:05.391 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:05.426 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:05.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:05.614 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-03-27T11:19:06.023 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:06.034 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:06.035 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:06.037 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:06.037 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:06.910 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/203 2023-03-27T11:19:06.911 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/203 2023-03-27T11:19:06.911 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:06.959 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:07.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:07.111 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-03-27T11:19:07.522 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:07.533 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:07.534 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:07.536 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:07.537 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:08.803 INFO:teuthology.orchestra.run.smithi172.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:19:08.814 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/204 2023-03-27T11:19:08.814 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/204 2023-03-27T11:19:08.814 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:08.820 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:08.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:08.864 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-03-27T11:19:09.276 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:09.287 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:09.288 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:09.290 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:09.290 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:10.143 INFO:teuthology.orchestra.run.smithi172.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:10.183 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/205 2023-03-27T11:19:10.183 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/205 2023-03-27T11:19:10.183 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:10.192 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:10.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:10.355 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-03-27T11:19:10.772 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:10.783 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:10.784 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:10.786 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:10.786 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:11.682 INFO:teuthology.orchestra.run.smithi172.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:19:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/206 2023-03-27T11:19:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/206 2023-03-27T11:19:11.710 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:11.719 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:11.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:11.862 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-03-27T11:19:12.279 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:12.290 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:12.291 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:12.293 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:12.294 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:21.540 INFO:teuthology.orchestra.run.smithi172.stdout:generic/207 9s 2023-03-27T11:19:21.551 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/207 2023-03-27T11:19:21.551 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:19:21.557 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:21.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:19:21.698 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-03-27T11:19:22.335 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:19:22.347 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:19:22.348 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:19:22.350 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:19:22.350 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:19:32.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:19:32.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:20:02.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:20:02.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:20:32.351 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:20:32.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:21:02.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:21:02.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:21:32.619 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:21:32.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:21:32.989 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T11:21:32.992+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307170) UID: 0 2023-03-27T11:21:32.990 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T11:21:32.993+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307170) UID: 0 2023-03-27T11:21:32.990 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T11:21:32.993+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307170) UID: 0 2023-03-27T11:21:32.991 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T11:21:32.993+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 307170) UID: 0 2023-03-27T11:22:43.016 INFO:teuthology.orchestra.run.smithi172.stdout:generic/208 201s 2023-03-27T11:22:43.028 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/208 2023-03-27T11:22:43.028 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:22:43.033 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:22:43.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:22:43.158 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-03-27T11:22:43.877 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:22:43.889 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:22:43.890 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:22:43.893 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:22:43.893 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:20.348 INFO:teuthology.orchestra.run.smithi172.stdout:generic/209 36s 2023-03-27T11:23:20.426 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/209 2023-03-27T11:23:20.426 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:20.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:20.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:20.586 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-03-27T11:23:21.259 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:21.270 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:21.271 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:21.273 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:21.273 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:21.880 INFO:teuthology.orchestra.run.smithi172.stdout:generic/210 0s 2023-03-27T11:23:21.892 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/210 2023-03-27T11:23:21.892 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:21.897 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:22.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:22.045 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-03-27T11:23:22.702 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:22.713 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:22.714 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:22.716 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:22.716 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:23.706 INFO:teuthology.orchestra.run.smithi172.stdout:generic/211 1s 2023-03-27T11:23:23.718 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/211 2023-03-27T11:23:23.718 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:23.725 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:23.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:23.771 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-03-27T11:23:24.176 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:24.187 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:24.189 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:24.191 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:24.191 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:24.764 INFO:teuthology.orchestra.run.smithi172.stdout:generic/212 0s 2023-03-27T11:23:24.777 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/212 2023-03-27T11:23:24.777 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:24.783 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:24.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:24.828 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-03-27T11:23:25.230 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:25.241 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:25.242 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:25.244 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:25.244 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:25.740 INFO:teuthology.orchestra.run.smithi172.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:23:25.749 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/213 2023-03-27T11:23:25.749 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/213 2023-03-27T11:23:25.750 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:25.755 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:25.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:25.791 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-03-27T11:23:26.216 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:26.227 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:26.228 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:26.230 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:26.230 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:26.723 INFO:teuthology.orchestra.run.smithi172.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:23:26.733 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/214 2023-03-27T11:23:26.733 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/214 2023-03-27T11:23:26.733 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:26.738 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:26.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:26.774 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-03-27T11:23:27.181 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:27.192 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:27.193 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:27.195 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:27.195 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:29.769 INFO:teuthology.orchestra.run.smithi172.stdout:generic/215 2s 2023-03-27T11:23:29.782 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/215 2023-03-27T11:23:29.782 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:29.787 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:29.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:29.854 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-03-27T11:23:30.255 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:30.266 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:30.267 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:30.269 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:30.270 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:31.085 INFO:teuthology.orchestra.run.smithi172.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:31.139 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/216 2023-03-27T11:23:31.139 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/216 2023-03-27T11:23:31.139 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:31.155 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:31.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:31.418 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-03-27T11:23:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:31.838 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:32.648 INFO:teuthology.orchestra.run.smithi172.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:32.672 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/217 2023-03-27T11:23:32.672 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/217 2023-03-27T11:23:32.672 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:32.687 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:32.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:32.966 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-03-27T11:23:33.377 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:33.388 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:33.389 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:33.391 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:33.391 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:34.307 INFO:teuthology.orchestra.run.smithi172.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:34.343 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/218 2023-03-27T11:23:34.343 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/218 2023-03-27T11:23:34.343 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:34.353 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:34.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:34.560 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-03-27T11:23:34.979 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:34.990 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:34.991 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:34.993 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:34.994 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:35.487 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/219 2023-03-27T11:23:35.487 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/219 2023-03-27T11:23:35.487 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:35.492 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:35.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:35.528 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-03-27T11:23:35.941 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:35.953 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:35.954 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:35.956 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:35.957 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:36.849 INFO:teuthology.orchestra.run.smithi172.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:36.911 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/220 2023-03-27T11:23:36.912 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/220 2023-03-27T11:23:36.912 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:36.930 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:37.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:37.116 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-03-27T11:23:37.529 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:37.540 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:37.541 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:37.544 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:37.544 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:39.050 INFO:teuthology.orchestra.run.smithi172.stdout:generic/221 2s 2023-03-27T11:23:39.062 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/221 2023-03-27T11:23:39.063 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:39.068 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:39.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:39.110 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-03-27T11:23:39.516 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:39.527 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:39.528 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:39.531 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:39.531 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:40.338 INFO:teuthology.orchestra.run.smithi172.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:40.361 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/222 2023-03-27T11:23:40.361 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/222 2023-03-27T11:23:40.361 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:40.375 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:40.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:40.602 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-03-27T11:23:41.008 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:41.020 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:41.021 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:41.023 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:41.526 INFO:teuthology.orchestra.run.smithi172.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:23:41.535 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/223 2023-03-27T11:23:41.535 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/223 2023-03-27T11:23:41.535 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:41.540 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:41.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:41.590 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-03-27T11:23:42.007 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:42.018 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:42.019 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:42.021 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:42.021 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:42.485 INFO:teuthology.orchestra.run.smithi172.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:23:42.494 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/224 2023-03-27T11:23:42.494 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/224 2023-03-27T11:23:42.495 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:42.499 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:42.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:42.534 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-03-27T11:23:42.939 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:42.950 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:42.951 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:42.954 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:42.954 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:43.485 INFO:teuthology.orchestra.run.smithi172.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T11:23:43.493 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/225 2023-03-27T11:23:43.494 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/225 2023-03-27T11:23:43.494 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:43.499 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:43.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:43.627 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-03-27T11:23:44.249 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:44.260 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:44.261 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:44.263 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:44.264 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:44.776 INFO:teuthology.orchestra.run.smithi172.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:23:44.785 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/226 2023-03-27T11:23:44.785 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/226 2023-03-27T11:23:44.785 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:44.790 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:44.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:44.834 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-03-27T11:23:45.235 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:45.246 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:45.247 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:45.249 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:45.250 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:46.076 INFO:teuthology.orchestra.run.smithi172.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:46.118 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/227 2023-03-27T11:23:46.118 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/227 2023-03-27T11:23:46.118 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:46.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:46.317 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-03-27T11:23:46.732 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:46.743 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:46.744 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:46.747 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:46.747 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:47.258 INFO:teuthology.orchestra.run.smithi172.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:23:47.267 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/228 2023-03-27T11:23:47.267 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/228 2023-03-27T11:23:47.268 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:47.273 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:47.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:47.308 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-03-27T11:23:47.714 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:47.726 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:47.727 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:47.729 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:47.729 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:48.500 INFO:teuthology.orchestra.run.smithi172.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:48.544 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/229 2023-03-27T11:23:48.545 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/229 2023-03-27T11:23:48.545 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:48.579 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:48.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:48.786 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-03-27T11:23:49.198 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:49.209 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:49.210 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:49.213 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:49.213 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:49.689 INFO:teuthology.orchestra.run.smithi172.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:49.698 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/230 2023-03-27T11:23:49.698 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/230 2023-03-27T11:23:49.698 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:49.703 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:49.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:49.746 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-03-27T11:23:50.154 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:50.166 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:50.167 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:50.169 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:50.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:50.631 INFO:teuthology.orchestra.run.smithi172.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:50.640 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/231 2023-03-27T11:23:50.640 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/231 2023-03-27T11:23:50.640 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:50.645 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:50.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:50.681 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-03-27T11:23:51.083 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:51.095 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:51.096 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:51.098 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:51.098 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:51.562 INFO:teuthology.orchestra.run.smithi172.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:51.571 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/232 2023-03-27T11:23:51.571 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/232 2023-03-27T11:23:51.572 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:51.577 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:51.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:51.614 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-03-27T11:23:52.025 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:52.036 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:52.037 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:52.039 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:52.039 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:52.501 INFO:teuthology.orchestra.run.smithi172.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:52.510 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/233 2023-03-27T11:23:52.511 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/233 2023-03-27T11:23:52.511 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:52.516 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:52.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:52.556 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-03-27T11:23:52.962 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:52.973 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:52.974 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:52.977 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:52.977 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:53.442 INFO:teuthology.orchestra.run.smithi172.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:53.451 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/234 2023-03-27T11:23:53.451 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/234 2023-03-27T11:23:53.451 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:53.457 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:53.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:53.499 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-03-27T11:23:53.904 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:53.916 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:53.916 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:53.919 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:53.919 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:54.383 INFO:teuthology.orchestra.run.smithi172.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:23:54.392 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/235 2023-03-27T11:23:54.392 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/235 2023-03-27T11:23:54.392 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:54.397 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:54.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:54.437 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-03-27T11:23:54.841 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:54.852 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:54.853 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:54.855 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:54.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:56.418 INFO:teuthology.orchestra.run.smithi172.stdout:generic/236 1s 2023-03-27T11:23:56.429 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/236 2023-03-27T11:23:56.430 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:56.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:56.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:56.589 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-03-27T11:23:57.203 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:57.215 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:57.216 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:57.218 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:57.218 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:57.824 INFO:teuthology.orchestra.run.smithi172.stdout:generic/237 0s 2023-03-27T11:23:57.836 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/237 2023-03-27T11:23:57.836 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:57.841 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:57.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:57.978 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-03-27T11:23:58.606 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:23:58.617 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:23:58.618 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:23:58.620 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:23:58.620 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:59.476 INFO:teuthology.orchestra.run.smithi172.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:23:59.524 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/238 2023-03-27T11:23:59.525 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/238 2023-03-27T11:23:59.525 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:23:59.532 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:23:59.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:23:59.701 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-03-27T11:24:00.111 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:24:00.122 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:24:00.123 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:24:00.125 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:24:00.125 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:24:07.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:24:07.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:24:37.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:24:37.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:25:07.599 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:25:07.613 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:25:37.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:25:37.882 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:25:57.747 INFO:teuthology.orchestra.run.smithi172.stdout:generic/239 117s 2023-03-27T11:25:57.760 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/239 2023-03-27T11:25:57.760 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:25:57.765 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:25:57.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:25:57.921 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-03-27T11:25:58.522 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:25:58.533 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:25:58.534 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:25:58.536 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:25:58.536 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:25:59.559 INFO:teuthology.orchestra.run.smithi172.stdout:generic/240 1s 2023-03-27T11:26:00.623 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/240 2023-03-27T11:26:00.624 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:26:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:26:00.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:26:00.778 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-03-27T11:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:26:01.460 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:26:01.461 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:26:01.464 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:26:08.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:26:08.176 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:26:38.289 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:26:38.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:26:38.391 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T11:26:38.394+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 324131) UID: 0 2023-03-27T11:26:38.391 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T11:26:38.394+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 324131) UID: 0 2023-03-27T11:27:14.968 INFO:teuthology.orchestra.run.smithi172.stdout:generic/241 73s 2023-03-27T11:27:19.427 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/241 2023-03-27T11:27:19.428 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:19.434 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:21.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:21.712 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-03-27T11:27:22.382 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:22.392 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:22.393 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:22.396 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:22.396 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:23.701 INFO:teuthology.orchestra.run.smithi172.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:23.721 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/242 2023-03-27T11:27:23.721 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/242 2023-03-27T11:27:23.721 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:23.735 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:23.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:23.938 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-03-27T11:27:24.693 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:24.707 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:24.708 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:24.710 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:24.711 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:25.641 INFO:teuthology.orchestra.run.smithi172.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:25.679 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/243 2023-03-27T11:27:25.679 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/243 2023-03-27T11:27:25.680 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:25.684 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:25.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:25.911 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-03-27T11:27:26.322 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:26.333 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:26.334 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:26.336 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:26.337 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:26.799 INFO:teuthology.orchestra.run.smithi172.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:27:26.808 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/244 2023-03-27T11:27:26.808 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/244 2023-03-27T11:27:26.808 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:26.813 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:26.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:26.848 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-03-27T11:27:27.251 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:27.262 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:27.263 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:27.265 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:27.265 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:27.813 INFO:teuthology.orchestra.run.smithi172.stdout:generic/245 0s 2023-03-27T11:27:27.825 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/245 2023-03-27T11:27:27.825 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:27.830 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:27.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:27.967 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-03-27T11:27:28.668 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:28.679 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:28.680 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:28.682 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:28.682 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:29.230 INFO:teuthology.orchestra.run.smithi172.stdout:generic/246 1s 2023-03-27T11:27:29.241 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/246 2023-03-27T11:27:29.242 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:29.247 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:29.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:29.400 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-03-27T11:27:30.070 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:30.081 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:30.082 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:30.084 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:30.085 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:39.187 INFO:teuthology.orchestra.run.smithi172.stdout:generic/247 9s 2023-03-27T11:27:39.200 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/247 2023-03-27T11:27:39.200 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:39.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:39.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:39.227 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-03-27T11:27:39.634 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:39.645 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:39.646 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:39.648 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:39.648 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:40.154 INFO:teuthology.orchestra.run.smithi172.stdout:generic/248 1s 2023-03-27T11:27:40.166 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/248 2023-03-27T11:27:40.166 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:40.171 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:40.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:40.217 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-03-27T11:27:40.620 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:40.631 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:40.632 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:40.635 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:40.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:41.467 INFO:teuthology.orchestra.run.smithi172.stdout:generic/249 1s 2023-03-27T11:27:41.479 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/249 2023-03-27T11:27:41.479 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:41.484 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:41.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:41.614 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-03-27T11:27:42.360 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:42.372 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:42.373 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:42.375 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:42.867 INFO:teuthology.orchestra.run.smithi172.stdout:generic/250 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:27:42.875 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/250 2023-03-27T11:27:42.875 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/250 2023-03-27T11:27:42.876 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:42.881 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:42.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:42.916 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-03-27T11:27:43.325 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:43.336 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:43.337 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:43.339 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:43.339 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:43.957 INFO:teuthology.orchestra.run.smithi172.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:43.982 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/251 2023-03-27T11:27:43.982 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/251 2023-03-27T11:27:43.983 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:43.987 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:44.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:44.024 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-03-27T11:27:44.437 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:44.448 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:44.449 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:44.451 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:44.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:44.926 INFO:teuthology.orchestra.run.smithi172.stdout:generic/252 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:27:44.935 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/252 2023-03-27T11:27:44.935 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/252 2023-03-27T11:27:44.935 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:44.940 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:44.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:44.979 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-03-27T11:27:45.385 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:45.396 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:45.397 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:45.399 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi172.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:46.222 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/253 2023-03-27T11:27:46.223 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/253 2023-03-27T11:27:46.223 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:46.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:46.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:46.491 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-03-27T11:27:46.906 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:46.917 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:46.918 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:46.920 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:46.921 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:47.729 INFO:teuthology.orchestra.run.smithi172.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:47.745 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/254 2023-03-27T11:27:47.746 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/254 2023-03-27T11:27:47.746 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:47.760 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:48.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:48.049 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-03-27T11:27:48.453 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:48.464 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:48.465 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:48.467 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:48.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:49.117 INFO:teuthology.orchestra.run.smithi172.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:27:49.126 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/255 2023-03-27T11:27:49.126 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/255 2023-03-27T11:27:49.127 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:49.132 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:49.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:49.295 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-03-27T11:27:49.939 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:49.950 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:49.951 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:49.953 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:49.953 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:50.799 INFO:teuthology.orchestra.run.smithi172.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:27:50.808 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/256 2023-03-27T11:27:50.808 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/256 2023-03-27T11:27:50.808 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:50.813 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:50.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:50.859 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-03-27T11:27:51.274 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:51.285 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:51.286 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:51.288 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:51.289 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:52.444 INFO:teuthology.orchestra.run.smithi172.stdout:generic/257 1s 2023-03-27T11:27:52.455 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/257 2023-03-27T11:27:52.456 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:52.461 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:52.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:52.693 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-03-27T11:27:53.393 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:53.404 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:53.405 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:53.407 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:53.880 INFO:teuthology.orchestra.run.smithi172.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-03-27T11:27:53.889 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/258 2023-03-27T11:27:53.889 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/258 2023-03-27T11:27:53.889 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:53.894 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:53.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:53.927 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-03-27T11:27:54.333 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:54.343 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:54.344 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:54.347 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:55.144 INFO:teuthology.orchestra.run.smithi172.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:55.175 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/259 2023-03-27T11:27:55.175 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/259 2023-03-27T11:27:55.175 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:55.186 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:55.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:55.443 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-03-27T11:27:55.857 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:55.868 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:55.869 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:55.871 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:55.872 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:56.471 INFO:teuthology.orchestra.run.smithi172.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:56.495 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/260 2023-03-27T11:27:56.495 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/260 2023-03-27T11:27:56.496 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:56.501 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:56.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:56.538 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-03-27T11:27:56.944 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:56.955 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:56.956 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:56.958 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:56.959 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:57.760 INFO:teuthology.orchestra.run.smithi172.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:57.778 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/261 2023-03-27T11:27:57.778 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/261 2023-03-27T11:27:57.778 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:57.789 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:58.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:58.044 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-03-27T11:27:58.455 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:58.466 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:58.467 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:58.469 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:58.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:59.274 INFO:teuthology.orchestra.run.smithi172.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:27:59.303 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/262 2023-03-27T11:27:59.304 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/262 2023-03-27T11:27:59.304 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:27:59.316 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:27:59.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:27:59.544 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-03-27T11:27:59.967 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:27:59.978 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:27:59.979 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:27:59.982 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:27:59.982 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:46.405 INFO:teuthology.orchestra.run.smithi172.stdout:generic/263 46s 2023-03-27T11:28:46.413 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/263 2023-03-27T11:28:46.413 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:46.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:46.592 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-03-27T11:28:47.222 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:47.232 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:47.233 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:47.236 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:47.236 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:48.195 INFO:teuthology.orchestra.run.smithi172.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:48.211 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/264 2023-03-27T11:28:48.211 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/264 2023-03-27T11:28:48.211 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:48.225 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:48.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:48.510 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-03-27T11:28:48.930 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:48.943 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:48.944 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:49.844 INFO:teuthology.orchestra.run.smithi172.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:49.871 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/265 2023-03-27T11:28:49.872 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/265 2023-03-27T11:28:49.872 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:49.890 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:50.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:50.035 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-03-27T11:28:50.503 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:50.514 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:50.515 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:50.517 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:50.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:51.455 INFO:teuthology.orchestra.run.smithi172.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:51.471 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/266 2023-03-27T11:28:51.471 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/266 2023-03-27T11:28:51.471 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:51.484 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:51.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:51.678 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-03-27T11:28:52.093 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:52.105 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:52.106 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:52.108 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:52.108 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:53.014 INFO:teuthology.orchestra.run.smithi172.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:53.059 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/267 2023-03-27T11:28:53.059 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/267 2023-03-27T11:28:53.059 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:53.093 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:53.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:53.211 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-03-27T11:28:53.629 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:53.640 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:53.641 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:53.643 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:53.644 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:54.618 INFO:teuthology.orchestra.run.smithi172.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:54.670 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/268 2023-03-27T11:28:54.670 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/268 2023-03-27T11:28:54.670 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:54.700 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:54.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:54.811 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-03-27T11:28:55.226 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:55.237 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:55.238 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:55.240 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:55.240 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:55.725 INFO:teuthology.orchestra.run.smithi172.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:28:55.734 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/269 2023-03-27T11:28:55.735 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/269 2023-03-27T11:28:55.735 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:55.740 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:55.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:55.790 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-03-27T11:28:56.223 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:56.234 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:56.235 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:56.237 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:56.237 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:56.688 INFO:teuthology.orchestra.run.smithi172.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:28:56.697 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/270 2023-03-27T11:28:56.697 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/270 2023-03-27T11:28:56.697 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:56.702 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:56.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:56.744 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-03-27T11:28:57.150 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:57.161 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:57.162 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:57.164 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:57.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:58.098 INFO:teuthology.orchestra.run.smithi172.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/271 2023-03-27T11:28:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/271 2023-03-27T11:28:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:58.140 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:58.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:58.283 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-03-27T11:28:58.719 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:28:58.729 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:28:58.730 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:28:58.733 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:28:58.733 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:59.762 INFO:teuthology.orchestra.run.smithi172.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:28:59.797 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/272 2023-03-27T11:28:59.797 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/272 2023-03-27T11:28:59.797 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:28:59.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:28:59.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:28:59.902 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-03-27T11:29:00.316 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:00.327 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:00.328 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:00.330 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:00.330 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:00.811 INFO:teuthology.orchestra.run.smithi172.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:29:00.820 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/273 2023-03-27T11:29:00.820 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/273 2023-03-27T11:29:00.820 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:00.826 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:00.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:00.863 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-03-27T11:29:01.278 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:01.289 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:01.290 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:01.292 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:01.793 INFO:teuthology.orchestra.run.smithi172.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T11:29:01.802 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/274 2023-03-27T11:29:01.802 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/274 2023-03-27T11:29:01.802 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:01.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:01.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:01.851 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-03-27T11:29:02.273 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:02.284 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:02.285 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:02.287 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:02.288 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:02.769 INFO:teuthology.orchestra.run.smithi172.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:29:02.778 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/275 2023-03-27T11:29:02.778 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/275 2023-03-27T11:29:02.778 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:02.783 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:02.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:02.823 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-03-27T11:29:03.231 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:03.242 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:03.243 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:03.246 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:03.246 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:04.148 INFO:teuthology.orchestra.run.smithi172.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:04.180 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/276 2023-03-27T11:29:04.182 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/276 2023-03-27T11:29:04.182 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:04.194 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:04.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:04.365 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-03-27T11:29:04.829 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:04.839 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:04.840 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:04.842 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:04.843 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:05.352 INFO:teuthology.orchestra.run.smithi172.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-03-27T11:29:05.361 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/277 2023-03-27T11:29:05.361 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/277 2023-03-27T11:29:05.362 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:05.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:05.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:05.407 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-03-27T11:29:05.817 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:05.828 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:05.829 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:05.832 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:05.832 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:06.781 INFO:teuthology.orchestra.run.smithi172.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:06.806 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/278 2023-03-27T11:29:06.807 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/278 2023-03-27T11:29:06.807 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:06.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:06.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:06.976 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-03-27T11:29:07.396 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:07.407 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:07.408 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:07.410 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:07.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:08.390 INFO:teuthology.orchestra.run.smithi172.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:08.424 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/279 2023-03-27T11:29:08.424 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/279 2023-03-27T11:29:08.424 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:08.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:08.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:08.545 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-03-27T11:29:08.961 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:08.973 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:08.974 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:08.976 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:08.977 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:09.468 INFO:teuthology.orchestra.run.smithi172.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:29:09.476 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/280 2023-03-27T11:29:09.477 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/280 2023-03-27T11:29:09.477 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:09.482 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:09.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:09.522 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-03-27T11:29:09.938 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:09.949 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:09.950 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:09.952 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:09.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:10.850 INFO:teuthology.orchestra.run.smithi172.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:10.900 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/281 2023-03-27T11:29:10.900 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/281 2023-03-27T11:29:10.900 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:10.908 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:11.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:11.084 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-03-27T11:29:11.506 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:11.518 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:11.519 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:11.521 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:11.521 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:12.406 INFO:teuthology.orchestra.run.smithi172.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/282 2023-03-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/282 2023-03-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:12.452 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:12.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:12.617 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-03-27T11:29:13.046 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:13.057 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:13.058 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:13.060 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:13.060 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:13.977 INFO:teuthology.orchestra.run.smithi172.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:14.015 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/283 2023-03-27T11:29:14.015 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/283 2023-03-27T11:29:14.016 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:14.050 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:14.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:14.216 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-03-27T11:29:14.670 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:14.683 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:14.683 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:14.686 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:15.544 INFO:teuthology.orchestra.run.smithi172.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:15.599 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/284 2023-03-27T11:29:15.599 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/284 2023-03-27T11:29:15.599 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:15.611 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:15.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:15.785 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-03-27T11:29:16.213 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:16.223 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:16.224 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:16.226 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:18.290 INFO:teuthology.orchestra.run.smithi172.stdout:generic/285 2s 2023-03-27T11:29:18.302 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/285 2023-03-27T11:29:18.302 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:18.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:18.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:18.938 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-03-27T11:29:19.695 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:19.705 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:19.706 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:19.709 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:19.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:20.496 INFO:teuthology.orchestra.run.smithi172.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:29:20.515 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/286 2023-03-27T11:29:20.515 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/286 2023-03-27T11:29:20.515 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:20.526 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:20.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:20.590 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-03-27T11:29:21.261 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:21.282 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:21.284 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:21.287 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:21.287 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:22.474 INFO:teuthology.orchestra.run.smithi172.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:22.496 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/287 2023-03-27T11:29:22.497 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/287 2023-03-27T11:29:22.497 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:22.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:22.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:22.720 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-03-27T11:29:23.325 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:23.342 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:23.344 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:23.347 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:23.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:24.259 INFO:teuthology.orchestra.run.smithi172.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:24.294 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/288 2023-03-27T11:29:24.294 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/288 2023-03-27T11:29:24.294 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:24.301 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:24.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:24.350 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-03-27T11:29:24.878 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:24.889 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:24.890 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:24.892 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:24.893 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:25.746 INFO:teuthology.orchestra.run.smithi172.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:25.775 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/289 2023-03-27T11:29:25.775 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/289 2023-03-27T11:29:25.775 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:25.791 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:25.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:25.942 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-03-27T11:29:26.363 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:26.374 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:26.375 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:26.378 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:26.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:27.201 INFO:teuthology.orchestra.run.smithi172.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:27.245 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/290 2023-03-27T11:29:27.246 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/290 2023-03-27T11:29:27.246 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:27.250 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:27.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:27.438 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-03-27T11:29:27.852 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:27.863 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:27.864 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:28.691 INFO:teuthology.orchestra.run.smithi172.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:28.737 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/291 2023-03-27T11:29:28.737 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/291 2023-03-27T11:29:28.738 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:28.743 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:28.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:28.916 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-03-27T11:29:29.338 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:29.349 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:29.350 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:29.352 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:29.352 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:30.197 INFO:teuthology.orchestra.run.smithi172.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:30.243 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/292 2023-03-27T11:29:30.244 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/292 2023-03-27T11:29:30.244 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:30.265 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:30.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:30.407 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-03-27T11:29:30.824 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:30.835 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:30.836 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:30.838 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:30.838 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:31.694 INFO:teuthology.orchestra.run.smithi172.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:31.729 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/293 2023-03-27T11:29:31.729 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/293 2023-03-27T11:29:31.730 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:31.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:31.894 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-03-27T11:29:32.314 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:32.325 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:32.326 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:32.329 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:33.278 INFO:teuthology.orchestra.run.smithi172.stdout:generic/294 1s 2023-03-27T11:29:33.337 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/294 2023-03-27T11:29:33.338 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:33.346 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:33.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:33.384 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-03-27T11:29:33.900 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:33.911 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:33.912 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:33.914 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:33.914 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:34.754 INFO:teuthology.orchestra.run.smithi172.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:34.800 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/295 2023-03-27T11:29:34.800 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/295 2023-03-27T11:29:34.800 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:34.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:34.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:34.961 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-03-27T11:29:35.389 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:35.400 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:35.401 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:35.403 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:36.194 INFO:teuthology.orchestra.run.smithi172.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:36.238 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/296 2023-03-27T11:29:36.239 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/296 2023-03-27T11:29:36.239 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:36.245 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:36.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:36.462 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-03-27T11:29:36.879 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:36.890 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:36.891 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:36.894 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:36.894 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:37.724 INFO:teuthology.orchestra.run.smithi172.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:37.754 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/297 2023-03-27T11:29:37.755 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/297 2023-03-27T11:29:37.763 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:37.784 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:37.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:37.972 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-03-27T11:29:38.381 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:38.392 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:38.393 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:38.395 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:38.395 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:39.254 INFO:teuthology.orchestra.run.smithi172.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:39.292 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/298 2023-03-27T11:29:39.293 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/298 2023-03-27T11:29:39.293 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:39.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:39.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:39.455 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-03-27T11:29:39.876 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:39.887 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:39.888 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:39.891 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:39.891 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:40.451 INFO:teuthology.orchestra.run.smithi172.stdout:generic/299 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:29:40.460 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/299 2023-03-27T11:29:40.460 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/299 2023-03-27T11:29:40.460 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:40.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:40.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:40.508 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-03-27T11:29:40.919 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:40.930 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:40.931 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:40.934 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:40.934 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:41.467 INFO:teuthology.orchestra.run.smithi172.stdout:generic/300 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:29:41.476 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/300 2023-03-27T11:29:41.476 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/300 2023-03-27T11:29:41.477 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:41.482 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:41.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:41.525 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-03-27T11:29:41.937 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:41.949 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:41.950 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:41.952 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:41.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:42.788 INFO:teuthology.orchestra.run.smithi172.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:42.827 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/301 2023-03-27T11:29:42.827 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/301 2023-03-27T11:29:42.827 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:42.845 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:43.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:43.012 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-03-27T11:29:43.431 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:43.442 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:43.443 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:43.445 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:43.445 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:44.290 INFO:teuthology.orchestra.run.smithi172.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:44.316 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/302 2023-03-27T11:29:44.321 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/302 2023-03-27T11:29:44.322 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:44.338 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:44.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:44.511 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-03-27T11:29:44.939 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:44.950 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:44.951 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:44.954 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:44.954 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/303 2023-03-27T11:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/303 2023-03-27T11:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:45.500 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:45.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:45.635 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-03-27T11:29:46.269 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:46.280 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:46.281 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:46.283 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:46.284 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:46.818 INFO:teuthology.orchestra.run.smithi172.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T11:29:46.827 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/304 2023-03-27T11:29:46.827 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/304 2023-03-27T11:29:46.828 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:46.833 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:46.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:46.972 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-03-27T11:29:47.592 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:47.603 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:47.604 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:47.606 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:47.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:48.414 INFO:teuthology.orchestra.run.smithi172.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:29:48.449 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/305 2023-03-27T11:29:48.449 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/305 2023-03-27T11:29:48.449 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:48.456 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:48.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:48.614 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-03-27T11:29:49.057 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:49.067 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:49.069 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:49.071 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:49.071 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:50.317 INFO:teuthology.orchestra.run.smithi172.stdout:generic/306 1s 2023-03-27T11:29:50.528 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/306 2023-03-27T11:29:50.528 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:50.533 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:50.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:50.689 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-03-27T11:29:51.289 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:51.301 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:51.302 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:51.304 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:51.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:52.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:29:52.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:29:53.294 INFO:teuthology.orchestra.run.smithi172.stdout:generic/307 2s 2023-03-27T11:29:53.305 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/307 2023-03-27T11:29:53.306 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:53.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:53.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:53.330 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-03-27T11:29:53.751 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:53.762 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:53.764 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:53.766 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:53.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:54.286 INFO:teuthology.orchestra.run.smithi172.stdout:generic/308 1s 2023-03-27T11:29:54.297 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/308 2023-03-27T11:29:54.298 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:54.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:54.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:54.350 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-03-27T11:29:54.758 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:54.769 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:54.770 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:54.773 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:54.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:56.326 INFO:teuthology.orchestra.run.smithi172.stdout:generic/309 2s 2023-03-27T11:29:56.337 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/309 2023-03-27T11:29:56.337 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:29:56.343 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:29:56.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:29:56.539 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-03-27T11:29:57.088 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:29:57.099 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:29:57.100 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:29:57.102 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:29:57.103 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:30:22.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:30:22.178 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:30:52.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:30:52.982 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:31:14.288 INFO:teuthology.orchestra.run.smithi172.stdout:generic/310 77s 2023-03-27T11:31:14.299 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/310 2023-03-27T11:31:14.299 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:14.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:14.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:14.540 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-03-27T11:31:15.112 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:15.123 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:15.124 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:15.126 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:15.126 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:15.707 INFO:teuthology.orchestra.run.smithi172.stdout:generic/311 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:31:15.716 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/311 2023-03-27T11:31:15.716 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/311 2023-03-27T11:31:15.716 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:15.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:15.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:15.763 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-03-27T11:31:16.179 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:16.190 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:16.191 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:16.194 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:16.194 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:16.684 INFO:teuthology.orchestra.run.smithi172.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:31:16.693 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/312 2023-03-27T11:31:16.694 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/312 2023-03-27T11:31:16.694 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:16.699 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:16.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:16.745 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-03-27T11:31:17.156 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:17.167 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:17.168 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:17.170 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:17.170 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:21.708 INFO:teuthology.orchestra.run.smithi172.stdout:generic/313 4s 2023-03-27T11:31:21.721 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/313 2023-03-27T11:31:21.721 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:21.727 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:21.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:21.779 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-03-27T11:31:22.187 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:22.198 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:22.199 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:22.201 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:22.201 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:23.049 INFO:teuthology.orchestra.run.smithi172.stdout:generic/314 1s 2023-03-27T11:31:23.060 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/314 2023-03-27T11:31:23.060 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:23.066 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:23.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:31:23.094 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:31:23.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:23.108 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-03-27T11:31:23.555 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:23.566 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:23.567 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:23.569 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:23.569 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:24.067 INFO:teuthology.orchestra.run.smithi172.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T11:31:24.076 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/315 2023-03-27T11:31:24.076 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/315 2023-03-27T11:31:24.076 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:24.081 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:24.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:24.125 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-03-27T11:31:24.537 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:24.549 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:24.550 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:24.552 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:24.552 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:25.237 INFO:teuthology.orchestra.run.smithi172.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T11:31:25.245 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/316 2023-03-27T11:31:25.246 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/316 2023-03-27T11:31:25.246 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:25.251 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:25.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:25.366 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-03-27T11:31:26.016 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:26.027 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:26.028 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:26.030 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:26.031 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:28.252 INFO:teuthology.orchestra.run.smithi172.stdout:generic/317 2s 2023-03-27T11:31:28.263 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/317 2023-03-27T11:31:28.264 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:28.269 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:28.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:28.288 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-03-27T11:31:28.697 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:28.708 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:28.709 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:28.711 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:28.712 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:29.744 INFO:teuthology.orchestra.run.smithi172.stdout:generic/318 1s 2023-03-27T11:31:29.756 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/318 2023-03-27T11:31:29.756 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:29.761 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:29.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:29.780 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-03-27T11:31:30.194 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:30.205 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:30.206 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:30.209 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:30.209 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:30.962 INFO:teuthology.orchestra.run.smithi172.stdout:generic/319 0s 2023-03-27T11:31:30.974 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/319 2023-03-27T11:31:30.974 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:30.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:31.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:31.000 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-03-27T11:31:31.407 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:31.418 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:31.419 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:31.422 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:31.422 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:31:31.916 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/320 2023-03-27T11:31:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/320 2023-03-27T11:31:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:31.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:31.957 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-03-27T11:31:32.368 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:32.379 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:32.380 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:32.382 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:32.872 INFO:teuthology.orchestra.run.smithi172.stdout:generic/321 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:31:32.880 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/321 2023-03-27T11:31:32.881 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/321 2023-03-27T11:31:32.881 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:32.886 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:32.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:32.930 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-03-27T11:31:33.337 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:33.348 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:33.349 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:33.351 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:33.351 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:33.831 INFO:teuthology.orchestra.run.smithi172.stdout:generic/322 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:31:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/322 2023-03-27T11:31:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/322 2023-03-27T11:31:33.840 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:31:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:33.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:31:33.884 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-03-27T11:31:34.293 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:31:34.304 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:31:34.305 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:31:34.308 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:31:34.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:31:53.454 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:31:53.458 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:31:53.544 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T11:31:53.548+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122481) UID: 0 2023-03-27T11:31:53.544 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T11:31:53.548+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122481) UID: 0 2023-03-27T11:31:53.545 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T11:31:53.548+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122481) UID: 0 2023-03-27T11:31:53.545 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T11:31:53.548+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122481) UID: 0 2023-03-27T11:33:35.434 INFO:teuthology.orchestra.run.smithi172.stdout:generic/323 121s 2023-03-27T11:33:35.445 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/323 2023-03-27T11:33:35.445 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:35.450 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:35.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:35.564 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-03-27T11:33:36.193 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:36.204 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:36.205 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:36.208 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:36.208 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:36.661 INFO:teuthology.orchestra.run.smithi172.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-03-27T11:33:36.670 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/324 2023-03-27T11:33:36.670 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/324 2023-03-27T11:33:36.670 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:36.675 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:36.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:36.711 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-03-27T11:33:37.118 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:37.129 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:37.130 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:37.132 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:37.133 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:37.616 INFO:teuthology.orchestra.run.smithi172.stdout:generic/325 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:33:37.626 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/325 2023-03-27T11:33:37.626 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/325 2023-03-27T11:33:37.626 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:37.631 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:37.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:37.665 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-03-27T11:33:38.068 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:38.079 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:38.080 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:38.082 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:38.083 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:38.938 INFO:teuthology.orchestra.run.smithi172.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:38.973 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/326 2023-03-27T11:33:38.973 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/326 2023-03-27T11:33:38.973 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:38.984 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:39.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:39.126 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-03-27T11:33:39.546 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:39.557 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:39.558 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:39.560 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:39.560 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:40.399 INFO:teuthology.orchestra.run.smithi172.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:40.437 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/327 2023-03-27T11:33:40.437 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/327 2023-03-27T11:33:40.438 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:40.445 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:40.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:40.608 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-03-27T11:33:41.027 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:41.038 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:41.039 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:41.041 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:41.849 INFO:teuthology.orchestra.run.smithi172.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:41.889 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/328 2023-03-27T11:33:41.889 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/328 2023-03-27T11:33:41.890 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:41.913 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:42.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:42.119 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-03-27T11:33:42.533 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:42.544 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:42.545 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:42.548 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:42.548 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:43.466 INFO:teuthology.orchestra.run.smithi172.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:43.495 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/329 2023-03-27T11:33:43.496 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/329 2023-03-27T11:33:43.496 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:43.507 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:43.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:43.618 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-03-27T11:33:44.037 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:44.048 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:44.049 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:44.051 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:44.051 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:44.888 INFO:teuthology.orchestra.run.smithi172.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:44.945 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/330 2023-03-27T11:33:44.945 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/330 2023-03-27T11:33:44.945 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:44.953 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:45.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:45.113 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-03-27T11:33:45.536 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:45.547 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:45.548 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:45.550 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:45.551 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:46.463 INFO:teuthology.orchestra.run.smithi172.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:46.503 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/331 2023-03-27T11:33:46.503 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/331 2023-03-27T11:33:46.504 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:46.514 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:46.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:46.624 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-03-27T11:33:47.040 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:47.051 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:47.052 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:47.055 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:47.055 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:47.920 INFO:teuthology.orchestra.run.smithi172.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:47.942 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/332 2023-03-27T11:33:47.942 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/332 2023-03-27T11:33:47.942 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:47.956 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:48.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:48.118 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-03-27T11:33:48.538 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:48.549 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:48.550 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:48.552 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:48.552 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:49.415 INFO:teuthology.orchestra.run.smithi172.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:49.474 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/333 2023-03-27T11:33:49.475 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/333 2023-03-27T11:33:49.475 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:49.482 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:49.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:49.649 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-03-27T11:33:50.062 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:50.074 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:50.075 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:50.077 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:50.077 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:51.005 INFO:teuthology.orchestra.run.smithi172.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:33:51.040 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/334 2023-03-27T11:33:51.041 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/334 2023-03-27T11:33:51.041 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:51.055 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:51.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:51.254 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-03-27T11:33:51.665 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:51.677 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:51.678 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:51.680 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:51.680 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:52.183 INFO:teuthology.orchestra.run.smithi172.stdout:generic/335 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:33:52.192 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/335 2023-03-27T11:33:52.192 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/335 2023-03-27T11:33:52.192 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:52.197 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:52.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:52.237 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-03-27T11:33:52.647 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:52.658 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:52.659 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:52.661 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:52.661 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:53.162 INFO:teuthology.orchestra.run.smithi172.stdout:generic/336 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:33:53.171 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/336 2023-03-27T11:33:53.171 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/336 2023-03-27T11:33:53.171 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:53.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:53.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:53.224 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-03-27T11:33:53.637 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:53.649 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:53.651 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:53.651 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:54.393 INFO:teuthology.orchestra.run.smithi172.stdout:generic/337 1s 2023-03-27T11:33:54.404 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/337 2023-03-27T11:33:54.405 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:54.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:54.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:54.429 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-03-27T11:33:54.840 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:54.851 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:54.852 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:54.854 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:54.854 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:55.358 INFO:teuthology.orchestra.run.smithi172.stdout:generic/338 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:33:55.367 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/338 2023-03-27T11:33:55.367 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/338 2023-03-27T11:33:55.367 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:33:55.372 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:33:55.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:33:55.410 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-03-27T11:33:55.826 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:33:55.837 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:33:55.838 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:33:55.841 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:33:55.841 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:50.475 INFO:teuthology.orchestra.run.smithi172.stdout:generic/339 54s 2023-03-27T11:34:50.611 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/339 2023-03-27T11:34:50.612 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:34:50.617 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:50.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:34:50.636 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-03-27T11:34:51.196 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:34:51.207 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:34:51.208 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:34:51.210 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:34:51.211 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:56.246 INFO:teuthology.orchestra.run.smithi172.stdout:generic/340 5s 2023-03-27T11:34:56.311 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/340 2023-03-27T11:34:56.311 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:34:56.316 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:56.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:34:56.373 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-03-27T11:34:56.810 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:34:56.825 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:34:56.827 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:34:56.830 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:34:56.830 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:57.500 INFO:teuthology.orchestra.run.smithi172.stdout:generic/341 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:34:57.509 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/341 2023-03-27T11:34:57.509 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/341 2023-03-27T11:34:57.509 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:34:57.514 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:57.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:34:57.547 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-03-27T11:34:57.953 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:34:57.964 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:34:57.965 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:34:57.968 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:34:57.968 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:58.459 INFO:teuthology.orchestra.run.smithi172.stdout:generic/342 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:34:58.468 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/342 2023-03-27T11:34:58.468 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/342 2023-03-27T11:34:58.468 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:34:58.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:58.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:34:58.509 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-03-27T11:34:58.913 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:34:58.925 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:34:58.926 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:34:58.928 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:34:58.928 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:59.423 INFO:teuthology.orchestra.run.smithi172.stdout:generic/343 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:34:59.432 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/343 2023-03-27T11:34:59.432 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/343 2023-03-27T11:34:59.432 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:34:59.438 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:34:59.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:34:59.485 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-03-27T11:34:59.888 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:34:59.899 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:34:59.900 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:34:59.902 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:34:59.902 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:08.191 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:35:08.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:35:09.611 INFO:teuthology.orchestra.run.smithi172.stdout:generic/344 9s 2023-03-27T11:35:09.680 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/344 2023-03-27T11:35:09.680 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:09.689 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:09.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:09.732 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-03-27T11:35:10.476 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:10.496 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:10.498 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:10.501 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:10.501 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:21.114 INFO:teuthology.orchestra.run.smithi172.stdout:generic/345 11s 2023-03-27T11:35:21.159 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/345 2023-03-27T11:35:21.159 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:21.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:21.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:21.239 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-03-27T11:35:21.713 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:21.724 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:21.725 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:21.727 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:21.728 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:27.016 INFO:teuthology.orchestra.run.smithi172.stdout:generic/346 5s 2023-03-27T11:35:27.054 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/346 2023-03-27T11:35:27.054 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:27.067 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:27.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:27.148 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-03-27T11:35:27.799 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:27.810 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:27.811 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:27.813 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:27.813 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:28.341 INFO:teuthology.orchestra.run.smithi172.stdout:generic/347 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:35:28.350 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/347 2023-03-27T11:35:28.350 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/347 2023-03-27T11:35:28.350 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:28.356 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:28.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:28.395 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-03-27T11:35:28.808 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:28.819 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:28.820 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:28.822 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:28.822 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:29.326 INFO:teuthology.orchestra.run.smithi172.stdout:generic/348 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:35:29.335 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/348 2023-03-27T11:35:29.335 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/348 2023-03-27T11:35:29.335 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:29.340 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:29.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:29.389 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-03-27T11:35:29.793 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:29.804 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:29.805 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:29.808 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:29.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:30.442 INFO:teuthology.orchestra.run.smithi172.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T11:35:30.451 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/349 2023-03-27T11:35:30.451 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/349 2023-03-27T11:35:30.451 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:30.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:30.500 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-03-27T11:35:30.907 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:30.918 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:30.919 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:30.921 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:30.921 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:32.045 INFO:teuthology.orchestra.run.smithi172.stdout:generic/350 1s 2023-03-27T11:35:32.056 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/350 2023-03-27T11:35:32.056 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:32.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:32.080 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-03-27T11:35:32.492 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:32.503 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:32.504 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:32.506 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:32.507 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:32.984 INFO:teuthology.orchestra.run.smithi172.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:35:32.993 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/351 2023-03-27T11:35:32.993 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/351 2023-03-27T11:35:32.993 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:32.999 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:33.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:33.035 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-03-27T11:35:33.443 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:33.454 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:33.455 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:33.457 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:33.458 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:34.266 INFO:teuthology.orchestra.run.smithi172.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:35:34.310 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/352 2023-03-27T11:35:34.311 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/352 2023-03-27T11:35:34.311 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:34.320 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:34.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:34.529 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-03-27T11:35:34.933 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:34.944 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:34.945 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:34.947 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:34.947 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:35.760 INFO:teuthology.orchestra.run.smithi172.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:35:35.783 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/353 2023-03-27T11:35:35.783 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/353 2023-03-27T11:35:35.783 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:35.797 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:35.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:35.970 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-03-27T11:35:36.405 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:36.416 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:36.417 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:36.419 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:36.419 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:38.537 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:35:38.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:35:46.165 INFO:teuthology.orchestra.run.smithi172.stdout:generic/354 10s 2023-03-27T11:35:46.222 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/354 2023-03-27T11:35:46.223 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:46.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:46.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:46.262 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-03-27T11:35:46.754 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:46.765 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:46.766 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:46.769 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:46.769 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:47.993 INFO:teuthology.orchestra.run.smithi172.stdout:generic/355 0s 2023-03-27T11:35:48.004 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/355 2023-03-27T11:35:48.004 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:48.010 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:48.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:48.141 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-03-27T11:35:48.752 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:48.763 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:48.764 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:48.766 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:48.767 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:49.476 INFO:teuthology.orchestra.run.smithi172.stdout:generic/356 [not run] swapfiles are not supported 2023-03-27T11:35:49.485 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/356 2023-03-27T11:35:49.485 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/356 2023-03-27T11:35:49.485 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:49.490 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:49.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:49.533 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-03-27T11:35:49.943 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:49.954 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:49.955 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:49.957 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:49.958 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:50.643 INFO:teuthology.orchestra.run.smithi172.stdout:generic/357 [not run] swapfiles are not supported 2023-03-27T11:35:50.652 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/357 2023-03-27T11:35:50.652 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/357 2023-03-27T11:35:50.652 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:50.657 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:50.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:50.694 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-03-27T11:35:51.101 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:51.112 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:51.113 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:51.115 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:51.116 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:51.966 INFO:teuthology.orchestra.run.smithi172.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:35:51.987 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/358 2023-03-27T11:35:51.988 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/358 2023-03-27T11:35:51.988 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:51.995 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:52.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:52.162 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-03-27T11:35:52.582 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:52.593 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:52.594 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:52.596 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:52.596 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:53.389 INFO:teuthology.orchestra.run.smithi172.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:35:53.422 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/359 2023-03-27T11:35:53.422 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/359 2023-03-27T11:35:53.422 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:53.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:53.586 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-03-27T11:35:54.026 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:54.037 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:54.038 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:54.040 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:54.040 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:54.578 INFO:teuthology.orchestra.run.smithi172.stdout:generic/360 0s 2023-03-27T11:35:54.589 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/360 2023-03-27T11:35:54.589 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:54.594 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:54.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:54.634 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-03-27T11:35:55.050 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:55.062 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:55.062 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:55.065 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:55.554 INFO:teuthology.orchestra.run.smithi172.stdout:generic/361 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:35:55.562 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/361 2023-03-27T11:35:55.563 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/361 2023-03-27T11:35:55.563 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:55.568 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:55.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:55.603 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-03-27T11:35:56.023 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:56.034 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:56.035 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:56.037 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:56.038 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:56.502 INFO:teuthology.orchestra.run.smithi172.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:35:56.511 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/362 2023-03-27T11:35:56.512 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/362 2023-03-27T11:35:56.512 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:56.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:56.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:56.556 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-03-27T11:35:56.972 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:56.983 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:56.984 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:56.986 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:57.439 INFO:teuthology.orchestra.run.smithi172.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:35:57.448 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/363 2023-03-27T11:35:57.448 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/363 2023-03-27T11:35:57.448 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:57.454 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:57.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:57.496 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-03-27T11:35:57.909 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:57.920 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:57.921 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:57.923 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:57.924 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:58.388 INFO:teuthology.orchestra.run.smithi172.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:35:58.397 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/364 2023-03-27T11:35:58.397 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/364 2023-03-27T11:35:58.397 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:58.402 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:58.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:58.452 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-03-27T11:35:58.856 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:58.867 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:58.868 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:58.870 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:58.871 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:59.333 INFO:teuthology.orchestra.run.smithi172.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:35:59.342 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/365 2023-03-27T11:35:59.342 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/365 2023-03-27T11:35:59.342 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:35:59.347 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:35:59.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:35:59.383 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-03-27T11:35:59.790 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:35:59.801 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:35:59.802 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:35:59.804 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:35:59.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:00.271 INFO:teuthology.orchestra.run.smithi172.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:36:00.280 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/366 2023-03-27T11:36:00.280 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/366 2023-03-27T11:36:00.281 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:00.286 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:00.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:00.330 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-03-27T11:36:00.738 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:00.749 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:00.750 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:00.753 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:00.753 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:01.214 INFO:teuthology.orchestra.run.smithi172.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:36:01.223 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/367 2023-03-27T11:36:01.224 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/367 2023-03-27T11:36:01.224 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:01.229 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:01.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:01.267 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-03-27T11:36:01.674 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:01.685 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:01.686 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:01.688 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:01.689 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:02.147 INFO:teuthology.orchestra.run.smithi172.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:36:02.156 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/368 2023-03-27T11:36:02.157 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/368 2023-03-27T11:36:02.157 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:02.162 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:02.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:02.203 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-03-27T11:36:02.608 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:02.619 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:02.620 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:03.092 INFO:teuthology.orchestra.run.smithi172.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:36:03.101 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/369 2023-03-27T11:36:03.101 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/369 2023-03-27T11:36:03.102 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:03.107 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:03.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:03.147 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-03-27T11:36:03.552 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:03.563 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:03.564 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:03.567 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:03.567 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:04.015 INFO:teuthology.orchestra.run.smithi172.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-03-27T11:36:04.024 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/370 2023-03-27T11:36:04.024 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/370 2023-03-27T11:36:04.024 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:04.029 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:04.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:04.065 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-03-27T11:36:04.474 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:04.485 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:04.486 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:04.488 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:04.489 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:04.968 INFO:teuthology.orchestra.run.smithi172.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:36:04.977 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/371 2023-03-27T11:36:04.977 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/371 2023-03-27T11:36:04.977 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:04.982 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:05.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:05.021 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-03-27T11:36:05.432 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:05.443 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:05.444 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:05.446 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:05.446 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:06.262 INFO:teuthology.orchestra.run.smithi172.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:36:06.304 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/372 2023-03-27T11:36:06.305 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/372 2023-03-27T11:36:06.305 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:06.344 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:06.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:06.510 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-03-27T11:36:06.920 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:06.932 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:06.933 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:06.935 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:06.935 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:07.767 INFO:teuthology.orchestra.run.smithi172.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:36:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/373 2023-03-27T11:36:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/373 2023-03-27T11:36:07.827 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:07.829 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:08.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:08.018 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-03-27T11:36:08.429 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:08.440 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:08.441 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:08.443 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:08.444 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:08.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:36:08.714 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:36:09.118 INFO:teuthology.orchestra.run.smithi172.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-27T11:36:09.229 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/374 2023-03-27T11:36:09.230 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/374 2023-03-27T11:36:09.230 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:09.233 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:09.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:09.555 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-03-27T11:36:09.966 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:09.977 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:09.978 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:09.980 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:09.980 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:10.590 INFO:teuthology.orchestra.run.smithi172.stdout:generic/375 0s 2023-03-27T11:36:10.601 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/375 2023-03-27T11:36:10.601 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:10.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:10.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:10.724 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-03-27T11:36:11.349 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:11.360 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:11.361 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:11.363 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:11.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:11.848 INFO:teuthology.orchestra.run.smithi172.stdout:generic/376 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:36:11.857 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/376 2023-03-27T11:36:11.857 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/376 2023-03-27T11:36:11.857 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:11.862 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:11.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:11.896 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-03-27T11:36:12.301 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:12.312 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:12.313 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:12.315 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:12.316 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:13.039 INFO:teuthology.orchestra.run.smithi172.stdout:generic/377 1s 2023-03-27T11:36:13.050 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/377 2023-03-27T11:36:13.050 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:13.056 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:13.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:13.074 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-03-27T11:36:13.478 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:13.489 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:13.490 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:13.492 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:13.492 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:14.274 INFO:teuthology.orchestra.run.smithi172.stdout:generic/378 1s 2023-03-27T11:36:14.286 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/378 2023-03-27T11:36:14.287 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:14.292 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:14.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:14.438 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-03-27T11:36:15.043 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:15.054 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:15.055 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:15.057 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:15.058 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:15.554 INFO:teuthology.orchestra.run.smithi172.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:15.563 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/379 2023-03-27T11:36:15.563 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/379 2023-03-27T11:36:15.563 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:15.568 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:15.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:15.601 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-03-27T11:36:16.013 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:16.024 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:16.025 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:16.028 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:16.028 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:16.494 INFO:teuthology.orchestra.run.smithi172.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:16.503 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/380 2023-03-27T11:36:16.504 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/380 2023-03-27T11:36:16.504 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:16.509 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:16.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:16.550 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-03-27T11:36:16.961 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:16.972 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:16.973 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:16.975 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:16.976 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:17.439 INFO:teuthology.orchestra.run.smithi172.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:17.448 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/381 2023-03-27T11:36:17.448 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/381 2023-03-27T11:36:17.448 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:17.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:17.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:17.486 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-03-27T11:36:17.897 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:17.908 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:17.909 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:17.912 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:17.912 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:18.383 INFO:teuthology.orchestra.run.smithi172.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:18.392 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/382 2023-03-27T11:36:18.392 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/382 2023-03-27T11:36:18.392 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:18.397 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:18.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:18.436 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-03-27T11:36:18.841 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:18.852 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:18.853 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:18.855 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:18.855 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:19.327 INFO:teuthology.orchestra.run.smithi172.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:19.336 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/383 2023-03-27T11:36:19.336 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/383 2023-03-27T11:36:19.337 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:19.342 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:19.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:19.377 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-03-27T11:36:19.785 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:19.796 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:19.797 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:19.799 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:19.800 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:20.263 INFO:teuthology.orchestra.run.smithi172.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:20.272 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/384 2023-03-27T11:36:20.272 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/384 2023-03-27T11:36:20.273 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:20.278 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:20.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:20.314 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-03-27T11:36:20.720 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:20.731 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:20.732 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:20.735 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:20.735 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:21.200 INFO:teuthology.orchestra.run.smithi172.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:21.209 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/385 2023-03-27T11:36:21.209 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/385 2023-03-27T11:36:21.209 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:21.214 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:21.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:21.248 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-03-27T11:36:21.657 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:21.668 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:21.669 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:21.671 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:21.671 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:22.133 INFO:teuthology.orchestra.run.smithi172.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:22.142 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/386 2023-03-27T11:36:22.142 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/386 2023-03-27T11:36:22.142 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:22.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:22.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:22.189 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-03-27T11:36:22.597 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:22.609 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:22.610 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:22.612 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:22.612 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:23.412 INFO:teuthology.orchestra.run.smithi172.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:36:23.440 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/387 2023-03-27T11:36:23.441 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/387 2023-03-27T11:36:23.441 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:23.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:23.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:23.650 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-03-27T11:36:24.066 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:24.077 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:24.078 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:24.080 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:24.080 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:24.613 INFO:teuthology.orchestra.run.smithi172.stdout:generic/388 [not run] require 172.21.15.172:6789:/scratch to be local device 2023-03-27T11:36:24.621 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/388 2023-03-27T11:36:24.622 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/388 2023-03-27T11:36:24.622 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:24.627 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:24.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:24.662 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-03-27T11:36:25.081 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:25.092 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:25.094 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:25.095 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:25.095 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:25.579 INFO:teuthology.orchestra.run.smithi172.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-03-27T11:36:25.588 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/389 2023-03-27T11:36:25.588 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/389 2023-03-27T11:36:25.588 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:25.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:25.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:25.633 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-03-27T11:36:26.041 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:26.052 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:26.053 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:26.056 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:26.056 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:26.564 INFO:teuthology.orchestra.run.smithi172.stdout:generic/390 [not run] ceph does not support freezing 2023-03-27T11:36:26.573 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/390 2023-03-27T11:36:26.573 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/390 2023-03-27T11:36:26.574 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:26.579 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:26.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:26.615 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-03-27T11:36:27.032 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:27.043 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:27.044 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:27.046 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:27.047 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:27.532 INFO:teuthology.orchestra.run.smithi172.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:36:27.541 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/391 2023-03-27T11:36:27.541 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/391 2023-03-27T11:36:27.541 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:27.546 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:27.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:27.585 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-03-27T11:36:27.993 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:28.004 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:28.005 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:28.008 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:28.008 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:28.610 INFO:teuthology.orchestra.run.smithi172.stdout:generic/392 [not run] ceph does not support shutdown 2023-03-27T11:36:28.638 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/392 2023-03-27T11:36:28.638 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/392 2023-03-27T11:36:28.639 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:28.644 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:28.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:28.682 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-03-27T11:36:29.088 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:29.099 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:29.100 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:29.102 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:29.102 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:30.338 INFO:teuthology.orchestra.run.smithi172.stdout:generic/393 1s 2023-03-27T11:36:30.349 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/393 2023-03-27T11:36:30.350 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:30.355 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:30.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:30.374 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-03-27T11:36:30.779 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:30.790 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:30.791 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:30.793 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:30.794 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:31.313 INFO:teuthology.orchestra.run.smithi172.stdout:generic/394 1s 2023-03-27T11:36:31.325 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/394 2023-03-27T11:36:31.325 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:31.330 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:31.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:31.469 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-03-27T11:36:32.152 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:32.169 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:32.170 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:32.172 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:32.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:34.058 INFO:teuthology.orchestra.run.smithi172.stdout:generic/395 2s 2023-03-27T11:36:34.124 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/395 2023-03-27T11:36:34.124 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:34.138 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:34.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:34.207 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-03-27T11:36:34.679 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:34.690 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:34.691 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:34.694 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:34.694 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:35.783 INFO:teuthology.orchestra.run.smithi172.stdout:generic/396 1s 2023-03-27T11:36:35.795 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/396 2023-03-27T11:36:35.795 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:35.801 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:35.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:35.819 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-03-27T11:36:36.235 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:36.246 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:36.247 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:36.249 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:36.250 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:38.152 INFO:teuthology.orchestra.run.smithi172.stdout:generic/397 2s 2023-03-27T11:36:38.164 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/397 2023-03-27T11:36:38.164 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:38.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:38.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:38.188 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-03-27T11:36:38.595 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:38.607 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:38.608 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:38.610 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:38.610 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:38.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:36:38.827 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:36:39.438 INFO:teuthology.orchestra.run.smithi172.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-03-27T11:36:39.447 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/398 2023-03-27T11:36:39.447 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/398 2023-03-27T11:36:39.447 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:39.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:39.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:39.576 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-03-27T11:36:40.209 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:40.220 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:40.221 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:40.224 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:40.224 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:41.005 INFO:teuthology.orchestra.run.smithi172.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-03-27T11:36:41.014 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/399 2023-03-27T11:36:41.014 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/399 2023-03-27T11:36:41.015 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:41.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:41.061 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-03-27T11:36:41.469 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:41.480 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:41.481 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:41.483 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:41.484 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:41.940 INFO:teuthology.orchestra.run.smithi172.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T11:36:41.949 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/400 2023-03-27T11:36:41.949 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/400 2023-03-27T11:36:41.949 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:41.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:41.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:41.992 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-03-27T11:36:42.403 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:42.414 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:42.415 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:42.417 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:42.418 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:43.271 INFO:teuthology.orchestra.run.smithi172.stdout:generic/401 1s 2023-03-27T11:36:43.314 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/401 2023-03-27T11:36:43.314 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:43.356 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:43.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:43.399 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-03-27T11:36:43.889 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:43.901 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:43.902 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:43.904 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:43.904 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:44.560 INFO:teuthology.orchestra.run.smithi172.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-03-27T11:36:44.582 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/402 2023-03-27T11:36:44.582 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/402 2023-03-27T11:36:44.582 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:44.587 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:44.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:44.625 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-03-27T11:36:45.038 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:45.049 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:45.050 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:45.053 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:45.053 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:46.301 INFO:teuthology.orchestra.run.smithi172.stdout:generic/403 1s 2023-03-27T11:36:46.312 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/403 2023-03-27T11:36:46.312 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:46.317 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:46.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:46.337 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-03-27T11:36:46.747 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:46.758 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:46.760 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:46.762 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:46.762 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:47.269 INFO:teuthology.orchestra.run.smithi172.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:36:47.278 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/404 2023-03-27T11:36:47.278 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/404 2023-03-27T11:36:47.279 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:47.284 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:47.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:47.324 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-03-27T11:36:47.739 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:47.750 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:47.751 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:47.753 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:47.754 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:48.290 INFO:teuthology.orchestra.run.smithi172.stdout:generic/405 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:36:48.299 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/405 2023-03-27T11:36:48.299 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/405 2023-03-27T11:36:48.299 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:48.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:48.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:48.342 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-03-27T11:36:48.747 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:48.758 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:48.759 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:48.761 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:48.761 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:51.147 INFO:teuthology.orchestra.run.smithi172.stdout:generic/406 3s 2023-03-27T11:36:51.276 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/406 2023-03-27T11:36:51.277 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:51.282 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:51.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:51.302 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-03-27T11:36:51.708 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:51.719 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:51.720 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:51.722 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:51.723 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:52.290 INFO:teuthology.orchestra.run.smithi172.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:36:52.299 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/407 2023-03-27T11:36:52.300 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/407 2023-03-27T11:36:52.300 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:52.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:52.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:52.494 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-03-27T11:36:53.065 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:53.076 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:53.077 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:53.080 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:53.080 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:53.635 INFO:teuthology.orchestra.run.smithi172.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T11:36:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/408 2023-03-27T11:36:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/408 2023-03-27T11:36:53.645 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:53.650 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:53.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:53.759 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-03-27T11:36:54.392 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:54.403 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:54.404 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:54.406 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:54.407 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:54.899 INFO:teuthology.orchestra.run.smithi172.stdout:generic/409 [not run] require 172.21.15.172:6789:/scratch to be local device 2023-03-27T11:36:54.908 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/409 2023-03-27T11:36:54.909 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/409 2023-03-27T11:36:54.909 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:54.914 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:54.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:54.947 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-03-27T11:36:55.364 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:55.375 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:55.376 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:55.378 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:55.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:55.875 INFO:teuthology.orchestra.run.smithi172.stdout:generic/410 [not run] require 172.21.15.172:6789:/scratch to be local device 2023-03-27T11:36:55.884 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/410 2023-03-27T11:36:55.884 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/410 2023-03-27T11:36:55.884 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:55.890 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:55.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:55.929 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-03-27T11:36:56.339 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:56.350 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:56.351 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:56.354 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:56.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:56.843 INFO:teuthology.orchestra.run.smithi172.stdout:generic/411 [not run] require 172.21.15.172:6789:/scratch to be local device 2023-03-27T11:36:56.852 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/411 2023-03-27T11:36:56.852 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/411 2023-03-27T11:36:56.852 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:56.857 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:56.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:56.892 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-03-27T11:36:57.313 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:57.324 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:57.325 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:57.328 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:57.328 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:generic/412 1s 2023-03-27T11:36:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/412 2023-03-27T11:36:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:58.226 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:58.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:58.246 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-03-27T11:36:58.654 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:58.665 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:58.666 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:58.668 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:58.668 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:59.282 INFO:teuthology.orchestra.run.smithi172.stdout:generic/413 [not run] mount 172.21.15.172:6789:/scratch with dax failed 2023-03-27T11:36:59.291 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/413 2023-03-27T11:36:59.291 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/413 2023-03-27T11:36:59.291 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:36:59.296 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:36:59.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:36:59.333 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-03-27T11:36:59.749 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:36:59.760 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:36:59.762 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:36:59.764 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:36:59.764 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:00.567 INFO:teuthology.orchestra.run.smithi172.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:37:00.642 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/414 2023-03-27T11:37:00.643 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/414 2023-03-27T11:37:00.643 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:00.649 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:00.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:00.797 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-03-27T11:37:01.212 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:01.223 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:01.224 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:01.226 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:01.226 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:02.041 INFO:teuthology.orchestra.run.smithi172.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:37:02.090 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/415 2023-03-27T11:37:02.091 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/415 2023-03-27T11:37:02.091 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:02.110 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:02.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:02.334 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-03-27T11:37:02.746 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:02.757 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:02.758 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:02.760 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:02.760 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:03.229 INFO:teuthology.orchestra.run.smithi172.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:37:03.238 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/416 2023-03-27T11:37:03.238 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/416 2023-03-27T11:37:03.239 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:03.244 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:03.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:03.288 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-03-27T11:37:03.693 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:03.705 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:03.706 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:03.708 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:03.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:04.328 INFO:teuthology.orchestra.run.smithi172.stdout:generic/417 [not run] ceph does not support shutdown 2023-03-27T11:37:04.353 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/417 2023-03-27T11:37:04.353 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/417 2023-03-27T11:37:04.353 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:04.358 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:04.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:04.395 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-03-27T11:37:04.806 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:04.817 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:04.818 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:04.821 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:04.821 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:05.335 INFO:teuthology.orchestra.run.smithi172.stdout:generic/418 [not run] require 172.21.15.172:6789:/test to be valid block disk 2023-03-27T11:37:05.344 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/418 2023-03-27T11:37:05.344 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/418 2023-03-27T11:37:05.345 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:05.350 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:05.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:05.393 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-03-27T11:37:05.802 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:05.813 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:05.814 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:05.816 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:05.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:06.603 INFO:teuthology.orchestra.run.smithi172.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-03-27T11:37:06.612 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/419 2023-03-27T11:37:06.612 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/419 2023-03-27T11:37:06.612 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:06.617 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:06.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:06.767 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-03-27T11:37:07.350 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:07.361 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:07.362 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:07.365 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:07.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:generic/420 1s 2023-03-27T11:37:08.044 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/420 2023-03-27T11:37:08.044 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:08.050 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:08.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:08.233 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-03-27T11:37:08.802 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:08.813 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:08.814 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:08.817 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:08.817 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:08.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:37:09.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:37:16.041 INFO:teuthology.orchestra.run.smithi172.stdout:generic/421 7s 2023-03-27T11:37:16.056 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/421 2023-03-27T11:37:16.057 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:16.068 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:16.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:16.113 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-03-27T11:37:16.636 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:16.647 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:16.648 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:16.650 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:16.651 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:17.149 INFO:teuthology.orchestra.run.smithi172.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T11:37:17.158 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/422 2023-03-27T11:37:17.158 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/422 2023-03-27T11:37:17.159 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:17.164 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:17.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:17.204 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-03-27T11:37:17.616 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:17.627 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:17.628 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:17.630 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:17.630 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:18.231 INFO:teuthology.orchestra.run.smithi172.stdout:generic/423 1s 2023-03-27T11:37:18.242 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/423 2023-03-27T11:37:18.242 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:18.248 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:18.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:18.402 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-03-27T11:37:19.002 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:19.013 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:19.014 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:19.016 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:19.016 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:19.504 INFO:teuthology.orchestra.run.smithi172.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-03-27T11:37:19.513 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/424 2023-03-27T11:37:19.513 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/424 2023-03-27T11:37:19.513 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:19.518 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:19.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:19.560 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-03-27T11:37:19.976 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:19.987 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:19.988 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:19.991 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:19.991 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:20.518 INFO:teuthology.orchestra.run.smithi172.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-03-27T11:37:20.527 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/425 2023-03-27T11:37:20.527 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/425 2023-03-27T11:37:20.527 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:37:20.532 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:20.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:37:20.665 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-03-27T11:37:21.278 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:37:21.289 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:37:21.290 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:37:21.292 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:37:21.293 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:37:39.104 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:37:39.109 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:38:03.840 INFO:teuthology.orchestra.run.smithi172.stdout:generic/426 42s 2023-03-27T11:38:03.938 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/426 2023-03-27T11:38:03.938 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:03.944 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:04.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:04.180 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-03-27T11:38:05.499 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:05.510 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:05.511 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:05.513 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:05.514 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:06.173 INFO:teuthology.orchestra.run.smithi172.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:38:06.182 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/427 2023-03-27T11:38:06.182 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/427 2023-03-27T11:38:06.182 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:06.187 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:06.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:06.233 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-03-27T11:38:06.648 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:06.659 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:06.660 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:06.662 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:06.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:07.207 INFO:teuthology.orchestra.run.smithi172.stdout:generic/428 1s 2023-03-27T11:38:07.218 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/428 2023-03-27T11:38:07.218 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:07.224 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:07.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:07.272 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-03-27T11:38:07.687 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:07.698 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:07.699 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:07.701 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:07.702 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:10.106 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:38:10.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:38:19.687 INFO:teuthology.orchestra.run.smithi172.stdout:generic/429 12s 2023-03-27T11:38:19.698 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/429 2023-03-27T11:38:19.699 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:19.704 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:19.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:19.723 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-03-27T11:38:20.223 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:20.234 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:20.235 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:20.238 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:20.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:20.910 INFO:teuthology.orchestra.run.smithi172.stdout:generic/430 0s 2023-03-27T11:38:20.921 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/430 2023-03-27T11:38:20.922 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:20.927 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:21.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:21.126 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-03-27T11:38:21.672 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:21.683 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:21.684 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:21.686 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:21.686 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:22.313 INFO:teuthology.orchestra.run.smithi172.stdout:generic/431 1s 2023-03-27T11:38:22.325 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/431 2023-03-27T11:38:22.325 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:22.330 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:22.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:22.490 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-03-27T11:38:23.097 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:23.108 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:23.109 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:23.111 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:23.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:23.763 INFO:teuthology.orchestra.run.smithi172.stdout:generic/432 0s 2023-03-27T11:38:23.774 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/432 2023-03-27T11:38:23.774 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:23.779 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:23.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:23.921 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-03-27T11:38:24.527 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:24.538 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:24.539 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:24.542 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:24.542 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:25.161 INFO:teuthology.orchestra.run.smithi172.stdout:generic/433 1s 2023-03-27T11:38:25.173 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/433 2023-03-27T11:38:25.173 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:25.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:25.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:25.359 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-03-27T11:38:25.940 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:25.951 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:25.952 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:25.955 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:25.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:26.570 INFO:teuthology.orchestra.run.smithi172.stdout:generic/434 0s 2023-03-27T11:38:26.581 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/434 2023-03-27T11:38:26.582 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:38:26.587 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:26.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:38:26.765 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-03-27T11:38:27.359 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:38:27.370 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:38:27.371 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:38:27.373 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:38:27.373 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:38:40.389 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:38:40.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:39:10.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:39:10.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:39:40.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:39:40.606 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:39:40.730 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T11:39:40.733+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 432410) UID: 0 2023-03-27T11:39:40.731 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T11:39:40.733+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 432410) UID: 0 2023-03-27T11:42:45.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:42:45.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:43:17.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:43:17.304 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:43:47.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:43:47.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:44:17.877 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:44:17.895 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:44:48.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:44:48.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:45:19.510 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:45:19.538 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:45:19.873 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T11:45:19.876+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 432805) UID: 0 2023-03-27T11:45:19.876 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T11:45:19.876+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 432805) UID: 0 2023-03-27T11:48:32.700 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:48:32.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:49:02.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:49:02.882 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:49:33.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:49:33.088 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:49:33.257 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T11:49:33.260+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 432915) UID: 0 2023-03-27T11:49:33.563 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T11:49:33.261+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 432915) UID: 0 2023-03-27T11:50:19.489 INFO:teuthology.orchestra.run.smithi172.stdout:generic/435 712s 2023-03-27T11:50:19.524 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/435 2023-03-27T11:50:19.524 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:50:19.547 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:50:19.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:50:19.588 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-03-27T11:50:20.165 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:50:20.175 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:50:20.176 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:50:20.178 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:50:20.179 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:50:21.074 INFO:teuthology.orchestra.run.smithi172.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:50:21.084 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/436 2023-03-27T11:50:21.084 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/436 2023-03-27T11:50:21.085 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:50:21.090 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:50:21.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:50:21.246 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-03-27T11:50:21.905 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:50:21.916 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:50:21.917 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:50:21.919 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:50:21.920 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:50:23.122 INFO:teuthology.orchestra.run.smithi172.stdout:generic/437 1s 2023-03-27T11:50:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/437 2023-03-27T11:50:23.134 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:50:23.139 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:50:23.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:50:23.182 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-03-27T11:50:23.621 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:50:23.632 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:50:23.633 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:50:23.635 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:50:23.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:44.621 INFO:teuthology.orchestra.run.smithi172.stdout:generic/438 81s 2023-03-27T11:51:44.632 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/438 2023-03-27T11:51:44.632 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:44.637 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:44.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:44.678 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-03-27T11:51:45.096 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:45.108 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:45.109 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:45.111 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:45.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:46.557 INFO:teuthology.orchestra.run.smithi172.stdout:generic/439 1s 2023-03-27T11:51:46.569 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/439 2023-03-27T11:51:46.569 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:46.574 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:46.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:46.620 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-03-27T11:51:47.042 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:47.053 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:47.054 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:47.056 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:47.056 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:50.215 INFO:teuthology.orchestra.run.smithi172.stdout:generic/440 3s 2023-03-27T11:51:50.226 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/440 2023-03-27T11:51:50.226 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:50.232 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:50.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:50.251 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-03-27T11:51:50.664 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:50.675 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:50.676 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:50.678 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:50.678 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:50.977 INFO:teuthology.orchestra.run.smithi172.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-03-27T11:51:50.977 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: stdin: file size changed while zipping 2023-03-27T11:51:51.310 INFO:teuthology.orchestra.run.smithi172.stdout:generic/441 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:51:51.320 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/441 2023-03-27T11:51:51.321 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/441 2023-03-27T11:51:51.321 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:51.327 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:51.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:51.373 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-03-27T11:51:51.792 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:51.803 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:51.804 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:51.806 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:51.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:52.327 INFO:teuthology.orchestra.run.smithi172.stdout:generic/442 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:51:52.336 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/442 2023-03-27T11:51:52.337 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/442 2023-03-27T11:51:52.337 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:52.342 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:52.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:52.385 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-03-27T11:51:52.807 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:52.818 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:52.819 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:52.821 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:52.821 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:53.354 INFO:teuthology.orchestra.run.smithi172.stdout:generic/443 0s 2023-03-27T11:51:53.366 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/443 2023-03-27T11:51:53.366 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:53.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:53.428 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-03-27T11:51:53.867 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:53.878 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:53.879 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:53.882 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:53.882 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:54.497 INFO:teuthology.orchestra.run.smithi172.stdout:generic/444 0s 2023-03-27T11:51:54.510 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/444 2023-03-27T11:51:54.511 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:54.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:54.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:54.586 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-03-27T11:51:54.994 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:55.005 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:55.006 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:55.008 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:55.008 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:55.880 INFO:teuthology.orchestra.run.smithi172.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:51:55.889 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/445 2023-03-27T11:51:55.889 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/445 2023-03-27T11:51:55.890 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:51:55.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:51:56.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:51:56.018 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-03-27T11:51:56.644 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:51:56.655 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:51:56.656 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:51:56.658 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:51:56.658 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:17.653 INFO:teuthology.orchestra.run.smithi172.stdout:generic/446 21s 2023-03-27T11:52:17.701 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/446 2023-03-27T11:52:17.701 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:17.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:17.743 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-03-27T11:52:18.295 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:18.306 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:18.307 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:18.309 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:18.309 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:19.197 INFO:teuthology.orchestra.run.smithi172.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:52:19.247 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/447 2023-03-27T11:52:19.247 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/447 2023-03-27T11:52:19.247 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:19.299 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:19.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:19.394 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-03-27T11:52:19.819 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:19.830 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:19.831 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:19.834 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:19.834 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:21.199 INFO:teuthology.orchestra.run.smithi172.stdout:generic/448 1s 2023-03-27T11:52:21.211 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/448 2023-03-27T11:52:21.211 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:21.216 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:21.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:21.354 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-03-27T11:52:21.988 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:21.999 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:22.000 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:22.002 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:22.002 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:22.532 INFO:teuthology.orchestra.run.smithi172.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T11:52:22.541 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/449 2023-03-27T11:52:22.541 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/449 2023-03-27T11:52:22.541 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:22.546 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:22.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:22.695 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-03-27T11:52:23.331 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:23.342 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:23.343 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:23.346 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:23.346 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:24.362 INFO:teuthology.orchestra.run.smithi172.stdout:generic/450 1s 2023-03-27T11:52:24.374 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/450 2023-03-27T11:52:24.374 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:24.379 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:24.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:24.520 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-03-27T11:52:24.792 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:52:24.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:52:25.151 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:25.163 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:25.164 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:25.166 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:25.166 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:54.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:52:54.912 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:52:55.817 INFO:teuthology.orchestra.run.smithi172.stdout:generic/451 30s 2023-03-27T11:52:55.829 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/451 2023-03-27T11:52:55.829 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:55.834 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:55.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:55.976 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-03-27T11:52:56.607 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:56.618 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:56.619 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:56.621 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:56.622 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:57.428 INFO:teuthology.orchestra.run.smithi172.stdout:generic/452 1s 2023-03-27T11:52:57.439 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/452 2023-03-27T11:52:57.440 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:57.445 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:57.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:57.464 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-03-27T11:52:57.879 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:57.891 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:57.892 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:57.894 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:57.894 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:58.383 INFO:teuthology.orchestra.run.smithi172.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-03-27T11:52:58.392 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/453 2023-03-27T11:52:58.392 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/453 2023-03-27T11:52:58.392 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:58.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:58.445 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-03-27T11:52:58.858 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:58.869 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:58.870 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:58.873 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:58.873 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:59.385 INFO:teuthology.orchestra.run.smithi172.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-03-27T11:52:59.394 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/454 2023-03-27T11:52:59.394 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/454 2023-03-27T11:52:59.394 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:52:59.399 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:52:59.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:52:59.440 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-03-27T11:52:59.851 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:52:59.863 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:52:59.864 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:52:59.866 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:52:59.866 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:00.465 INFO:teuthology.orchestra.run.smithi172.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-03-27T11:53:00.474 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/455 2023-03-27T11:53:00.474 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/455 2023-03-27T11:53:00.474 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:00.479 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:00.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:00.520 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-03-27T11:53:00.937 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:00.948 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:00.949 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:00.952 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:00.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:01.468 INFO:teuthology.orchestra.run.smithi172.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T11:53:01.477 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/456 2023-03-27T11:53:01.477 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/456 2023-03-27T11:53:01.477 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:01.482 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:01.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:01.526 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-03-27T11:53:01.934 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:01.945 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:01.946 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:01.948 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:01.948 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:03.056 INFO:teuthology.orchestra.run.smithi172.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:53:03.068 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/457 2023-03-27T11:53:03.068 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/457 2023-03-27T11:53:03.069 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:03.074 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:03.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:03.127 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-03-27T11:53:03.537 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:03.548 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:03.549 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:03.551 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:04.426 INFO:teuthology.orchestra.run.smithi172.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T11:53:04.476 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/458 2023-03-27T11:53:04.476 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/458 2023-03-27T11:53:04.477 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:04.492 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:04.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:04.654 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-03-27T11:53:05.062 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:05.073 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:05.074 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:05.076 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:05.077 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:05.789 INFO:teuthology.orchestra.run.smithi172.stdout:generic/459 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:53:05.798 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/459 2023-03-27T11:53:05.799 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/459 2023-03-27T11:53:05.799 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:05.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:05.845 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-03-27T11:53:06.259 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:06.270 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:06.271 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:06.273 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:06.274 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:09.482 INFO:teuthology.orchestra.run.smithi172.stdout:generic/460 3s 2023-03-27T11:53:09.494 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/460 2023-03-27T11:53:09.494 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:09.499 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:09.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:09.519 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-03-27T11:53:09.935 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:09.947 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:09.947 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:09.950 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:09.950 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:10.743 INFO:teuthology.orchestra.run.smithi172.stdout:generic/461 [not run] ceph does not support shutdown 2023-03-27T11:53:10.753 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/461 2023-03-27T11:53:10.753 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/461 2023-03-27T11:53:10.754 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:10.758 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:10.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:10.796 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-03-27T11:53:11.220 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:11.232 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:11.233 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:11.235 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:11.235 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:11.860 INFO:teuthology.orchestra.run.smithi172.stdout:generic/462 [not run] mount 172.21.15.172:6789:/scratch with dax failed 2023-03-27T11:53:11.869 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/462 2023-03-27T11:53:11.869 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/462 2023-03-27T11:53:11.869 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:11.874 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:11.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:11.914 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-03-27T11:53:12.327 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:12.338 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:12.339 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:12.341 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:12.341 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:12.906 INFO:teuthology.orchestra.run.smithi172.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T11:53:12.915 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/463 2023-03-27T11:53:12.915 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/463 2023-03-27T11:53:12.916 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:53:12.921 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:13.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:53:13.074 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-03-27T11:53:13.720 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:53:13.731 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:53:13.732 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:53:13.734 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:53:13.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:53:25.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:53:25.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:53:55.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:53:55.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:54:13.929 INFO:teuthology.orchestra.run.smithi172.stdout:generic/464 60s 2023-03-27T11:54:13.940 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/464 2023-03-27T11:54:13.940 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:13.946 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:13.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:13.965 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-03-27T11:54:14.381 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:14.392 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:14.392 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:14.395 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:14.395 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:19.531 INFO:teuthology.orchestra.run.smithi172.stdout:generic/465 4s 2023-03-27T11:54:19.572 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/465 2023-03-27T11:54:19.572 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:19.596 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:19.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:19.632 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-03-27T11:54:20.112 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:20.123 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:20.124 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:20.126 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:20.127 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:20.588 INFO:teuthology.orchestra.run.smithi172.stdout:generic/466 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:54:20.597 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/466 2023-03-27T11:54:20.597 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/466 2023-03-27T11:54:20.597 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:20.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:20.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:20.637 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-03-27T11:54:21.129 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:21.140 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:21.143 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:21.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:25.603 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:54:25.607 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:54:31.891 INFO:teuthology.orchestra.run.smithi172.stdout:generic/467 10s 2023-03-27T11:54:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/467 2023-03-27T11:54:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:32.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:32.218 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-03-27T11:54:33.551 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:33.562 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:33.563 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:33.565 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:33.565 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:34.250 INFO:teuthology.orchestra.run.smithi172.stdout:generic/468 [not run] ceph does not support shutdown 2023-03-27T11:54:34.275 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/468 2023-03-27T11:54:34.275 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/468 2023-03-27T11:54:34.275 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:34.280 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:34.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:34.324 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-03-27T11:54:34.756 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:34.767 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:34.768 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:34.770 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:34.770 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:35.268 INFO:teuthology.orchestra.run.smithi172.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T11:54:35.277 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/469 2023-03-27T11:54:35.278 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/469 2023-03-27T11:54:35.278 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:35.283 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:35.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:35.320 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-03-27T11:54:35.736 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:35.747 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:35.749 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:35.751 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:35.751 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:36.267 INFO:teuthology.orchestra.run.smithi172.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-03-27T11:54:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/470 2023-03-27T11:54:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/470 2023-03-27T11:54:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:36.281 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:36.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:36.314 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-03-27T11:54:36.726 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:36.737 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:36.738 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:36.740 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:36.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:37.280 INFO:teuthology.orchestra.run.smithi172.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-03-27T11:54:37.289 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/471 2023-03-27T11:54:37.290 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/471 2023-03-27T11:54:37.290 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:37.295 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:37.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:37.433 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-03-27T11:54:38.024 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:38.035 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:38.036 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:38.038 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:38.039 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:38.781 INFO:teuthology.orchestra.run.smithi172.stdout:generic/472 [not run] swapfiles are not supported 2023-03-27T11:54:38.790 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/472 2023-03-27T11:54:38.790 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/472 2023-03-27T11:54:38.790 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:38.795 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:38.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:38.834 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-03-27T11:54:39.244 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:39.255 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:39.256 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:39.259 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:39.259 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:39.796 INFO:teuthology.orchestra.run.smithi172.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T11:54:39.804 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/473 2023-03-27T11:54:39.805 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/473 2023-03-27T11:54:39.805 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:39.810 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:39.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:39.848 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-03-27T11:54:40.253 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:40.264 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:40.265 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:40.268 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:40.268 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:40.883 INFO:teuthology.orchestra.run.smithi172.stdout:generic/474 [not run] ceph does not support shutdown 2023-03-27T11:54:40.910 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/474 2023-03-27T11:54:40.911 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/474 2023-03-27T11:54:40.911 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:40.916 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:40.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:40.956 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-03-27T11:54:41.363 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:41.374 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:41.375 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:41.378 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:41.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:41.907 INFO:teuthology.orchestra.run.smithi172.stdout:generic/475 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T11:54:41.916 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/475 2023-03-27T11:54:41.917 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/475 2023-03-27T11:54:41.917 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T11:54:41.922 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:41.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T11:54:41.964 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-03-27T11:54:42.372 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T11:54:42.383 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T11:54:42.384 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T11:54:42.386 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T11:54:42.386 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T11:54:55.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:54:55.980 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:55:26.597 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:55:26.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:55:57.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:55:57.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:55:57.509 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T11:55:57.509+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551461) UID: 0 2023-03-27T11:55:57.512 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T11:55:57.507+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551461) UID: 0 2023-03-27T11:55:57.514 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T11:55:57.518+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551461) UID: 0 2023-03-27T11:55:57.521 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T11:55:57.504+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551461) UID: 0 2023-03-27T11:59:34.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T11:59:34.783 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:00:05.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:00:05.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:00:07.198 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T12:00:07.191+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124648) UID: 0 2023-03-27T12:00:07.199 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T12:00:07.186+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124648) UID: 0 2023-03-27T12:00:07.205 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T12:00:07.189+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124648) UID: 0 2023-03-27T12:00:07.205 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T12:00:07.189+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124648) UID: 0 2023-03-27T12:03:40.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:03:40.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:03:41.344 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T12:03:41.346+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551872) UID: 0 2023-03-27T12:03:41.348 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T12:03:41.348+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551872) UID: 0 2023-03-27T12:03:41.361 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T12:03:41.343+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551872) UID: 0 2023-03-27T12:03:41.372 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T12:03:41.347+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551872) UID: 0 2023-03-27T12:07:23.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:07:23.429 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:07:23.552 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T12:07:23.555+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124853) UID: 0 2023-03-27T12:07:23.553 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T12:07:23.555+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124853) UID: 0 2023-03-27T12:07:23.553 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T12:07:23.555+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124853) UID: 0 2023-03-27T12:07:23.554 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T12:07:23.555+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124853) UID: 0 2023-03-27T12:10:17.331 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:10:17.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:10:17.668 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T12:10:17.669+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552043) UID: 0 2023-03-27T12:10:17.669 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T12:10:17.669+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552043) UID: 0 2023-03-27T12:14:50.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:14:50.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:15:23.008 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:15:23.031 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:15:53.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:15:53.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:16:23.786 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:16:23.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:16:54.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:16:54.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:17:24.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:17:24.518 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:17:54.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:17:54.727 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:17:54.847 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T12:17:54.849+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125184) UID: 0 2023-03-27T12:17:54.848 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T12:17:54.850+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125184) UID: 0 2023-03-27T12:17:54.848 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T12:17:54.850+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125184) UID: 0 2023-03-27T12:17:54.849 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T12:17:54.850+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125184) UID: 0 2023-03-27T12:23:47.566 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:23:47.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:24:18.246 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:24:18.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:24:18.461 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T12:24:18.462+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552456) UID: 0 2023-03-27T12:24:18.467 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T12:24:18.462+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552456) UID: 0 2023-03-27T12:27:54.754 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T12:27:54.749+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552501) UID: 0 2023-03-27T12:27:54.757 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T12:27:54.758+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552501) UID: 0 2023-03-27T12:27:54.762 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T12:27:54.756+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552501) UID: 0 2023-03-27T12:27:54.771 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T12:27:54.755+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552501) UID: 0 2023-03-27T12:31:46.628 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:31:46.634 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:32:17.067 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:32:17.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:32:47.217 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:32:47.245 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:33:17.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:33:17.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:33:47.720 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:33:47.735 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:34:18.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:34:18.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:34:48.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:34:48.494 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:35:19.531 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:35:19.540 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:35:50.130 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:35:50.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:35:50.837 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T12:35:50.840+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552827) UID: 0 2023-03-27T12:35:50.838 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T12:35:50.840+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552827) UID: 0 2023-03-27T12:35:50.839 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T12:35:50.840+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552827) UID: 0 2023-03-27T12:35:50.839 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T12:35:50.840+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 552827) UID: 0 2023-03-27T12:39:36.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:39:36.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:39:36.722 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T12:39:36.719+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552898) UID: 0 2023-03-27T12:39:36.723 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T12:39:36.719+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 552898) UID: 0 2023-03-27T12:44:30.741 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:44:30.749 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:45:01.286 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:45:01.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:45:31.733 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:45:31.739 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:46:01.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:46:01.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:46:31.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:46:32.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:47:02.147 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:47:02.151 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:47:32.261 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:47:32.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:48:02.576 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:48:02.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:48:32.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:48:32.905 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:49:03.469 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:49:03.483 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:49:33.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:49:33.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:50:04.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:50:04.114 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:50:34.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:50:34.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:51:04.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:51:04.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:51:05.132 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T12:51:05.133+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 553384) UID: 0 2023-03-27T12:51:05.143 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T12:51:05.144+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 553384) UID: 0 2023-03-27T12:54:40.384 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T12:54:40.383+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553430) UID: 0 2023-03-27T12:54:40.395 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T12:54:40.382+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553430) UID: 0 2023-03-27T12:54:40.399 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T12:54:40.383+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553430) UID: 0 2023-03-27T12:54:40.399 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T12:54:40.383+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 553430) UID: 0 2023-03-27T12:58:31.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:58:31.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T12:58:32.336 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T12:58:32.337+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-03-27T12:58:32.337 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T12:58:32.337+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-03-27T12:58:32.337 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T12:58:32.338+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-03-27T12:58:32.337 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T12:58:32.338+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-03-27T13:01:48.945 INFO:teuthology.orchestra.run.smithi172.stdout:generic/476 4024s 2023-03-27T13:01:49.298 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/476 2023-03-27T13:01:49.299 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:01:49.320 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:01:49.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:01:49.395 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-03-27T13:01:51.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:01:51.996 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:01:52.240 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T13:01:52.242+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126409) UID: 0 2023-03-27T13:01:52.241 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T13:01:52.242+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126409) UID: 0 2023-03-27T13:01:52.241 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T13:01:52.242+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126409) UID: 0 2023-03-27T13:01:52.241 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T13:01:52.242+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126409) UID: 0 2023-03-27T13:01:59.671 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:01:59.698 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:01:59.700 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:01:59.703 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:01:59.703 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:04:56.398 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:04:56.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:04:56.549 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T13:04:56.550+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 553922) UID: 0 2023-03-27T13:04:56.550 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T13:04:56.550+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 553922) UID: 0 2023-03-27T13:10:34.130 INFO:teuthology.orchestra.run.smithi172.stdout:generic/477 49s 2023-03-27T13:10:34.314 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/477 2023-03-27T13:10:34.314 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:10:34.351 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:10:34.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:10:34.621 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-03-27T13:10:37.736 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:10:37.752 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:10:37.753 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:10:37.760 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:10:37.760 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:10:37.973 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T13:10:37.970+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 554558) UID: 0 2023-03-27T13:10:37.974 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T13:10:37.970+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 554558) UID: 0 2023-03-27T13:10:37.974 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T13:10:37.971+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 554558) UID: 0 2023-03-27T13:10:37.974 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T13:10:37.970+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 554558) UID: 0 2023-03-27T13:10:56.696 INFO:teuthology.orchestra.run.smithi172.stdout:generic/478 18s 2023-03-27T13:10:56.716 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/478 2023-03-27T13:10:56.716 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:10:56.726 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:10:56.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:10:56.786 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-03-27T13:10:57.461 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:10:57.481 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:10:57.482 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:10:57.486 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:10:57.486 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:10:59.034 INFO:teuthology.orchestra.run.smithi172.stdout:generic/479 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:10:59.050 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/479 2023-03-27T13:10:59.050 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/479 2023-03-27T13:10:59.050 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:10:59.062 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:10:59.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:10:59.138 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-03-27T13:10:59.814 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:10:59.833 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:10:59.834 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:10:59.837 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:10:59.837 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:01.663 INFO:teuthology.orchestra.run.smithi172.stdout:generic/480 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:01.678 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/480 2023-03-27T13:11:01.678 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/480 2023-03-27T13:11:01.679 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:01.687 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:01.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:01.762 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-03-27T13:11:02.395 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:02.410 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:02.412 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:02.415 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:03.260 INFO:teuthology.orchestra.run.smithi172.stdout:generic/481 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:03.277 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/481 2023-03-27T13:11:03.277 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/481 2023-03-27T13:11:03.277 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:03.284 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:03.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:03.352 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-03-27T13:11:04.094 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:04.114 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:04.115 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:04.121 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:04.121 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:05.083 INFO:teuthology.orchestra.run.smithi172.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-03-27T13:11:05.099 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/482 2023-03-27T13:11:05.099 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/482 2023-03-27T13:11:05.099 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:05.110 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:05.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:05.166 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-03-27T13:11:05.812 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:05.839 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:05.840 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:05.842 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:05.842 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:06.688 INFO:teuthology.orchestra.run.smithi172.stdout:generic/483 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:06.705 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/483 2023-03-27T13:11:06.705 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/483 2023-03-27T13:11:06.705 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:06.714 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:06.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:06.768 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-03-27T13:11:07.413 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:07.428 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:07.430 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:07.433 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:07.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:08.256 INFO:teuthology.orchestra.run.smithi172.stdout:generic/484 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:08.271 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/484 2023-03-27T13:11:08.272 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/484 2023-03-27T13:11:08.272 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:08.279 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:08.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:08.327 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-03-27T13:11:08.994 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:09.019 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:09.020 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:09.023 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:09.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:09.815 INFO:teuthology.orchestra.run.smithi172.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T13:11:09.828 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/485 2023-03-27T13:11:09.829 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/485 2023-03-27T13:11:09.829 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:09.839 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:09.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:09.905 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-03-27T13:11:10.625 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:10.643 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:10.644 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:10.646 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:10.646 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:11.956 INFO:teuthology.orchestra.run.smithi172.stdout:generic/486 1s 2023-03-27T13:11:11.971 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/486 2023-03-27T13:11:11.972 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:11.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:12.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:12.017 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-03-27T13:11:12.681 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:12.700 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:12.702 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:12.705 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:12.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:13.544 INFO:teuthology.orchestra.run.smithi172.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-03-27T13:11:13.556 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/487 2023-03-27T13:11:13.556 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/487 2023-03-27T13:11:13.556 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:13.567 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:13.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:13.628 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-03-27T13:11:14.318 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:14.342 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:14.344 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:14.347 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:14.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:15.108 INFO:teuthology.orchestra.run.smithi172.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T13:11:15.128 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/488 2023-03-27T13:11:15.129 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/488 2023-03-27T13:11:15.129 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:15.136 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:15.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:15.197 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-03-27T13:11:15.840 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:15.856 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:15.859 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:15.862 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:15.862 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:16.641 INFO:teuthology.orchestra.run.smithi172.stdout:generic/489 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:16.657 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/489 2023-03-27T13:11:16.657 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/489 2023-03-27T13:11:16.657 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:16.666 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:16.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:16.721 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-03-27T13:11:17.437 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:17.459 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:17.461 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:17.467 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:20.070 INFO:teuthology.orchestra.run.smithi172.stdout:generic/490 3s 2023-03-27T13:11:20.086 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/490 2023-03-27T13:11:20.086 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:20.099 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:20.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:20.330 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-03-27T13:11:21.269 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:21.285 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:21.286 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:21.289 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:21.289 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:22.145 INFO:teuthology.orchestra.run.smithi172.stdout:generic/491 [not run] ceph does not support freezing 2023-03-27T13:11:22.165 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/491 2023-03-27T13:11:22.165 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/491 2023-03-27T13:11:22.165 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:22.173 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:22.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:22.229 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-03-27T13:11:22.864 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:22.885 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:22.886 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:22.889 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:22.889 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:23.643 INFO:teuthology.orchestra.run.smithi172.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-03-27T13:11:23.656 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/492 2023-03-27T13:11:23.656 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/492 2023-03-27T13:11:23.657 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:23.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:23.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:23.725 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-03-27T13:11:24.393 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:24.411 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:24.412 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:24.415 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:24.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:25.665 INFO:teuthology.orchestra.run.smithi172.stdout:generic/493 [not run] swapfiles are not supported 2023-03-27T13:11:25.681 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/493 2023-03-27T13:11:25.681 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/493 2023-03-27T13:11:25.681 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:25.690 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:25.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:25.754 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-03-27T13:11:26.405 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:26.426 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:26.427 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:26.431 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:26.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:27.534 INFO:teuthology.orchestra.run.smithi172.stdout:generic/494 [not run] swapfiles are not supported 2023-03-27T13:11:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/494 2023-03-27T13:11:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/494 2023-03-27T13:11:27.549 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:27.557 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:27.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:27.625 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-03-27T13:11:28.305 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:28.329 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:28.329 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:28.333 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:28.333 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:29.489 INFO:teuthology.orchestra.run.smithi172.stdout:generic/495 [not run] swapfiles are not supported 2023-03-27T13:11:29.508 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/495 2023-03-27T13:11:29.508 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/495 2023-03-27T13:11:29.508 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:29.524 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:29.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:29.590 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-03-27T13:11:30.278 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:30.303 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:30.303 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:30.305 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:30.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:31.446 INFO:teuthology.orchestra.run.smithi172.stdout:generic/496 [not run] swapfiles are not supported 2023-03-27T13:11:31.460 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/496 2023-03-27T13:11:31.461 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/496 2023-03-27T13:11:31.461 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:31.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:31.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:31.532 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-03-27T13:11:32.226 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:32.244 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:32.246 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:32.253 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:33.288 INFO:teuthology.orchestra.run.smithi172.stdout:generic/497 [not run] swapfiles are not supported 2023-03-27T13:11:33.297 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/497 2023-03-27T13:11:33.297 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/497 2023-03-27T13:11:33.298 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:33.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:33.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:33.366 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-03-27T13:11:34.042 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:34.057 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:34.058 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:34.062 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:34.062 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:35.157 INFO:teuthology.orchestra.run.smithi172.stdout:generic/498 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:35.172 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/498 2023-03-27T13:11:35.172 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/498 2023-03-27T13:11:35.172 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:35.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:35.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:35.241 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-03-27T13:11:35.787 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:35.799 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:35.801 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:35.803 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:35.803 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:36.747 INFO:teuthology.orchestra.run.smithi172.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T13:11:36.760 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/499 2023-03-27T13:11:36.760 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/499 2023-03-27T13:11:36.760 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:36.765 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:36.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:36.831 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-03-27T13:11:37.517 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:37.532 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:37.533 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:37.535 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:37.535 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:38.401 INFO:teuthology.orchestra.run.smithi172.stdout:generic/500 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:38.419 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/500 2023-03-27T13:11:38.419 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/500 2023-03-27T13:11:38.419 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:38.427 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:38.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:38.480 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-03-27T13:11:39.104 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:39.120 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:39.122 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:39.130 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:39.130 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:40.537 INFO:teuthology.orchestra.run.smithi172.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T13:11:40.603 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/501 2023-03-27T13:11:40.603 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/501 2023-03-27T13:11:40.603 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:40.610 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:40.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:40.733 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-03-27T13:11:41.404 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:41.423 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:41.425 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:41.428 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:41.428 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:42.288 INFO:teuthology.orchestra.run.smithi172.stdout:generic/502 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:42.303 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/502 2023-03-27T13:11:42.304 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/502 2023-03-27T13:11:42.305 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:42.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:42.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:42.373 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-03-27T13:11:43.037 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:43.062 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:43.064 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:43.066 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:43.067 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:43.919 INFO:teuthology.orchestra.run.smithi172.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T13:11:43.935 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/503 2023-03-27T13:11:43.935 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/503 2023-03-27T13:11:43.935 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:43.949 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:44.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:44.018 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-03-27T13:11:44.693 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:44.714 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:44.715 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:44.719 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:44.719 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:45.572 INFO:teuthology.orchestra.run.smithi172.stdout:generic/504 0s 2023-03-27T13:11:45.590 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/504 2023-03-27T13:11:45.590 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:45.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:45.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:45.675 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-03-27T13:11:46.340 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:46.361 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:46.362 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:46.367 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:46.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:47.358 INFO:teuthology.orchestra.run.smithi172.stdout:generic/505 [not run] ceph does not support shutdown 2023-03-27T13:11:47.403 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/505 2023-03-27T13:11:47.403 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/505 2023-03-27T13:11:47.403 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:47.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:47.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:47.480 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-03-27T13:11:48.141 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:48.160 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:48.161 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:48.166 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:48.167 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:48.922 INFO:teuthology.orchestra.run.smithi172.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T13:11:48.936 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/506 2023-03-27T13:11:48.936 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/506 2023-03-27T13:11:48.936 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:48.946 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:49.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:49.003 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-03-27T13:11:49.702 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:49.716 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:49.718 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:49.721 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:50.520 INFO:teuthology.orchestra.run.smithi172.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-03-27T13:11:50.534 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/507 2023-03-27T13:11:50.534 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/507 2023-03-27T13:11:50.534 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:50.543 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:50.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:50.637 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-03-27T13:11:51.313 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:51.326 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:51.331 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:51.334 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:51.334 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:52.109 INFO:teuthology.orchestra.run.smithi172.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-03-27T13:11:52.122 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/508 2023-03-27T13:11:52.123 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/508 2023-03-27T13:11:52.123 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:52.131 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:52.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:52.192 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-03-27T13:11:52.881 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:52.897 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:52.899 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:52.902 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:52.902 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:53.708 INFO:teuthology.orchestra.run.smithi172.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-03-27T13:11:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/509 2023-03-27T13:11:53.720 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/509 2023-03-27T13:11:53.721 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:53.731 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:53.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:53.786 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-03-27T13:11:54.446 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:54.461 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:54.463 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:54.466 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:54.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:55.256 INFO:teuthology.orchestra.run.smithi172.stdout:generic/510 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:11:55.269 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/510 2023-03-27T13:11:55.270 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/510 2023-03-27T13:11:55.270 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:55.276 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:55.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:55.346 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-03-27T13:11:56.004 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:56.018 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:56.020 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:56.022 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:56.022 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:56.820 INFO:teuthology.orchestra.run.smithi172.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-03-27T13:11:56.839 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/511 2023-03-27T13:11:56.839 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/511 2023-03-27T13:11:56.840 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:56.846 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:56.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:56.914 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-03-27T13:11:57.598 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:57.612 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:57.613 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:57.615 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:57.616 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:58.420 INFO:teuthology.orchestra.run.smithi172.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T13:11:58.441 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/512 2023-03-27T13:11:58.441 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/512 2023-03-27T13:11:58.441 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:11:58.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:11:58.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:11:58.525 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-03-27T13:11:59.231 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:11:59.253 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:11:59.255 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:11:59.258 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:11:59.258 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:00.528 INFO:teuthology.orchestra.run.smithi172.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T13:12:00.557 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/513 2023-03-27T13:12:00.558 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/513 2023-03-27T13:12:00.558 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:00.578 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:00.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:00.817 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-03-27T13:12:01.523 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:01.542 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:01.543 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:01.546 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:01.546 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:02.834 INFO:teuthology.orchestra.run.smithi172.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T13:12:02.885 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/514 2023-03-27T13:12:02.885 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/514 2023-03-27T13:12:02.885 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:02.913 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:03.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:03.167 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-03-27T13:12:03.873 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:03.893 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:03.895 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:03.898 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:03.898 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:05.173 INFO:teuthology.orchestra.run.smithi172.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T13:12:05.207 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/515 2023-03-27T13:12:05.207 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/515 2023-03-27T13:12:05.207 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:05.214 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:05.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:05.476 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-03-27T13:12:06.178 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:06.194 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:06.196 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:06.199 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:06.199 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:07.303 INFO:teuthology.orchestra.run.smithi172.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-03-27T13:12:07.317 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/516 2023-03-27T13:12:07.317 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/516 2023-03-27T13:12:07.318 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:07.329 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:07.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:07.508 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-03-27T13:12:08.196 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:08.208 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:08.209 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:08.212 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:08.212 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:09.312 INFO:teuthology.orchestra.run.smithi172.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-27T13:12:09.443 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/517 2023-03-27T13:12:09.447 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/517 2023-03-27T13:12:09.447 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:09.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:09.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:09.799 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-03-27T13:12:10.359 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:10.375 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:10.376 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:10.379 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:10.379 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:11.642 INFO:teuthology.orchestra.run.smithi172.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T13:12:11.667 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/518 2023-03-27T13:12:11.667 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/518 2023-03-27T13:12:11.668 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:11.677 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:12.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:12.097 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-03-27T13:12:12.787 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:12.811 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:12.813 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:12.816 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:12.817 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:13.671 INFO:teuthology.orchestra.run.smithi172.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-03-27T13:12:13.688 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/519 2023-03-27T13:12:13.688 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/519 2023-03-27T13:12:13.689 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:13.696 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:13.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:13.875 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-03-27T13:12:14.795 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:14.809 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:14.810 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:14.813 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:14.813 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:15.581 INFO:teuthology.orchestra.run.smithi172.stdout:generic/520 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T13:12:15.596 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/520 2023-03-27T13:12:15.597 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/520 2023-03-27T13:12:15.598 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T13:12:15.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:12:15.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T13:12:15.665 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-03-27T13:12:16.307 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T13:12:16.329 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T13:12:16.330 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T13:12:16.334 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T13:12:16.334 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T13:13:56.596 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:13:56.602 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:13:56.729 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T13:13:56.731+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126573) UID: 0 2023-03-27T13:13:56.730 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T13:13:56.731+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126573) UID: 0 2023-03-27T13:13:56.730 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T13:13:56.731+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126573) UID: 0 2023-03-27T13:13:56.730 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T13:13:56.731+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126573) UID: 0 2023-03-27T13:20:39.895 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:20:39.901 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:20:40.025 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T13:20:40.026+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 576328) UID: 0 2023-03-27T13:20:40.028 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T13:20:40.029+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 576328) UID: 0 2023-03-27T13:23:39.510 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T13:23:39.509+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 576356) UID: 0 2023-03-27T13:23:39.510 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T13:23:39.509+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 576356) UID: 0 2023-03-27T13:23:39.511 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T13:23:39.510+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 576356) UID: 0 2023-03-27T13:23:39.511 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T13:23:39.510+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 576356) UID: 0 2023-03-27T13:27:15.942 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:27:15.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:27:46.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:27:46.088 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:28:16.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:28:16.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:28:46.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:28:46.342 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:29:16.470 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:29:16.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:29:46.624 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:29:46.634 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:30:16.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:30:16.772 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:30:47.144 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:30:47.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:31:18.075 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:31:18.080 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:31:48.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:31:48.218 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:32:19.727 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:32:19.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:32:50.133 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:32:50.138 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:33:20.277 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:33:20.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:33:50.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:33:50.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:34:20.556 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:34:20.562 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:34:50.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:34:50.693 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:35:20.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:35:20.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:35:51.008 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:35:51.014 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:36:21.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:36:21.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:36:51.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:36:51.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:37:22.865 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:37:22.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:37:53.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:37:53.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:38:23.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:38:23.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:38:53.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:38:53.512 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:38:53.636 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T13:38:53.637+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577069) UID: 0 2023-03-27T13:38:53.636 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T13:38:53.637+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577069) UID: 0 2023-03-27T13:38:53.636 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T13:38:53.637+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577069) UID: 0 2023-03-27T13:38:53.637 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T13:38:53.638+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577069) UID: 0 2023-03-27T13:42:05.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:42:05.382 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:42:35.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:42:35.743 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:43:05.883 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:43:05.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:43:36.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:43:36.042 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:44:06.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:44:06.831 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:44:36.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:44:36.999 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:44:37.131 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T13:44:37.132+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127587) UID: 0 2023-03-27T13:44:37.132 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T13:44:37.132+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127587) UID: 0 2023-03-27T13:44:37.132 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T13:44:37.132+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127587) UID: 0 2023-03-27T13:44:37.132 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T13:44:37.132+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127587) UID: 0 2023-03-27T13:47:52.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:47:52.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:47:53.111 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T13:47:53.111+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127639) UID: 0 2023-03-27T13:47:53.112 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T13:47:53.111+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127639) UID: 0 2023-03-27T13:47:53.112 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T13:47:53.112+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127639) UID: 0 2023-03-27T13:47:53.114 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T13:47:53.114+0000 7f7d32ff8700 -1 received signal: Hangup from (PID: 127639) UID: 0 2023-03-27T13:51:10.054 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:51:10.063 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:51:40.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:51:40.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:52:10.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:52:10.362 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:52:41.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:52:41.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:53:11.373 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:53:11.382 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:53:41.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:53:41.564 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:54:11.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:54:11.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:54:11.820 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T13:54:11.820+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577553) UID: 0 2023-03-27T13:54:11.820 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T13:54:11.821+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577553) UID: 0 2023-03-27T13:54:11.821 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T13:54:11.821+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577553) UID: 0 2023-03-27T13:54:11.821 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T13:54:11.821+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 577553) UID: 0 2023-03-27T13:57:30.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:57:30.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:58:00.375 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:58:00.379 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:58:30.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:58:30.637 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:59:00.760 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:59:00.769 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:59:30.900 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T13:59:30.905 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:00:02.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:00:02.570 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:00:32.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:00:32.716 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:01:03.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:01:03.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:01:33.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:01:33.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:02:03.452 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:02:03.461 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:02:33.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:02:33.610 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:03:03.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:03:03.749 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:03:33.877 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:03:33.882 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:04:04.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:04:04.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:04:34.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:04:34.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:05:04.552 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:05:04.558 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:05:34.692 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:05:34.697 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:06:07.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:06:07.702 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:06:37.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:06:37.843 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:07:07.990 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:07:07.995 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:07:38.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:07:38.180 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:07:38.292 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T14:07:38.292+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128502) UID: 0 2023-03-27T14:07:38.292 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T14:07:38.292+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128502) UID: 0 2023-03-27T14:07:38.293 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T14:07:38.293+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128502) UID: 0 2023-03-27T14:07:38.293 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T14:07:38.293+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128502) UID: 0 2023-03-27T14:10:48.588 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:10:48.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:11:18.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:11:18.878 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:11:49.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:11:49.704 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:12:19.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:12:19.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:12:51.246 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:12:51.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:13:21.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:13:21.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:13:52.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:13:52.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:14:22.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:14:22.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:14:52.873 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:14:52.882 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:15:23.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:15:23.168 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:15:54.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:15:54.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:16:24.575 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:16:24.579 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:16:24.765 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T14:16:24.765+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578557) UID: 0 2023-03-27T14:16:24.765 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T14:16:24.766+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578557) UID: 0 2023-03-27T14:16:24.765 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T14:16:24.766+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578557) UID: 0 2023-03-27T14:16:24.766 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T14:16:24.766+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578557) UID: 0 2023-03-27T14:19:34.382 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:19:34.389 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:20:04.519 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:20:04.526 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:20:34.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:20:34.669 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:21:04.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:21:04.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:21:34.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:21:34.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:21:35.102 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T14:21:35.102+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129040) UID: 0 2023-03-27T14:21:35.103 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T14:21:35.102+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129040) UID: 0 2023-03-27T14:21:35.103 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T14:21:35.103+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129040) UID: 0 2023-03-27T14:21:35.104 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T14:21:35.104+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129040) UID: 0 2023-03-27T14:24:53.385 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:24:53.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:25:23.600 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:25:23.605 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:25:54.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:25:54.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:26:24.231 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:26:24.237 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:26:54.372 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:26:54.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:27:25.257 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:27:25.262 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:27:25.377 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T14:27:25.377+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129239) UID: 0 2023-03-27T14:27:25.378 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T14:27:25.376+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129239) UID: 0 2023-03-27T14:27:25.379 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T14:27:25.377+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129239) UID: 0 2023-03-27T14:27:25.379 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T14:27:25.378+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129239) UID: 0 2023-03-27T14:27:25.393 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T14:27:25.394+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578923) UID: 0 2023-03-27T14:27:25.394 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T14:27:25.394+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578923) UID: 0 2023-03-27T14:27:25.394 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T14:27:25.394+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578923) UID: 0 2023-03-27T14:27:25.394 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T14:27:25.394+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 578923) UID: 0 2023-03-27T14:30:38.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:30:38.105 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:30:38.221 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T14:30:38.221+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129292) UID: 0 2023-03-27T14:30:38.221 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T14:30:38.221+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129292) UID: 0 2023-03-27T14:30:38.222 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T14:30:38.222+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129292) UID: 0 2023-03-27T14:30:38.224 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T14:30:38.222+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129292) UID: 0 2023-03-27T14:33:52.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:33:52.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:34:22.208 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:34:22.214 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:34:52.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:34:52.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:35:22.496 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:35:22.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:35:52.640 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:35:52.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:36:22.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:36:22.813 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:36:52.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:36:53.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:37:23.140 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:37:23.145 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:37:53.276 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:37:53.281 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:38:23.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:38:23.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:38:53.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:38:53.556 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:39:23.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:39:23.729 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:39:53.917 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:39:53.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:40:24.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:40:24.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:40:54.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:40:54.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:41:25.265 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:41:25.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:41:55.406 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:41:55.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:42:25.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:42:25.610 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:42:55.767 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:42:55.771 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:43:26.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:43:26.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:43:56.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:43:56.932 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:44:27.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:44:27.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:44:57.271 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:44:57.276 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:45:27.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:45:27.423 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:45:27.538 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T14:45:27.538+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579692) UID: 0 2023-03-27T14:45:27.538 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T14:45:27.538+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579692) UID: 0 2023-03-27T14:45:27.538 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T14:45:27.538+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579692) UID: 0 2023-03-27T14:45:27.539 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T14:45:27.538+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579692) UID: 0 2023-03-27T14:48:43.589 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:48:43.594 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:49:13.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:49:13.891 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:49:44.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:49:44.033 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:50:14.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:50:14.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:50:42.024 INFO:teuthology.orchestra.run.smithi172.stdout:generic/521 5905s 2023-03-27T14:50:42.060 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/521 2023-03-27T14:50:42.060 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T14:50:42.068 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T14:50:42.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T14:50:42.301 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-03-27T14:50:43.203 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T14:50:43.218 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T14:50:43.220 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T14:50:43.223 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T14:50:43.224 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T14:50:44.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:50:44.314 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:51:14.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:51:14.463 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:51:44.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:51:44.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:51:44.894 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T14:51:44.894+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 580423) UID: 0 2023-03-27T14:51:44.894 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T14:51:44.895+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 580423) UID: 0 2023-03-27T14:54:40.913 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T14:54:40.913+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580452) UID: 0 2023-03-27T14:54:40.914 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T14:54:40.913+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580452) UID: 0 2023-03-27T14:54:40.914 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T14:54:40.913+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580452) UID: 0 2023-03-27T14:54:40.915 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T14:54:40.914+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580452) UID: 0 2023-03-27T14:57:58.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:57:58.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:58:28.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:58:28.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:58:58.643 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:58:58.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:59:28.788 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:59:28.793 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:59:58.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T14:59:58.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:00:29.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:00:29.087 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:00:59.944 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:00:59.950 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:01:00.095 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T15:01:00.097+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130492) UID: 0 2023-03-27T15:01:00.096 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T15:01:00.097+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130492) UID: 0 2023-03-27T15:01:00.096 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T15:01:00.098+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130492) UID: 0 2023-03-27T15:01:00.096 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T15:01:00.097+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130492) UID: 0 2023-03-27T15:04:15.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:04:15.827 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:04:46.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:04:46.704 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:05:16.859 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:05:16.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:05:47.011 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:05:47.016 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:06:17.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:06:17.219 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:06:47.424 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:06:47.429 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:07:17.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:07:17.570 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:07:47.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:07:47.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:08:17.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:08:17.855 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:08:17.961 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T15:08:17.962+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580972) UID: 0 2023-03-27T15:08:17.961 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T15:08:17.963+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580972) UID: 0 2023-03-27T15:08:17.962 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T15:08:17.963+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580972) UID: 0 2023-03-27T15:08:17.962 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T15:08:17.963+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580972) UID: 0 2023-03-27T15:11:25.999 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:11:26.007 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:11:26.145 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T15:11:26.146+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130837) UID: 0 2023-03-27T15:11:26.146 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T15:11:26.146+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130837) UID: 0 2023-03-27T15:11:26.146 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T15:11:26.146+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130837) UID: 0 2023-03-27T15:11:26.147 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T15:11:26.146+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130837) UID: 0 2023-03-27T15:14:48.643 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:14:48.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:15:19.461 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:15:19.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:15:49.607 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:15:49.611 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:16:19.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:16:19.758 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:16:49.929 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:16:49.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:17:20.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:17:20.078 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:17:50.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:17:50.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:18:21.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:18:21.182 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:18:51.323 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:18:51.330 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:19:21.460 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:19:21.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:19:21.590 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T15:19:21.591+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131150) UID: 0 2023-03-27T15:19:21.590 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T15:19:21.591+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131150) UID: 0 2023-03-27T15:19:21.591 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T15:19:21.591+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131150) UID: 0 2023-03-27T15:19:21.591 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T15:19:21.591+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131150) UID: 0 2023-03-27T15:22:42.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:22:43.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:23:15.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:23:15.175 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:23:45.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:23:45.344 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:24:15.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:24:15.487 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:24:45.646 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:24:45.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:25:15.793 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:25:15.797 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:25:45.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:25:45.944 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:26:16.111 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:26:16.116 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:26:46.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:26:46.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:27:16.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:27:16.543 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:27:47.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:27:47.638 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:28:17.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:28:17.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:28:47.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:28:47.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:29:18.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:29:18.130 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:29:48.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:29:48.399 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:30:18.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:30:18.539 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:30:18.669 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T15:30:18.670+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131636) UID: 0 2023-03-27T15:30:18.669 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T15:30:18.670+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131636) UID: 0 2023-03-27T15:30:18.670 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T15:30:18.670+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131636) UID: 0 2023-03-27T15:30:18.670 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T15:30:18.671+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131636) UID: 0 2023-03-27T15:33:35.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:33:35.813 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:34:06.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:34:06.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:34:36.227 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:34:36.233 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:35:06.362 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:35:06.370 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:35:36.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:35:36.517 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:36:07.363 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:36:07.369 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:36:37.497 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:36:37.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:37:07.633 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:37:07.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:37:37.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:37:37.774 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:38:07.909 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:38:07.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:38:38.050 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:38:38.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:39:08.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:39:08.225 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:39:38.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:39:38.423 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:40:08.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:40:08.560 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:40:38.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:40:38.724 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:41:09.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:41:09.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:41:39.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:41:39.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:42:09.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:42:09.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:42:39.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:42:39.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:43:09.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:43:09.636 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:43:39.786 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:43:39.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:43:39.912 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T15:43:39.910+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132263) UID: 0 2023-03-27T15:43:39.912 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T15:43:39.910+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132263) UID: 0 2023-03-27T15:43:39.912 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T15:43:39.910+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132263) UID: 0 2023-03-27T15:43:39.913 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T15:43:39.910+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132263) UID: 0 2023-03-27T15:43:39.998 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T15:43:39.998+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582442) UID: 0 2023-03-27T15:43:39.998 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T15:43:39.998+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582442) UID: 0 2023-03-27T15:43:39.999 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T15:43:39.998+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582442) UID: 0 2023-03-27T15:43:39.999 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T15:43:39.998+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582442) UID: 0 2023-03-27T15:46:49.883 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:46:49.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:47:20.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:47:20.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:47:50.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:47:50.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:48:20.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:48:20.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:48:20.546 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T15:48:20.546+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132406) UID: 0 2023-03-27T15:48:20.547 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T15:48:20.546+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132406) UID: 0 2023-03-27T15:48:20.547 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T15:48:20.546+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132406) UID: 0 2023-03-27T15:48:20.548 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T15:48:20.547+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132406) UID: 0 2023-03-27T15:51:33.876 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:51:33.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:52:04.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:52:04.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:52:04.460 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T15:52:04.459+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582661) UID: 0 2023-03-27T15:52:04.460 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T15:52:04.460+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582661) UID: 0 2023-03-27T15:52:04.461 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T15:52:04.459+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582661) UID: 0 2023-03-27T15:52:04.461 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T15:52:04.460+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582661) UID: 0 2023-03-27T15:54:02.025 INFO:teuthology.orchestra.run.smithi172.stdout:generic/522 3798s 2023-03-27T15:54:02.069 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/522 2023-03-27T15:54:02.070 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:02.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:02.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:02.154 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-03-27T15:54:03.083 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:03.096 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:03.097 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:03.099 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:03.099 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:05.300 INFO:teuthology.orchestra.run.smithi172.stdout:generic/523 2s 2023-03-27T15:54:05.321 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/523 2023-03-27T15:54:05.321 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:05.328 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:05.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:05.361 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-03-27T15:54:06.037 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:06.057 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:06.057 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:06.062 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:06.062 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:14.236 INFO:teuthology.orchestra.run.smithi172.stdout:generic/524 8s 2023-03-27T15:54:14.261 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/524 2023-03-27T15:54:14.262 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:14.270 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:14.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:14.299 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-03-27T15:54:15.001 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:15.022 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:15.023 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:15.027 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:15.027 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:16.109 INFO:teuthology.orchestra.run.smithi172.stdout:generic/525 [not run] filesystem does not support huge file size 2023-03-27T15:54:16.154 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/525 2023-03-27T15:54:16.154 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/525 2023-03-27T15:54:16.155 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:16.166 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:16.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:16.226 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-03-27T15:54:16.902 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:16.924 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:16.925 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:16.928 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:16.928 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:17.890 INFO:teuthology.orchestra.run.smithi172.stdout:generic/526 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T15:54:17.913 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/526 2023-03-27T15:54:17.914 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/526 2023-03-27T15:54:17.914 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:17.922 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:17.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:17.988 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-03-27T15:54:18.664 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:18.687 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:18.689 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:18.693 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:18.693 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:19.537 INFO:teuthology.orchestra.run.smithi172.stdout:generic/527 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T15:54:19.555 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/527 2023-03-27T15:54:19.555 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/527 2023-03-27T15:54:19.555 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:19.566 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:19.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:19.629 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-03-27T15:54:20.332 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:20.349 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:20.350 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:20.353 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:20.353 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:21.365 INFO:teuthology.orchestra.run.smithi172.stdout:generic/528 1s 2023-03-27T15:54:21.384 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/528 2023-03-27T15:54:21.384 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:21.396 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:21.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:21.569 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-03-27T15:54:22.585 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:22.603 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:22.604 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:22.607 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:22.607 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:24.334 INFO:teuthology.orchestra.run.smithi172.stdout:generic/529 2s 2023-03-27T15:54:24.348 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/529 2023-03-27T15:54:24.348 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:24.356 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:24.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:24.384 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-03-27T15:54:25.085 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:25.108 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:25.110 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:25.114 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:25.114 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:26.134 INFO:teuthology.orchestra.run.smithi172.stdout:generic/530 [not run] ceph does not support shutdown 2023-03-27T15:54:26.177 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/530 2023-03-27T15:54:26.178 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/530 2023-03-27T15:54:26.178 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T15:54:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:54:26.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T15:54:26.248 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-03-27T15:54:26.916 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T15:54:26.935 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T15:54:26.936 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T15:54:26.939 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T15:54:26.939 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T15:55:20.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:55:20.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T15:55:20.389 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T15:55:20.389+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 587749) UID: 0 2023-03-27T15:55:20.389 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T15:55:20.389+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 587749) UID: 0 2023-03-27T15:59:46.587 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T15:59:46.586+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587785) UID: 0 2023-03-27T15:59:46.588 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T15:59:46.587+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587785) UID: 0 2023-03-27T15:59:46.589 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T15:59:46.588+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587785) UID: 0 2023-03-27T15:59:46.589 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T15:59:46.588+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587785) UID: 0 2023-03-27T16:03:40.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:03:40.833 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:03:41.130 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:03:41.129+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 587862) UID: 0 2023-03-27T16:03:41.130 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:03:41.130+0000 7f3f82bf9700 -1 Fail to open '/proc/587862/cmdline' error = (2) No such file or directory 2023-03-27T16:03:41.131 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:03:41.130+0000 7f3f82bf9700 -1 received signal: Hangup from (PID: 587862) UID: 0 2023-03-27T16:08:25.026 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T16:08:25.012+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587910) UID: 0 2023-03-27T16:08:25.027 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T16:08:25.013+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587910) UID: 0 2023-03-27T16:08:25.028 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T16:08:25.013+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587910) UID: 0 2023-03-27T16:08:25.028 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T16:08:25.013+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587910) UID: 0 2023-03-27T16:13:03.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:13:03.448 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:13:14.248 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:13:14.248+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 587975) UID: 0 2023-03-27T16:13:14.248 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:13:14.248+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 587975) UID: 0 2023-03-27T16:20:21.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:20:21.020 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:20:23.724 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:20:23.724+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588076) UID: 0 2023-03-27T16:20:23.726 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:20:23.726+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588076) UID: 0 2023-03-27T16:27:21.812 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:27:21.817 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:27:28.902 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:27:28.903+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588164) UID: 0 2023-03-27T16:27:28.903 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:27:28.903+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588164) UID: 0 2023-03-27T16:33:37.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:33:37.128 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:33:44.204 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:33:44.205+0000 7f61acdf9700 -1 received signal: Hangup from (PID: 588248) UID: 0 2023-03-27T16:33:44.216 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:33:44.207+0000 7f3f82bf9700 -1 received signal: Hangup from (PID: 588248) UID: 0 2023-03-27T16:38:00.807 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:38:00.812 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:38:30.923 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:38:30.928 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:39:01.028 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:39:01.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:39:01.307 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:39:01.307+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588368) UID: 0 2023-03-27T16:39:01.308 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:39:01.307+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588368) UID: 0 2023-03-27T16:42:17.831 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:42:17.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:42:54.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:42:54.291 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:43:26.966 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:43:26.971 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:43:57.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:43:57.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:44:27.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:44:27.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:44:27.256 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:44:27.257+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588546) UID: 0 2023-03-27T16:44:27.256 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:44:27.257+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588546) UID: 0 2023-03-27T16:47:42.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:47:42.417 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:48:12.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:48:12.537 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:48:42.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:48:42.650 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:49:12.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:49:12.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:49:42.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:49:42.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:49:42.988 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:49:42.989+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588712) UID: 0 2023-03-27T16:49:42.989 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:49:42.989+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588712) UID: 0 2023-03-27T16:52:48.086 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:52:48.091 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:53:18.323 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:53:18.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:53:48.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:53:48.512 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:54:18.625 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:54:18.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:54:48.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:54:48.761 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:55:20.079 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:55:20.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:55:20.407 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T16:55:20.407+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588912) UID: 0 2023-03-27T16:55:20.407 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T16:55:20.408+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 588912) UID: 0 2023-03-27T16:58:27.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:58:27.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:59:02.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:59:02.065 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:59:32.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T16:59:32.187 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:00:02.363 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:00:02.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:00:32.552 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:00:32.556 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:01:02.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:01:02.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:01:03.002 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T17:01:03.003+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589120) UID: 0 2023-03-27T17:01:03.002 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T17:01:03.003+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589120) UID: 0 2023-03-27T17:04:16.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:04:16.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:04:17.052 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T17:04:17.053+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133921) UID: 0 2023-03-27T17:04:17.052 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T17:04:17.053+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133921) UID: 0 2023-03-27T17:04:17.053 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T17:04:17.053+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133921) UID: 0 2023-03-27T17:04:17.053 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T17:04:17.053+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133921) UID: 0 2023-03-27T17:06:52.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:06:52.045 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:06:53.304 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T17:06:53.307+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589223) UID: 0 2023-03-27T17:06:53.305 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T17:06:53.307+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589223) UID: 0 2023-03-27T17:10:37.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:10:37.366 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:11:07.598 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:11:07.602 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:11:37.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:11:37.766 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:11:38.010 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T17:11:38.011+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589346) UID: 0 2023-03-27T17:11:38.010 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T17:11:38.011+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589346) UID: 0 2023-03-27T17:14:55.438 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:14:55.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:15:25.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:15:25.568 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:15:55.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:15:55.700 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:15:55.839 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T17:15:55.840+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589457) UID: 0 2023-03-27T17:15:55.839 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T17:15:55.840+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 589457) UID: 0 2023-03-27T17:16:16.208 INFO:teuthology.orchestra.run.smithi172.stdout:generic/531 4909s 2023-03-27T17:16:16.263 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/531 2023-03-27T17:16:16.263 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:16:16.273 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:16:16.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:16:16.298 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-03-27T17:16:20.594 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:16:20.610 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:16:20.611 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:16:20.615 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:16:20.615 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:16:37.057 INFO:teuthology.orchestra.run.smithi172.stdout:generic/532 4s 2023-03-27T17:16:37.069 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/532 2023-03-27T17:16:37.070 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:16:37.076 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:16:43.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:16:43.039 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-03-27T17:16:46.613 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:16:46.623 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:16:46.624 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:16:46.627 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:16:46.627 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:30.293 INFO:teuthology.orchestra.run.smithi172.stdout:generic/533 29s 2023-03-27T17:17:31.307 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/533 2023-03-27T17:17:31.308 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:17:31.314 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:35.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:17:35.642 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-03-27T17:17:42.037 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:17:42.086 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:17:42.086 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:17:42.090 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:17:42.090 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:46.054 INFO:teuthology.orchestra.run.smithi172.stdout:generic/534 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:17:46.077 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/534 2023-03-27T17:17:46.077 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/534 2023-03-27T17:17:46.077 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:17:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:46.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:17:46.203 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-03-27T17:17:47.464 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:17:47.536 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:17:47.536 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:17:47.541 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:17:47.541 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:48.952 INFO:teuthology.orchestra.run.smithi172.stdout:generic/535 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:17:48.979 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/535 2023-03-27T17:17:48.980 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/535 2023-03-27T17:17:48.980 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:17:48.994 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:49.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:17:49.096 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-03-27T17:17:50.289 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:17:50.349 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:17:50.352 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:17:50.356 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:17:50.356 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:52.376 INFO:teuthology.orchestra.run.smithi172.stdout:generic/536 [not run] ceph does not support shutdown 2023-03-27T17:17:52.444 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/536 2023-03-27T17:17:52.445 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/536 2023-03-27T17:17:52.445 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:17:52.459 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:52.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:17:52.565 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-03-27T17:17:53.779 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:17:53.823 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:17:53.823 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:17:53.836 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:17:53.836 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:55.931 INFO:teuthology.orchestra.run.smithi172.stdout:generic/537 [not run] FSTRIM not supported 2023-03-27T17:17:56.029 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/537 2023-03-27T17:17:56.029 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/537 2023-03-27T17:17:56.030 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:17:56.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:17:56.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:17:56.135 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-03-27T17:17:57.508 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:17:57.553 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:17:57.554 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:17:57.559 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:17:57.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:19:10.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:19:10.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:19:40.649 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:19:40.653 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:19:40.736 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T17:19:40.738+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134272) UID: 0 2023-03-27T17:19:40.738 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T17:19:40.738+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134272) UID: 0 2023-03-27T17:19:40.740 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T17:19:40.740+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134272) UID: 0 2023-03-27T17:19:40.741 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T17:19:40.741+0000 7f0dc85f8700 -1 received signal: Hangup from (PID: 134272) UID: 0 2023-03-27T17:23:19.158 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:23:19.174 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:23:49.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:23:49.564 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:24:19.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:24:19.781 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:24:50.714 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:24:50.722 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:25:20.897 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:25:20.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:25:21.098 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T17:25:21.100+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134446) UID: 0 2023-03-27T17:25:21.098 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T17:25:21.100+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134446) UID: 0 2023-03-27T17:25:21.099 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T17:25:21.100+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134446) UID: 0 2023-03-27T17:25:21.099 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T17:25:21.100+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134446) UID: 0 2023-03-27T17:28:53.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:28:53.921 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:28:54.091 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T17:28:54.093+0000 7f0dc85f8700 -1 received signal: Hangup from (PID: 134500) UID: 0 2023-03-27T17:28:54.091 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T17:28:54.093+0000 7f7d32ff8700 -1 received signal: Hangup from (PID: 134500) UID: 0 2023-03-27T17:28:54.092 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T17:28:54.095+0000 7feee0bf8700 -1 Fail to open '/proc/134500/cmdline' error = (2) No such file or directory 2023-03-27T17:28:54.092 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T17:28:54.095+0000 7feee0bf8700 -1 received signal: Hangup from (PID: 134500) UID: 0 2023-03-27T17:28:54.094 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T17:28:54.093+0000 7f345fdf8700 -1 received signal: Hangup from (PID: 134500) UID: 0 2023-03-27T17:32:36.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:32:36.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:33:06.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:33:06.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:33:37.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:33:37.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:34:07.191 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:34:07.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:34:37.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:34:37.332 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:35:07.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:35:07.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:35:37.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:35:37.768 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:35:59.461 INFO:teuthology.orchestra.run.smithi172.stdout:generic/538 1081s 2023-03-27T17:35:59.473 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/538 2023-03-27T17:35:59.473 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:35:59.478 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:35:59.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:35:59.776 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-03-27T17:36:00.649 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:00.660 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:00.661 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:00.663 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:00.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:02.543 INFO:teuthology.orchestra.run.smithi172.stdout:generic/539 2s 2023-03-27T17:36:02.556 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/539 2023-03-27T17:36:02.556 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:02.561 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:02.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:02.691 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-03-27T17:36:03.379 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:03.391 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:03.392 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:03.394 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:03.394 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:04.232 INFO:teuthology.orchestra.run.smithi172.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:36:04.262 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/540 2023-03-27T17:36:04.262 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/540 2023-03-27T17:36:04.262 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:04.284 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:04.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:04.480 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-03-27T17:36:04.896 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:04.907 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:04.908 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:04.910 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:04.910 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:05.773 INFO:teuthology.orchestra.run.smithi172.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:36:05.820 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/541 2023-03-27T17:36:05.820 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/541 2023-03-27T17:36:05.820 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:05.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:06.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:06.021 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-03-27T17:36:06.439 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:06.450 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:06.451 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:06.453 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:06.454 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:07.264 INFO:teuthology.orchestra.run.smithi172.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:36:07.309 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/542 2023-03-27T17:36:07.309 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/542 2023-03-27T17:36:07.309 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:07.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:07.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:07.524 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-03-27T17:36:07.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:36:07.865 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:36:07.958 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:07.970 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:07.971 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:07.973 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:07.973 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:08.832 INFO:teuthology.orchestra.run.smithi172.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:36:08.856 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/543 2023-03-27T17:36:08.856 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/543 2023-03-27T17:36:08.856 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:08.871 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:09.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:09.066 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-03-27T17:36:09.518 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:09.530 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:09.531 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:09.533 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:09.533 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:10.375 INFO:teuthology.orchestra.run.smithi172.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:36:10.397 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/544 2023-03-27T17:36:10.397 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/544 2023-03-27T17:36:10.397 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:10.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:10.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:10.625 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-03-27T17:36:11.055 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:11.066 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:11.067 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:11.069 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:11.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:11.626 INFO:teuthology.orchestra.run.smithi172.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-03-27T17:36:11.635 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/545 2023-03-27T17:36:11.635 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/545 2023-03-27T17:36:11.635 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:11.640 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:11.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:11.685 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-03-27T17:36:12.101 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:12.112 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:12.113 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:12.115 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:12.115 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:12.672 INFO:teuthology.orchestra.run.smithi172.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T17:36:12.681 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/546 2023-03-27T17:36:12.682 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/546 2023-03-27T17:36:12.682 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:12.687 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:12.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:12.735 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-03-27T17:36:13.145 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:13.157 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:13.157 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:13.160 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:13.160 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:13.682 INFO:teuthology.orchestra.run.smithi172.stdout:generic/547 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:36:13.691 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/547 2023-03-27T17:36:13.691 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/547 2023-03-27T17:36:13.691 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:13.696 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:13.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:13.734 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-03-27T17:36:14.142 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:14.154 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:14.155 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:14.157 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:14.157 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:15.576 INFO:teuthology.orchestra.run.smithi172.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T17:36:15.585 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/548 2023-03-27T17:36:15.585 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/548 2023-03-27T17:36:15.586 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:15.591 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:15.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:15.629 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-03-27T17:36:16.038 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:16.049 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:16.050 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:16.052 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:16.052 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:17.511 INFO:teuthology.orchestra.run.smithi172.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-03-27T17:36:17.520 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/549 2023-03-27T17:36:17.520 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/549 2023-03-27T17:36:17.520 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:17.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:17.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:17.562 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-03-27T17:36:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:17.989 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:17.990 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:17.992 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:17.992 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:18.892 INFO:teuthology.orchestra.run.smithi172.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-03-27T17:36:18.929 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/550 2023-03-27T17:36:18.929 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/550 2023-03-27T17:36:18.929 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:36:18.934 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:18.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:36:18.975 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-03-27T17:36:19.391 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:36:19.402 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:36:19.403 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:36:19.405 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:36:19.405 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:36:37.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:36:37.963 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:37:08.209 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:37:08.214 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:37:38.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:37:38.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:38:08.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:38:08.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:38:38.742 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:38:38.746 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:39:08.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:39:08.888 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:39:39.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:39:39.024 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:40:09.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:40:09.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:40:39.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:40:39.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:41:09.506 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:41:09.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:41:39.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:41:39.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:42:09.807 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:42:09.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:42:39.978 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:42:39.987 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:43:10.483 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:43:10.489 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:43:40.589 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:43:40.593 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:44:10.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:44:10.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:44:40.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:44:40.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:45:11.089 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:45:11.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:45:41.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:45:41.265 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:46:11.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:46:11.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:46:41.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:46:41.552 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:47:11.652 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:47:11.656 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:47:41.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:47:41.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:48:12.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:48:12.010 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:48:42.151 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:48:42.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:49:12.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:49:12.304 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:49:42.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:49:42.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:50:12.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:50:12.654 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:50:42.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:50:42.826 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:51:12.921 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:51:12.926 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:51:43.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:51:43.104 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:52:13.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:52:13.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:52:43.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:52:43.374 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:53:13.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:53:13.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:53:43.664 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:53:43.669 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:54:13.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:54:13.774 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:54:43.950 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:54:43.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:55:14.120 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:55:14.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:55:29.919 INFO:teuthology.orchestra.run.smithi172.stdout:generic/551 1150s 2023-03-27T17:55:29.938 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/551 2023-03-27T17:55:29.938 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:29.943 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:29.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:29.963 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-03-27T17:55:30.471 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:30.482 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:30.483 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:30.485 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:31.153 INFO:teuthology.orchestra.run.smithi172.stdout:generic/552 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:55:31.163 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/552 2023-03-27T17:55:31.163 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/552 2023-03-27T17:55:31.163 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:31.168 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:31.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:31.217 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-03-27T17:55:31.631 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:31.642 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:31.643 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:31.645 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:32.238 INFO:teuthology.orchestra.run.smithi172.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-03-27T17:55:32.247 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/553 2023-03-27T17:55:32.247 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/553 2023-03-27T17:55:32.247 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:32.253 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:32.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:32.429 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-03-27T17:55:33.041 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:33.052 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:33.053 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:33.055 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:33.056 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:33.881 INFO:teuthology.orchestra.run.smithi172.stdout:generic/554 [not run] swapfiles are not supported 2023-03-27T17:55:33.890 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/554 2023-03-27T17:55:33.890 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/554 2023-03-27T17:55:33.890 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:33.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:34.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:34.025 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-03-27T17:55:34.664 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:34.675 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:34.676 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:34.678 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:34.679 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:35.224 INFO:teuthology.orchestra.run.smithi172.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-03-27T17:55:35.233 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/555 2023-03-27T17:55:35.233 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/555 2023-03-27T17:55:35.233 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:35.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:35.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:35.442 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-03-27T17:55:36.027 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:36.038 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:36.039 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:36.041 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:36.041 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:36.509 INFO:teuthology.orchestra.run.smithi172.stdout:generic/556 [not run] ceph does not support casefold feature 2023-03-27T17:55:36.517 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/556 2023-03-27T17:55:36.518 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/556 2023-03-27T17:55:36.518 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:36.523 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:36.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:36.564 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-03-27T17:55:36.972 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:36.983 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:36.984 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:36.987 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:36.987 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:37.487 INFO:teuthology.orchestra.run.smithi172.stdout:generic/557 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:55:37.496 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/557 2023-03-27T17:55:37.496 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/557 2023-03-27T17:55:37.497 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:37.502 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:37.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:37.542 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-03-27T17:55:37.954 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:37.965 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:37.966 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:37.968 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:37.969 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:38.447 INFO:teuthology.orchestra.run.smithi172.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-03-27T17:55:38.456 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/558 2023-03-27T17:55:38.456 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/558 2023-03-27T17:55:38.456 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:38.461 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:38.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:38.506 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-03-27T17:55:38.923 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:38.934 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:38.935 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:38.938 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:38.938 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:39.410 INFO:teuthology.orchestra.run.smithi172.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-03-27T17:55:39.419 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/559 2023-03-27T17:55:39.419 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/559 2023-03-27T17:55:39.419 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:39.425 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:39.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:39.470 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-03-27T17:55:39.881 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:39.892 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:39.893 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:39.895 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:39.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:40.388 INFO:teuthology.orchestra.run.smithi172.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-03-27T17:55:40.397 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/560 2023-03-27T17:55:40.397 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/560 2023-03-27T17:55:40.397 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:40.403 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:40.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:40.445 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-03-27T17:55:40.850 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:40.861 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:40.862 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:40.864 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:40.865 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:41.340 INFO:teuthology.orchestra.run.smithi172.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-03-27T17:55:41.349 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/561 2023-03-27T17:55:41.349 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/561 2023-03-27T17:55:41.349 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:41.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:41.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:41.393 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-03-27T17:55:41.804 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:41.816 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:41.817 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:41.819 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:42.688 INFO:teuthology.orchestra.run.smithi172.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:55:42.716 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/562 2023-03-27T17:55:42.716 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/562 2023-03-27T17:55:42.716 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:42.733 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:42.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:42.898 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-03-27T17:55:43.318 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:43.329 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:43.330 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:43.332 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:43.332 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:43.849 INFO:teuthology.orchestra.run.smithi172.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-03-27T17:55:43.867 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/563 2023-03-27T17:55:43.868 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/563 2023-03-27T17:55:43.868 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:43.873 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:43.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:43.915 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-03-27T17:55:44.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:55:44.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:55:44.329 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:44.340 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:44.341 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:44.344 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:44.344 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:44.936 INFO:teuthology.orchestra.run.smithi172.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-03-27T17:55:44.945 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/564 2023-03-27T17:55:44.945 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/564 2023-03-27T17:55:44.945 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:44.951 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:45.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:45.072 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-03-27T17:55:45.718 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:45.730 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:45.731 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:45.733 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:45.733 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:46.548 INFO:teuthology.orchestra.run.smithi172.stdout:generic/565 1s 2023-03-27T17:55:46.559 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/565 2023-03-27T17:55:46.559 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:46.565 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:46.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:46.743 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-03-27T17:55:47.340 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:47.351 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:47.352 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:47.354 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:47.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:47.829 INFO:teuthology.orchestra.run.smithi172.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T17:55:47.838 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/566 2023-03-27T17:55:47.838 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/566 2023-03-27T17:55:47.838 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:47.843 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:47.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:47.889 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-03-27T17:55:48.302 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:48.313 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:48.314 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:48.317 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:48.317 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:49.371 INFO:teuthology.orchestra.run.smithi172.stdout:generic/567 1s 2023-03-27T17:55:49.383 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/567 2023-03-27T17:55:49.383 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:49.388 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:49.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:49.407 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-03-27T17:55:49.818 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:49.832 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:49.833 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:49.836 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:49.836 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:50.328 INFO:teuthology.orchestra.run.smithi172.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T17:55:50.338 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/568 2023-03-27T17:55:50.338 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/568 2023-03-27T17:55:50.338 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:50.343 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:50.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:50.387 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-03-27T17:55:50.796 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:50.807 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:50.808 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:50.810 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:50.810 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:51.321 INFO:teuthology.orchestra.run.smithi172.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T17:55:51.330 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/569 2023-03-27T17:55:51.330 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/569 2023-03-27T17:55:51.330 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:51.335 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:51.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:51.383 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-03-27T17:55:51.792 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:51.803 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:51.804 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:51.806 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:51.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:52.294 INFO:teuthology.orchestra.run.smithi172.stdout:generic/570 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:55:52.303 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/570 2023-03-27T17:55:52.303 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/570 2023-03-27T17:55:52.304 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:52.309 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:52.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:52.354 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-03-27T17:55:52.767 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:52.778 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:52.779 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:52.781 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:52.781 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:53.283 INFO:teuthology.orchestra.run.smithi172.stdout:generic/571 [not run] Require fcntl setlease support 2023-03-27T17:55:53.292 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/571 2023-03-27T17:55:53.292 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/571 2023-03-27T17:55:53.292 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:53.297 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:53.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:53.343 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-03-27T17:55:53.760 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:53.771 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:53.772 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:53.774 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:53.774 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:54.262 INFO:teuthology.orchestra.run.smithi172.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-03-27T17:55:54.271 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/572 2023-03-27T17:55:54.271 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/572 2023-03-27T17:55:54.271 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:54.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:54.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:54.318 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-03-27T17:55:54.730 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:54.741 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:54.742 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:54.744 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:54.744 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:55.229 INFO:teuthology.orchestra.run.smithi172.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-03-27T17:55:55.238 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/573 2023-03-27T17:55:55.238 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/573 2023-03-27T17:55:55.238 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:55.243 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:55.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:55.281 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-03-27T17:55:55.699 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:55.710 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:55.711 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:55.714 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:55.714 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:56.188 INFO:teuthology.orchestra.run.smithi172.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-03-27T17:55:56.196 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/574 2023-03-27T17:55:56.197 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/574 2023-03-27T17:55:56.197 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:56.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:56.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:56.241 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-03-27T17:55:56.649 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:56.659 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:56.660 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:56.662 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:56.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:57.147 INFO:teuthology.orchestra.run.smithi172.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-03-27T17:55:57.156 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/575 2023-03-27T17:55:57.156 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/575 2023-03-27T17:55:57.156 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:57.162 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:57.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:57.204 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-03-27T17:55:57.615 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:57.627 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:57.628 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:57.630 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:57.630 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-03-27T17:55:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/576 2023-03-27T17:55:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/576 2023-03-27T17:55:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:58.188 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:58.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:58.232 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-03-27T17:55:58.641 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:58.652 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:58.653 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:58.655 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:58.656 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:59.146 INFO:teuthology.orchestra.run.smithi172.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-03-27T17:55:59.156 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/577 2023-03-27T17:55:59.156 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/577 2023-03-27T17:55:59.157 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:55:59.161 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:55:59.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:55:59.199 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-03-27T17:55:59.607 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:55:59.618 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:55:59.619 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:55:59.621 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:55:59.621 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:00.170 INFO:teuthology.orchestra.run.smithi172.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T17:56:00.179 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/578 2023-03-27T17:56:00.179 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/578 2023-03-27T17:56:00.179 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:00.185 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:00.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:00.358 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-03-27T17:56:00.963 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:00.974 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:00.975 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:00.978 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:00.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:01.476 INFO:teuthology.orchestra.run.smithi172.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-03-27T17:56:01.485 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/579 2023-03-27T17:56:01.486 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/579 2023-03-27T17:56:01.486 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:01.491 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:01.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:01.531 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-03-27T17:56:01.948 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:01.959 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:01.960 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:01.963 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:01.963 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:02.752 INFO:teuthology.orchestra.run.smithi172.stdout:generic/580 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:02.790 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/580 2023-03-27T17:56:02.791 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/580 2023-03-27T17:56:02.791 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:02.796 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:02.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:02.835 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-03-27T17:56:03.247 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:03.258 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:03.259 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:03.262 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:03.262 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:04.479 INFO:teuthology.orchestra.run.smithi172.stdout:generic/581 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:04.516 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/581 2023-03-27T17:56:04.517 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/581 2023-03-27T17:56:04.517 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:04.522 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:04.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:04.556 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-03-27T17:56:04.970 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:04.981 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:04.982 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:04.985 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:04.985 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:05.789 INFO:teuthology.orchestra.run.smithi172.stdout:generic/582 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:05.822 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/582 2023-03-27T17:56:05.823 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/582 2023-03-27T17:56:05.823 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:05.828 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:05.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:05.871 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-03-27T17:56:06.280 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:06.291 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:06.292 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:06.294 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:06.295 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:07.091 INFO:teuthology.orchestra.run.smithi172.stdout:generic/583 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:07.123 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/583 2023-03-27T17:56:07.124 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/583 2023-03-27T17:56:07.124 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:07.130 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:07.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:07.168 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-03-27T17:56:07.581 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:07.592 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:07.593 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:07.595 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:07.595 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:08.402 INFO:teuthology.orchestra.run.smithi172.stdout:generic/584 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:08.439 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/584 2023-03-27T17:56:08.439 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/584 2023-03-27T17:56:08.439 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:08.445 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:08.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:08.483 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-03-27T17:56:08.893 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:08.904 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:08.905 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:08.908 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:08.908 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:09.439 INFO:teuthology.orchestra.run.smithi172.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-03-27T17:56:09.448 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/585 2023-03-27T17:56:09.448 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/585 2023-03-27T17:56:09.448 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:09.454 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:09.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:09.599 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-03-27T17:56:10.210 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:10.221 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:10.222 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:10.224 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:10.225 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:10.804 INFO:teuthology.orchestra.run.smithi172.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T17:56:10.813 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/586 2023-03-27T17:56:10.813 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/586 2023-03-27T17:56:10.814 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:10.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:10.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:10.968 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-03-27T17:56:11.573 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:11.585 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:11.586 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:11.588 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:11.588 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:12.117 INFO:teuthology.orchestra.run.smithi172.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T17:56:12.126 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/587 2023-03-27T17:56:12.126 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/587 2023-03-27T17:56:12.126 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:12.131 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:12.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:12.175 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-03-27T17:56:12.587 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:12.598 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:12.599 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:12.601 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:12.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:13.546 INFO:teuthology.orchestra.run.smithi172.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:56:13.580 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/588 2023-03-27T17:56:13.580 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/588 2023-03-27T17:56:13.581 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:13.596 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:13.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:13.716 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-03-27T17:56:14.129 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:14.140 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:14.141 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:14.144 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:14.144 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:14.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:56:14.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:56:14.669 INFO:teuthology.orchestra.run.smithi172.stdout:generic/589 [not run] require 172.21.15.172:6789:/scratch to be local device 2023-03-27T17:56:14.678 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/589 2023-03-27T17:56:14.678 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/589 2023-03-27T17:56:14.678 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:14.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:14.726 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-03-27T17:56:15.136 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:15.147 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:15.148 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:15.150 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:15.643 INFO:teuthology.orchestra.run.smithi172.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T17:56:15.652 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/590 2023-03-27T17:56:15.652 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/590 2023-03-27T17:56:15.652 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:15.658 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:15.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:15.708 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-03-27T17:56:16.127 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:16.138 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:16.139 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:16.141 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:16.141 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:16.774 INFO:teuthology.orchestra.run.smithi172.stdout:generic/591 0s 2023-03-27T17:56:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/591 2023-03-27T17:56:16.832 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:16.832 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:16.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:16.904 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-03-27T17:56:17.551 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:17.562 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:17.563 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:17.566 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:17.566 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:18.559 INFO:teuthology.orchestra.run.smithi172.stdout:generic/592 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:18.587 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/592 2023-03-27T17:56:18.588 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/592 2023-03-27T17:56:18.588 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:18.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:18.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:18.631 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-03-27T17:56:19.048 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:19.058 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:19.059 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:19.062 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:19.062 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:19.867 INFO:teuthology.orchestra.run.smithi172.stdout:generic/593 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:19.905 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/593 2023-03-27T17:56:19.906 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/593 2023-03-27T17:56:19.906 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:19.911 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:19.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:19.953 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-03-27T17:56:20.373 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:20.385 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:20.386 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:20.388 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:20.388 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:20.897 INFO:teuthology.orchestra.run.smithi172.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T17:56:20.906 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/594 2023-03-27T17:56:20.906 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/594 2023-03-27T17:56:20.906 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:20.911 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:20.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:20.955 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-03-27T17:56:21.379 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:21.390 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:21.392 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:21.394 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:21.394 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:22.227 INFO:teuthology.orchestra.run.smithi172.stdout:generic/595 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:22.258 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/595 2023-03-27T17:56:22.258 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/595 2023-03-27T17:56:22.259 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:22.264 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:22.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:22.305 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-03-27T17:56:22.719 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:22.730 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:22.731 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:22.734 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:22.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:23.308 INFO:teuthology.orchestra.run.smithi172.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-03-27T17:56:23.317 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/596 2023-03-27T17:56:23.317 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/596 2023-03-27T17:56:23.317 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:23.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:23.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:23.382 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-03-27T17:56:23.793 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:23.804 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:23.806 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:23.808 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:23.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:25.048 INFO:teuthology.orchestra.run.smithi172.stdout:generic/597 1s 2023-03-27T17:56:25.059 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/597 2023-03-27T17:56:25.059 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:25.064 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:25.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:25.202 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-03-27T17:56:25.839 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:25.851 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:25.852 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:25.855 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:25.855 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:27.142 INFO:teuthology.orchestra.run.smithi172.stdout:generic/598 1s 2023-03-27T17:56:27.154 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/598 2023-03-27T17:56:27.154 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:27.159 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:27.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:27.337 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-03-27T17:56:27.909 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:27.921 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:27.922 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:27.924 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:27.924 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:28.563 INFO:teuthology.orchestra.run.smithi172.stdout:generic/599 [not run] ceph does not support shutdown 2023-03-27T17:56:28.592 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/599 2023-03-27T17:56:28.593 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/599 2023-03-27T17:56:28.593 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:28.598 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:28.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:28.635 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-03-27T17:56:29.046 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:29.057 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:29.058 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:29.061 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:29.061 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:29.540 INFO:teuthology.orchestra.run.smithi172.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T17:56:29.548 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/600 2023-03-27T17:56:29.549 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/600 2023-03-27T17:56:29.549 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:29.554 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:29.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:29.593 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-03-27T17:56:30.009 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:30.020 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:30.021 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:30.024 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:30.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:30.507 INFO:teuthology.orchestra.run.smithi172.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T17:56:30.516 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/601 2023-03-27T17:56:30.516 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/601 2023-03-27T17:56:30.516 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:30.522 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:30.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:30.564 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-03-27T17:56:30.974 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:30.985 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:30.986 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:30.988 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:30.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:31.963 INFO:teuthology.orchestra.run.smithi172.stdout:generic/602 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:31.990 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/602 2023-03-27T17:56:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/602 2023-03-27T17:56:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:32.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:32.045 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-03-27T17:56:32.462 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:32.473 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:32.474 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:32.477 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:32.477 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:32.966 INFO:teuthology.orchestra.run.smithi172.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T17:56:32.975 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/603 2023-03-27T17:56:32.975 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/603 2023-03-27T17:56:32.976 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:32.981 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:33.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:33.026 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-03-27T17:56:33.445 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:33.456 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:33.457 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:33.459 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:33.460 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:38.171 INFO:teuthology.orchestra.run.smithi172.stdout:generic/604 5s 2023-03-27T17:56:38.183 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/604 2023-03-27T17:56:38.183 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:38.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:38.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:38.208 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-03-27T17:56:38.616 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:38.627 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:38.628 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:38.631 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:38.631 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:40.706 INFO:teuthology.orchestra.run.smithi172.stdout:generic/605 [not run] mount 172.21.15.172:6789:/scratch with dax=always failed 2023-03-27T17:56:40.715 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/605 2023-03-27T17:56:40.715 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/605 2023-03-27T17:56:40.716 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:40.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:40.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:40.763 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-03-27T17:56:41.178 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:41.189 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:41.190 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:41.192 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:41.192 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:41.801 INFO:teuthology.orchestra.run.smithi172.stdout:generic/606 [not run] mount 172.21.15.172:6789:/scratch with dax=always failed 2023-03-27T17:56:41.809 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/606 2023-03-27T17:56:41.810 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/606 2023-03-27T17:56:41.810 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:41.815 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:41.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:41.860 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-03-27T17:56:42.270 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:42.281 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:42.282 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:42.285 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:42.285 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:42.805 INFO:teuthology.orchestra.run.smithi172.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-03-27T17:56:42.814 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/607 2023-03-27T17:56:42.814 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/607 2023-03-27T17:56:42.815 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:42.820 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:42.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:42.960 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-03-27T17:56:43.597 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:43.608 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:43.609 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:43.611 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:43.611 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:44.213 INFO:teuthology.orchestra.run.smithi172.stdout:generic/608 [not run] mount 172.21.15.172:6789:/scratch with dax=always failed 2023-03-27T17:56:44.222 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/608 2023-03-27T17:56:44.222 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/608 2023-03-27T17:56:44.223 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:44.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:44.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:44.272 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-03-27T17:56:44.432 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:56:44.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:56:44.686 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:44.697 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:44.698 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:44.700 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:44.701 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:45.415 INFO:teuthology.orchestra.run.smithi172.stdout:generic/609 1s 2023-03-27T17:56:45.427 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/609 2023-03-27T17:56:45.427 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:45.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:45.610 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-03-27T17:56:46.219 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:46.231 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:46.231 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:46.234 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:46.234 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:46.871 INFO:teuthology.orchestra.run.smithi172.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T17:56:46.880 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/610 2023-03-27T17:56:46.880 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/610 2023-03-27T17:56:46.881 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:46.886 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:46.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:46.934 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-03-27T17:56:47.350 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:47.361 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:47.362 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:47.365 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:47.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:48.254 INFO:teuthology.orchestra.run.smithi172.stdout:generic/611 1s 2023-03-27T17:56:48.265 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/611 2023-03-27T17:56:48.265 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:48.271 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:48.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:48.290 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-03-27T17:56:48.699 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:48.710 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:48.711 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:48.713 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:48.713 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:49.275 INFO:teuthology.orchestra.run.smithi172.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T17:56:49.284 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/612 2023-03-27T17:56:49.284 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/612 2023-03-27T17:56:49.284 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:49.289 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:49.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:49.457 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-03-27T17:56:50.061 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:50.073 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:50.074 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:50.076 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:50.076 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:50.864 INFO:teuthology.orchestra.run.smithi172.stdout:generic/613 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:56:50.902 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/613 2023-03-27T17:56:50.903 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/613 2023-03-27T17:56:50.903 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:50.908 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:50.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:50.949 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-03-27T17:56:51.368 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:51.379 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:51.380 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:51.382 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:51.382 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:52.314 INFO:teuthology.orchestra.run.smithi172.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-03-27T17:56:52.351 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/614 2023-03-27T17:56:52.351 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/614 2023-03-27T17:56:52.352 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:56:52.357 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:56:52.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:56:52.403 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-03-27T17:56:52.813 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:56:52.824 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:56:52.825 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:56:52.828 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:56:52.828 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:14.580 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:57:14.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:57:42.169 INFO:teuthology.orchestra.run.smithi172.stdout:generic/615 49s 2023-03-27T17:57:42.181 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/615 2023-03-27T17:57:42.181 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:42.186 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:42.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:42.206 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-03-27T17:57:42.619 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:42.630 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:42.631 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:42.633 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:42.634 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:43.121 INFO:teuthology.orchestra.run.smithi172.stdout:generic/616 [not run] kernel does not support IO_URING 2023-03-27T17:57:43.129 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/616 2023-03-27T17:57:43.130 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/616 2023-03-27T17:57:43.130 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:43.135 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:43.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:43.181 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-03-27T17:57:43.594 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:43.605 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:43.606 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:43.608 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:43.608 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:44.157 INFO:teuthology.orchestra.run.smithi172.stdout:generic/617 [not run] kernel does not support IO_URING 2023-03-27T17:57:44.166 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/617 2023-03-27T17:57:44.166 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/617 2023-03-27T17:57:44.166 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:44.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:44.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:44.233 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-03-27T17:57:44.653 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:44.665 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:44.665 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:44.668 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:44.668 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:44.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:57:44.768 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:57:45.571 INFO:teuthology.orchestra.run.smithi172.stdout:generic/618 1s 2023-03-27T17:57:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/618 2023-03-27T17:57:45.583 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:45.588 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:45.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:45.607 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-03-27T17:57:46.057 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:46.068 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:46.069 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:46.072 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:46.072 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:46.587 INFO:teuthology.orchestra.run.smithi172.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T17:57:46.596 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/619 2023-03-27T17:57:46.596 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/619 2023-03-27T17:57:46.596 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:46.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:46.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:46.657 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-03-27T17:57:47.074 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:47.085 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:47.086 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:47.089 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:47.089 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:47.651 INFO:teuthology.orchestra.run.smithi172.stdout:generic/620 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:57:47.660 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/620 2023-03-27T17:57:47.660 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/620 2023-03-27T17:57:47.661 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:47.666 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:47.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:47.704 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-03-27T17:57:48.129 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:48.140 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:48.141 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:48.144 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:48.144 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:48.950 INFO:teuthology.orchestra.run.smithi172.stdout:generic/621 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T17:57:48.985 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/621 2023-03-27T17:57:48.986 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/621 2023-03-27T17:57:48.986 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:48.991 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:49.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:49.033 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-03-27T17:57:49.443 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:49.454 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:49.455 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:49.458 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:49.458 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:50.124 INFO:teuthology.orchestra.run.smithi172.stdout:generic/622 [not run] ceph does not support shutdown 2023-03-27T17:57:50.159 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/622 2023-03-27T17:57:50.159 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/622 2023-03-27T17:57:50.160 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:50.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:50.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:50.203 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-03-27T17:57:50.612 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:50.623 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:50.624 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:50.626 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:50.627 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:51.261 INFO:teuthology.orchestra.run.smithi172.stdout:generic/623 [not run] ceph does not support shutdown 2023-03-27T17:57:51.288 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/623 2023-03-27T17:57:51.289 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/623 2023-03-27T17:57:51.289 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:51.294 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:51.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:51.338 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-03-27T17:57:51.749 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:51.760 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:51.761 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:51.764 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:51.764 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:52.250 INFO:teuthology.orchestra.run.smithi172.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-03-27T17:57:52.259 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/624 2023-03-27T17:57:52.259 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/624 2023-03-27T17:57:52.259 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:52.264 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:52.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:52.306 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-03-27T17:57:52.718 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:52.729 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:52.730 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:52.733 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:52.733 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:53.222 INFO:teuthology.orchestra.run.smithi172.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-03-27T17:57:53.231 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/625 2023-03-27T17:57:53.232 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/625 2023-03-27T17:57:53.232 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:53.237 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:53.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:53.280 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-03-27T17:57:53.695 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:53.706 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:53.707 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:53.709 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:53.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:54.250 INFO:teuthology.orchestra.run.smithi172.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-03-27T17:57:54.259 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/626 2023-03-27T17:57:54.259 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/626 2023-03-27T17:57:54.259 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:54.265 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:54.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:54.424 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-03-27T17:57:55.026 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:55.038 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:55.039 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:55.041 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:55.041 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:55.616 INFO:teuthology.orchestra.run.smithi172.stdout:generic/627 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:57:55.625 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/627 2023-03-27T17:57:55.625 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/627 2023-03-27T17:57:55.625 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:55.630 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:55.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:55.680 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-03-27T17:57:56.092 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:56.104 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:56.105 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:56.107 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:56.107 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:57.048 INFO:teuthology.orchestra.run.smithi172.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T17:57:57.104 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/628 2023-03-27T17:57:57.104 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/628 2023-03-27T17:57:57.104 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:57.125 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:57.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:57.276 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-03-27T17:57:57.691 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:57.702 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:57.703 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:57.706 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:57.706 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:generic/629 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:57:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/629 2023-03-27T17:57:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/629 2023-03-27T17:57:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:58.244 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:58.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:58.287 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-03-27T17:57:58.703 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:57:58.714 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:57:58.715 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:57:58.717 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:57:58.717 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:59.423 INFO:teuthology.orchestra.run.smithi172.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-27T17:57:59.600 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/630 2023-03-27T17:57:59.601 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/630 2023-03-27T17:57:59.601 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:57:59.628 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:57:59.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:57:59.848 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-03-27T17:58:00.267 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:00.282 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:00.282 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:14.867 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:58:14.872 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:58:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:generic/631 - output mismatch (see /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/results//generic/631.out.bad) 2023-03-27T17:58:31.531 INFO:teuthology.orchestra.run.smithi172.stdout: --- tests/generic/631.out 2023-03-27 10:11:11.384573708 +0000 2023-03-27T17:58:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: +++ /tmp/tmp.Bd5h2Tmv1Lxfstests-dev/results//generic/631.out.bad 2023-03-27 17:58:31.480509363 +0000 2023-03-27T17:58:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: @@ -1,2 +1,4784 @@ 2023-03-27T17:58:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: QA output created by 631 2023-03-27T17:58:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.532 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.533 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.534 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted./tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directorymv: 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf' 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directorymv: 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: mount: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf'/tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2023-03-27T17:58:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: mv: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-27T17:58:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted./tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted.umount: 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.715 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directorymv: 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.716 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.717 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.718 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.719 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.720 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.721 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.722 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.723 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.724 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.727 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.728 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.729 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.730 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.731 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.732 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.733 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.734 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.735 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.736 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.737 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.738 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.739 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.740 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory: No such file or directorymv: 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: +cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.741 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.742 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.743 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.744 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.745 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.746 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.747 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.748 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted./tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.749 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.750 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted./tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.751 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.752 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.753 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.754 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.755 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.756 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.757 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.758 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.759 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.760 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.761 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.762 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.763 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.764 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.765 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.766 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.767 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.768 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.769 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.770 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.771 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.772 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.773 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.774 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.775 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.776 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.778 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.779 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.780 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.781 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.782 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.783 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.784 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.785 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.786 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.787 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.788 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.789 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.790 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.791 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.792 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.793 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.794 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.795 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.796 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.797 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.798 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: touch: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.799 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.800 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.801 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.802 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.803 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.804 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.805 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.806 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.807 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.808 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.809 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.810 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.811 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.812 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.813 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.814 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.815 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.816 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.817 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.818 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.819 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.820 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.821 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.823 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.824 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.825 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.826 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.827 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.828 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.829 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.830 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.833 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.834 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.835 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.836 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: touch: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.837 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.838 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.839 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.840 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.841 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.842 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.843 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.844 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.845 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.846 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.847 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.848 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.849 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.850 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.851 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.852 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.853 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.854 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted.umount: 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.856 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.857 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.858 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.862 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.863 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.864 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.865 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.866 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.867 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.868 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.869 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.870 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.871 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.872 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.873 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.874 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.875 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.876 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.877 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.878 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.878 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.878 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.878 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.878 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.878 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.879 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.881 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.882 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.883 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.884 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.885 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.886 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.887 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.888 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.889 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.890 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.891 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.892 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted.umount: 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.893 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.894 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.895 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.896 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.897 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.898 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.899 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.900 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.901 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.902 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.903 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.904 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.905 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.906 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.907 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.908 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.909 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.910 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.911 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.912 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.913 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.914 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.915 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.916 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.917 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.918 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.919 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.920 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.921 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.922 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.923 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.924 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.925 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.926 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.927 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.928 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.929 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.930 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.931 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.932 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf' 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.946 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.947 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.948 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.949 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.950 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.951 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.952 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.953 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.954 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.955 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.956 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.957 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.958 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.959 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.960 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.961 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.962 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.963 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.964 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.966 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.967 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.968 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.969 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.970 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.971 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.972 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.973 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.974 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.975 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.976 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.977 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.978 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.979 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.980 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.981 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.982 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.983 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.984 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.985 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.986 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.987 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.988 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.989 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.990 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.991 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.992 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.993 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.994 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.995 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.996 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:31.997 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.998 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:31.999 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.000 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.001 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.002 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.003 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directorymv: 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.004 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.005 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.006 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf' 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.007 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.008 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: touch: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted.cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf' 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.009 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.010 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.011 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.012 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.013 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.014 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.015 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.016 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.017 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.018 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.019 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.020 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.021 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf' 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.022 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.023 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.024 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.025 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.027 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.028 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.029 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.030 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.031 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.032 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.033 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.034 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.035 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.036 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.037 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.038 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.039 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.040 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.041 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.042 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.044 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.045 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.045 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.045 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.045 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.045 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.045 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.047 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.048 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.048 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.048 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.048 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.048 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.048 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.049 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.050 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.051 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.052 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.053 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.054 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.055 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.056 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.057 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.058 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.059 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.060 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.061 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.062 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.063 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.064 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.065 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.066 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.067 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.068 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.069 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.070 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.071 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf' 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.072 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directorytouch: 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.073 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.074 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.075 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.076 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.077 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.078 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.079 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.080 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf' 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +: No such file or directory 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.081 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.082 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.083 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.084 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.085 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.086 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.087 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.087 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.087 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.087 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.087 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.087 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.088 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.089 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.090 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.090 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.090 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.090 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.090 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.090 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.091 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.092 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted.umount: 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.093 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.094 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.095 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.096 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.097 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.098 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.099 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.100 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.101 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.102 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.103 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.104 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.104 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.104 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.104 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.104 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-03-27T17:58:32.104 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.105 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.106 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.107 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.108 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.109 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.110 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.111 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.112 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.114 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.115 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.116 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.117 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.118 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.119 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.120 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.121 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.122 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.123 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.125 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.126 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted./tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.127 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.128 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.129 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.130 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.131 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.132 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.133 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.134 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.136 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.137 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.138 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.139 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: mount: mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.140 INFO:teuthology.orchestra.run.smithi172.stdout: + 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.141 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.142 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +/tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.143 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.144 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.145 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged5/etc/access.conf': No such file or directory 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged5: not mounted. 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged2/etc/access.conf': No such file or directory 2023-03-27T17:58:32.146 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged2: not mounted. 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged0/etc/access.conf': No such file or directory 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged0: not mounted. 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.147 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged1/etc/access.conf': No such file or directory 2023-03-27T17:58:32.148 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged3/etc/access.conf': No such file or directory 2023-03-27T17:58:32.149 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged1: not mounted. 2023-03-27T17:58:32.149 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged3: not mounted. 2023-03-27T17:58:32.149 INFO:teuthology.orchestra.run.smithi172.stdout: +mount: /tmp/tmp.4XPvpb2vjxscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-03-27T17:58:32.149 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.149 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.149 INFO:teuthology.orchestra.run.smithi172.stdout: +mv: cannot stat '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout: +touch: cannot touch '/tmp/tmp.4XPvpb2vjxscratch/merged4/etc/access.conf': No such file or directory 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout: +umount: /tmp/tmp.4XPvpb2vjxscratch/merged4: not mounted. 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout: Silence is golden. 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout:HINT: You _MAY_ be missing kernel fix: 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:32.150 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/631 2023-03-27T17:58:32.151 INFO:teuthology.orchestra.run.smithi172.stdout:Failures: generic/631 2023-03-27T17:58:32.151 INFO:teuthology.orchestra.run.smithi172.stdout:Failed 1 of 1 tests 2023-03-27T17:58:32.151 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:32.151 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-03-27T17:58:32.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-03-27T17:58:32.152 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-03-27T17:58:32.562 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:32.573 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:32.574 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:32.576 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:32.576 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:34.519 INFO:teuthology.orchestra.run.smithi172.stdout:generic/632 2s 2023-03-27T17:58:34.531 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/632 2023-03-27T17:58:34.531 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:34.536 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:34.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:34.580 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-03-27T17:58:34.989 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:35.001 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:35.002 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:35.004 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:35.004 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:35.807 INFO:teuthology.orchestra.run.smithi172.stdout:generic/633 0s 2023-03-27T17:58:35.818 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/633 2023-03-27T17:58:35.818 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:35.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:35.985 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-03-27T17:58:36.609 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:36.620 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:36.621 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:36.623 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:36.624 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:38.070 INFO:teuthology.orchestra.run.smithi172.stdout:generic/634 2s 2023-03-27T17:58:38.083 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/634 2023-03-27T17:58:38.083 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:38.088 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:38.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:38.107 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-03-27T17:58:38.513 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:38.524 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:38.525 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:38.528 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:38.528 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:39.184 INFO:teuthology.orchestra.run.smithi172.stdout:generic/635 [not run] ceph does not support shutdown 2023-03-27T17:58:39.213 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/635 2023-03-27T17:58:39.214 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/635 2023-03-27T17:58:39.214 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:39.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:39.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:39.257 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-03-27T17:58:39.668 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:39.679 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:39.680 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:39.682 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:39.682 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:40.411 INFO:teuthology.orchestra.run.smithi172.stdout:generic/636 [not run] swapfiles are not supported 2023-03-27T17:58:40.420 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/636 2023-03-27T17:58:40.420 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/636 2023-03-27T17:58:40.421 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:40.426 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:40.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:40.467 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-03-27T17:58:40.875 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:40.886 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:40.888 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:40.890 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:40.890 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:41.825 INFO:teuthology.orchestra.run.smithi172.stdout:generic/637 0s 2023-03-27T17:58:41.836 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/637 2023-03-27T17:58:41.837 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:41.842 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:42.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:42.153 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-03-27T17:58:42.628 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:42.639 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:42.640 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:42.642 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:42.643 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:43.193 INFO:teuthology.orchestra.run.smithi172.stdout:generic/638 1s 2023-03-27T17:58:43.205 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/638 2023-03-27T17:58:43.205 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:43.211 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:43.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:43.255 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-03-27T17:58:43.665 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:43.676 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:43.677 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:43.679 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:43.679 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:44.342 INFO:teuthology.orchestra.run.smithi172.stdout:generic/639 1s 2023-03-27T17:58:44.354 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/639 2023-03-27T17:58:44.354 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:44.359 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:44.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:44.416 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-03-27T17:58:44.822 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:44.833 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:44.834 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:44.836 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:44.836 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:45.344 INFO:teuthology.orchestra.run.smithi172.stdout:generic/640 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T17:58:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/640 2023-03-27T17:58:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/640 2023-03-27T17:58:45.353 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:45.359 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:45.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:45.401 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-03-27T17:58:45.811 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:45.822 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:45.823 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:45.825 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:45.826 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:46.569 INFO:teuthology.orchestra.run.smithi172.stdout:generic/641 [not run] swapfiles are not supported 2023-03-27T17:58:46.578 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/641 2023-03-27T17:58:46.578 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/641 2023-03-27T17:58:46.578 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T17:58:46.583 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:46.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T17:58:46.629 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-03-27T17:58:47.037 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T17:58:47.048 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T17:58:47.049 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T17:58:47.051 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T17:58:47.052 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T17:58:48.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:58:48.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:59:18.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:59:18.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T17:59:18.532 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T17:59:18.535+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 695521) UID: 0 2023-03-27T17:59:18.533 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T17:59:18.535+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 695521) UID: 0 2023-03-27T18:03:08.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:03:08.445 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:03:38.625 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:03:38.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:03:38.739 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T18:03:38.742+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 695626) UID: 0 2023-03-27T18:03:38.740 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T18:03:38.742+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 695626) UID: 0 2023-03-27T18:06:53.773 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:06:53.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:07:23.943 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:07:23.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:07:54.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:07:54.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:07:54.149 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T18:07:54.151+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 695737) UID: 0 2023-03-27T18:07:54.149 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T18:07:54.151+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 695737) UID: 0 2023-03-27T18:11:10.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:11:10.334 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:11:10.571 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T18:11:10.573+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695794) UID: 0 2023-03-27T18:11:10.572 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T18:11:10.573+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695794) UID: 0 2023-03-27T18:11:10.572 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T18:11:10.573+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695794) UID: 0 2023-03-27T18:11:10.573 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T18:11:10.573+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695794) UID: 0 2023-03-27T18:12:51.102 INFO:teuthology.orchestra.run.smithi172.stdout:generic/642 842s 2023-03-27T18:12:51.237 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/642 2023-03-27T18:12:51.238 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:12:51.243 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:12:51.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:12:51.263 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-03-27T18:12:52.913 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:12:52.924 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:12:52.925 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:12:52.927 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:12:52.927 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:14:38.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:14:38.211 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:14:38.337 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T18:14:38.340+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 696157) UID: 0 2023-03-27T18:14:38.338 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T18:14:38.340+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 696157) UID: 0 2023-03-27T18:16:47.891 INFO:teuthology.orchestra.run.smithi172.stdout:generic/643 [not run] swapfiles are not supported 2023-03-27T18:16:47.900 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/643 2023-03-27T18:16:47.900 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/643 2023-03-27T18:16:47.900 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:47.905 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:47.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:47.961 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-03-27T18:16:48.375 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:48.386 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:48.387 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:48.389 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:48.389 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:48.894 INFO:teuthology.orchestra.run.smithi172.stdout:generic/644 [not run] vfstest not support by ceph 2023-03-27T18:16:48.903 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/644 2023-03-27T18:16:48.903 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/644 2023-03-27T18:16:48.903 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:48.908 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:48.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:48.944 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-03-27T18:16:49.356 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:49.367 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:49.368 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:49.370 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:49.370 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:49.846 INFO:teuthology.orchestra.run.smithi172.stdout:generic/645 [not run] vfstest not support by ceph 2023-03-27T18:16:49.855 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/645 2023-03-27T18:16:49.855 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/645 2023-03-27T18:16:49.856 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:49.861 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:49.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:49.911 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-03-27T18:16:50.322 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:50.334 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:50.337 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:50.337 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:50.984 INFO:teuthology.orchestra.run.smithi172.stdout:generic/646 [not run] ceph does not support shutdown 2023-03-27T18:16:51.010 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/646 2023-03-27T18:16:51.010 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/646 2023-03-27T18:16:51.010 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:51.015 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:51.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:51.050 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-03-27T18:16:51.464 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:51.475 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:51.476 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:51.478 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:51.478 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:52.250 INFO:teuthology.orchestra.run.smithi172.stdout:generic/647 1s 2023-03-27T18:16:52.261 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/647 2023-03-27T18:16:52.262 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:52.267 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:52.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:52.399 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-03-27T18:16:53.112 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:53.123 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:53.124 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:53.126 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:53.126 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:54.779 INFO:teuthology.orchestra.run.smithi172.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T18:16:54.806 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/648 2023-03-27T18:16:54.807 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/648 2023-03-27T18:16:54.807 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:54.827 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:54.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:54.890 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-03-27T18:16:55.300 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:55.311 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:55.312 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:55.314 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:55.314 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:55.882 INFO:teuthology.orchestra.run.smithi172.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-03-27T18:16:55.891 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/649 2023-03-27T18:16:55.891 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/649 2023-03-27T18:16:55.891 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T18:16:55.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:16:56.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T18:16:56.051 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-03-27T18:16:56.773 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T18:16:56.783 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T18:16:56.784 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T18:16:56.787 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T18:16:56.787 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T18:19:35.907 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T18:19:35.909+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700669) UID: 0 2023-03-27T18:19:35.908 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T18:19:35.911+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700669) UID: 0 2023-03-27T18:19:35.913 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T18:19:35.915+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700669) UID: 0 2023-03-27T18:19:35.914 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T18:19:35.909+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 700669) UID: 0 2023-03-27T18:27:09.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:27:09.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:27:39.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:27:39.866 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:28:10.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:28:10.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:28:40.466 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:28:40.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:29:10.819 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:29:10.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:29:41.593 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:29:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:30:11.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:30:11.860 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:30:42.117 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:30:42.123 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:31:12.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:31:12.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:31:42.774 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:31:42.781 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:32:13.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:32:13.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:32:43.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:32:43.371 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:33:13.709 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:33:13.732 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:33:44.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:33:44.082 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:33:44.388 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T18:33:44.389+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705380) UID: 0 2023-03-27T18:33:44.388 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T18:33:44.389+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705380) UID: 0 2023-03-27T18:33:44.389 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T18:33:44.390+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705380) UID: 0 2023-03-27T18:33:44.392 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T18:33:44.390+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705380) UID: 0 2023-03-27T18:38:08.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:38:08.712 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:38:39.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:38:39.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:39:09.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:39:09.359 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:39:39.603 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:39:39.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:40:09.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:40:09.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:40:40.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:40:40.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:41:10.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:41:10.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:41:40.692 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:41:40.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:41:40.801 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T18:41:40.803+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137159) UID: 0 2023-03-27T18:41:40.801 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T18:41:40.803+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137159) UID: 0 2023-03-27T18:41:40.802 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T18:41:40.803+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137159) UID: 0 2023-03-27T18:41:40.802 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T18:41:40.803+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137159) UID: 0 2023-03-27T18:44:28.786 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:44:28.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:44:29.139 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T18:44:29.141+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 709006) UID: 0 2023-03-27T18:44:29.139 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T18:44:29.141+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 709006) UID: 0 2023-03-27T18:49:17.155 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:49:17.162 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:49:47.528 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:49:47.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:50:17.935 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:50:17.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:50:48.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:50:48.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:51:18.537 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:51:18.557 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:51:48.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:51:48.964 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:52:19.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:52:19.330 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:52:49.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:52:49.755 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:53:19.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:53:20.011 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:53:50.137 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:53:50.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:54:20.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:54:20.506 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:54:50.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:54:50.755 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:55:20.964 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:55:20.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:55:51.279 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:55:51.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:56:21.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:56:21.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:56:51.919 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:56:51.937 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:57:22.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:57:22.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:57:52.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:57:52.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:58:22.943 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:58:22.949 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:58:53.280 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:58:53.287 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:59:23.605 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:59:23.610 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:59:53.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T18:59:53.897 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:00:24.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:00:24.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:00:54.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:00:54.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:01:24.864 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:01:24.879 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:01:55.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:01:55.152 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:02:25.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:02:25.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:02:55.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:02:55.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:03:25.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:03:26.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:03:56.271 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:03:56.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:04:26.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:04:26.509 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:04:56.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:04:56.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:05:27.124 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:05:27.130 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:05:57.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:05:57.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:06:28.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:06:28.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:06:58.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:06:58.502 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:07:28.817 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:07:28.822 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:07:59.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:07:59.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:08:29.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:08:29.560 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:08:59.954 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:08:59.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:09:30.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:09:30.154 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:10:00.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:10:00.496 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:10:30.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:10:30.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:11:00.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:11:00.950 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:11:31.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:11:31.131 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:12:01.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:12:01.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:12:31.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:12:31.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:13:02.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:13:02.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:13:32.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:13:32.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:14:02.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:14:02.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:14:32.836 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:14:32.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:15:03.196 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:15:03.210 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:15:33.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:15:33.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:16:04.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:16:04.035 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:16:04.187 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T19:16:04.187+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 720058) UID: 0 2023-03-27T19:16:04.188 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T19:16:04.187+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 720058) UID: 0 2023-03-27T19:21:24.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:21:24.216 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:21:54.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:21:54.571 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:22:25.874 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:22:25.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:22:56.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:22:56.206 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:23:26.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:23:26.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:23:56.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:23:56.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:24:27.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:24:27.066 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:24:57.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:24:57.335 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:25:27.633 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:25:27.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:26:01.923 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:26:01.936 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:26:32.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:26:32.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:27:02.460 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:27:02.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:27:33.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:27:33.909 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:27:39.759 INFO:teuthology.orchestra.run.smithi172.stdout:generic/650 4242s 2023-03-27T19:27:39.800 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/650 2023-03-27T19:27:39.800 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:27:39.808 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:40.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:27:40.103 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-03-27T19:27:41.821 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:27:41.863 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:27:41.865 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:27:41.872 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:27:41.873 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:44.296 INFO:teuthology.orchestra.run.smithi172.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:27:44.340 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/651 2023-03-27T19:27:44.340 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/651 2023-03-27T19:27:44.341 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:27:44.372 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:44.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:27:44.566 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-03-27T19:27:45.933 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:27:45.983 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:27:45.988 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:27:45.995 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:27:45.996 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:48.339 INFO:teuthology.orchestra.run.smithi172.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:27:48.387 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/652 2023-03-27T19:27:48.387 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/652 2023-03-27T19:27:48.392 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:27:48.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:48.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:27:48.648 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-03-27T19:27:50.164 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:27:50.207 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:27:50.213 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:27:50.224 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:27:50.224 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:52.822 INFO:teuthology.orchestra.run.smithi172.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:27:52.860 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/653 2023-03-27T19:27:52.861 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/653 2023-03-27T19:27:52.861 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:27:52.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:53.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:27:53.260 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-03-27T19:27:54.739 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:27:54.787 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:27:54.792 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:27:54.799 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:27:54.800 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:57.096 INFO:teuthology.orchestra.run.smithi172.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:27:57.136 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/654 2023-03-27T19:27:57.137 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/654 2023-03-27T19:27:57.138 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:27:57.170 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:27:57.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:27:57.588 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-03-27T19:27:59.010 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:27:59.042 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:27:59.044 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:27:59.050 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:27:59.050 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:01.248 INFO:teuthology.orchestra.run.smithi172.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:01.284 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/655 2023-03-27T19:28:01.285 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/655 2023-03-27T19:28:01.286 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:01.319 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:01.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:01.689 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-03-27T19:28:03.221 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:03.264 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:03.265 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:03.275 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:04.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:28:04.235 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:28:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:generic/656 [not run] vfstest not support by ceph 2023-03-27T19:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/656 2023-03-27T19:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/656 2023-03-27T19:28:04.763 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:04.785 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:04.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:04.916 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-03-27T19:28:06.258 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:06.296 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:06.299 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:06.305 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:06.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:08.386 INFO:teuthology.orchestra.run.smithi172.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:08.419 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/657 2023-03-27T19:28:08.419 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/657 2023-03-27T19:28:08.421 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:08.452 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:08.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:08.880 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-03-27T19:28:10.329 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:10.370 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:10.373 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:10.381 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:10.382 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:12.501 INFO:teuthology.orchestra.run.smithi172.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:12.542 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/658 2023-03-27T19:28:12.543 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/658 2023-03-27T19:28:12.544 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:12.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:12.762 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-03-27T19:28:14.130 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:14.171 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:14.174 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:14.184 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:14.184 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:16.390 INFO:teuthology.orchestra.run.smithi172.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:16.436 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/659 2023-03-27T19:28:16.437 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/659 2023-03-27T19:28:16.437 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:16.475 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:16.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:16.673 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-03-27T19:28:18.000 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:18.030 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:18.034 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:18.045 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:18.045 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:20.414 INFO:teuthology.orchestra.run.smithi172.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:20.461 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/660 2023-03-27T19:28:20.462 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/660 2023-03-27T19:28:20.463 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:20.493 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:20.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:20.776 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-03-27T19:28:22.086 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:22.127 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:22.132 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:22.140 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:22.140 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:24.562 INFO:teuthology.orchestra.run.smithi172.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:24.608 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/661 2023-03-27T19:28:24.609 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/661 2023-03-27T19:28:24.609 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:24.646 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:24.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:24.789 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-03-27T19:28:26.276 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:26.317 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:26.320 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:26.326 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:26.326 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:28.663 INFO:teuthology.orchestra.run.smithi172.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:28.713 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/662 2023-03-27T19:28:28.713 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/662 2023-03-27T19:28:28.713 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:28.745 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:28.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:28.980 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-03-27T19:28:30.282 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:30.333 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:30.334 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:30.341 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:30.341 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:32.643 INFO:teuthology.orchestra.run.smithi172.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:32.679 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/663 2023-03-27T19:28:32.680 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/663 2023-03-27T19:28:32.680 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:32.713 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:33.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:33.044 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-03-27T19:28:34.450 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:34.465 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:28:34.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:28:34.486 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:34.488 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:34.496 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:34.496 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:36.752 INFO:teuthology.orchestra.run.smithi172.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:36.798 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/664 2023-03-27T19:28:36.799 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/664 2023-03-27T19:28:36.799 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:36.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:37.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:37.217 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-03-27T19:28:38.633 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:38.660 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:38.663 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:38.670 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:38.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:40.988 INFO:teuthology.orchestra.run.smithi172.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:41.040 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/665 2023-03-27T19:28:41.041 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/665 2023-03-27T19:28:41.041 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:41.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:41.384 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-03-27T19:28:42.982 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:43.030 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:43.034 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:43.041 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:43.041 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:45.006 INFO:teuthology.orchestra.run.smithi172.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:45.032 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/666 2023-03-27T19:28:45.033 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/666 2023-03-27T19:28:45.033 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:45.062 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:45.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:45.477 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-03-27T19:28:46.979 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:47.020 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:47.024 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:47.030 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:47.030 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:49.150 INFO:teuthology.orchestra.run.smithi172.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:49.201 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/667 2023-03-27T19:28:49.201 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/667 2023-03-27T19:28:49.201 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:49.227 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:49.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:49.657 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-03-27T19:28:51.092 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:51.134 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:51.137 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:51.141 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:51.142 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:53.342 INFO:teuthology.orchestra.run.smithi172.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:53.377 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/668 2023-03-27T19:28:53.378 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/668 2023-03-27T19:28:53.379 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:53.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:53.618 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-03-27T19:28:55.284 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:55.313 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:55.318 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:55.327 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:55.327 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:57.632 INFO:teuthology.orchestra.run.smithi172.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:28:57.672 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/669 2023-03-27T19:28:57.672 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/669 2023-03-27T19:28:57.672 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:28:57.707 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:28:57.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:28:57.835 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-03-27T19:28:59.271 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:28:59.302 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:28:59.303 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:28:59.307 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:28:59.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:01.750 INFO:teuthology.orchestra.run.smithi172.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:29:01.792 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/670 2023-03-27T19:29:01.793 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/670 2023-03-27T19:29:01.794 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:29:01.827 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:02.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:29:02.092 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-03-27T19:29:03.351 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:29:03.407 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:29:03.413 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:29:03.423 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:29:03.424 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:04.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:29:04.809 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:29:05.826 INFO:teuthology.orchestra.run.smithi172.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:29:05.867 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/671 2023-03-27T19:29:05.867 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/671 2023-03-27T19:29:05.868 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:29:05.905 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:06.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:29:06.061 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-03-27T19:29:07.471 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:29:07.513 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:29:07.517 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:29:07.525 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:29:07.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:09.766 INFO:teuthology.orchestra.run.smithi172.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:29:09.807 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/672 2023-03-27T19:29:09.807 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/672 2023-03-27T19:29:09.807 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:29:09.833 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:09.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:29:09.962 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-03-27T19:29:11.443 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:29:11.475 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:29:11.480 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:29:11.486 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:29:11.486 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:14.375 INFO:teuthology.orchestra.run.smithi172.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:29:14.426 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/673 2023-03-27T19:29:14.427 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/673 2023-03-27T19:29:14.428 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:29:14.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:14.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:29:14.705 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-03-27T19:29:16.220 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:29:16.257 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:29:16.259 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:29:16.261 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:29:16.262 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:18.526 INFO:teuthology.orchestra.run.smithi172.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-03-27T19:29:18.867 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/674 2023-03-27T19:29:18.868 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/674 2023-03-27T19:29:18.868 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:29:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:19.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:29:19.070 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-03-27T19:29:20.500 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:29:20.545 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:29:20.548 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:29:20.556 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:29:20.556 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:23.125 INFO:teuthology.orchestra.run.smithi172.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T19:29:23.168 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/675 2023-03-27T19:29:23.169 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/675 2023-03-27T19:29:23.169 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T19:29:23.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:23.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T19:29:23.511 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-03-27T19:29:24.915 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T19:29:24.955 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T19:29:24.959 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T19:29:24.964 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T19:29:24.965 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T19:29:35.133 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:29:35.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:30:05.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:30:05.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:30:35.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:30:35.711 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:31:06.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:31:06.950 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:31:37.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:31:37.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:32:07.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:32:07.560 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:32:07.888 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T19:32:07.888+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 735335) UID: 0 2023-03-27T19:32:07.899 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T19:32:07.888+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 735335) UID: 0 2023-03-27T19:37:41.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:37:41.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:37:41.597 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T19:37:41.597+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139545) UID: 0 2023-03-27T19:37:41.598 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T19:37:41.598+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139545) UID: 0 2023-03-27T19:37:41.598 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T19:37:41.598+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139545) UID: 0 2023-03-27T19:37:41.599 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T19:37:41.598+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139545) UID: 0 2023-03-27T19:40:38.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:40:38.664 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:41:09.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:41:09.159 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:41:09.497 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T19:41:09.499+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 735487) UID: 0 2023-03-27T19:41:09.498 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T19:41:09.499+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 735487) UID: 0 2023-03-27T19:46:38.184 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:46:38.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:46:38.279 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T19:46:38.280+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139700) UID: 0 2023-03-27T19:46:38.279 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T19:46:38.280+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139700) UID: 0 2023-03-27T19:46:38.280 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T19:46:38.280+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139700) UID: 0 2023-03-27T19:46:38.280 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T19:46:38.280+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139700) UID: 0 2023-03-27T19:52:10.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:52:10.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T19:52:11.171 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T19:52:11.172+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 735631) UID: 0 2023-03-27T19:52:11.171 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T19:52:11.173+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 735631) UID: 0 2023-03-27T19:59:28.649 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T19:59:28.649+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 735696) UID: 0 2023-03-27T19:59:28.650 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T19:59:28.649+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 735696) UID: 0 2023-03-27T19:59:28.650 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T19:59:28.649+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 735696) UID: 0 2023-03-27T19:59:28.650 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T19:59:28.649+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 735696) UID: 0 2023-03-27T20:03:54.069 INFO:teuthology.orchestra.run.smithi172.stdout:generic/676 2068s 2023-03-27T20:03:54.177 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/676 2023-03-27T20:03:54.178 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:03:54.205 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:03:54.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:03:54.775 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-03-27T20:03:56.508 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:03:56.562 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:03:56.568 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:03:56.579 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:03:56.579 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:03:58.468 INFO:teuthology.orchestra.run.smithi172.stdout:generic/677 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T20:03:58.510 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/677 2023-03-27T20:03:58.511 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/677 2023-03-27T20:03:58.512 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:03:58.538 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:03:58.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:03:58.654 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-03-27T20:04:00.157 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:00.212 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:00.214 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:00.221 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:00.221 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:02.309 INFO:teuthology.orchestra.run.smithi172.stdout:generic/678 [not run] kernel does not support IO_URING 2023-03-27T20:04:02.350 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/678 2023-03-27T20:04:02.351 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/678 2023-03-27T20:04:02.351 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:02.725 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:02.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:02.854 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-03-27T20:04:04.513 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:04.564 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:04.570 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:04.579 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:04.579 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:06.234 INFO:teuthology.orchestra.run.smithi172.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T20:04:06.264 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/679 2023-03-27T20:04:06.264 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/679 2023-03-27T20:04:06.264 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:06.286 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:06.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:06.455 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-03-27T20:04:07.988 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:08.022 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:08.031 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:08.041 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:08.042 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:11.202 INFO:teuthology.orchestra.run.smithi172.stdout:generic/680 3s 2023-03-27T20:04:11.240 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/680 2023-03-27T20:04:11.241 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:11.268 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:11.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:11.444 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-03-27T20:04:13.160 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:13.203 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:13.209 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:13.215 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:13.216 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:15.079 INFO:teuthology.orchestra.run.smithi172.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T20:04:15.122 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/681 2023-03-27T20:04:15.122 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/681 2023-03-27T20:04:15.123 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:15.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:15.290 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-03-27T20:04:17.080 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:17.135 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:17.141 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:17.151 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:17.152 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:19.093 INFO:teuthology.orchestra.run.smithi172.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T20:04:19.125 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/682 2023-03-27T20:04:19.125 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/682 2023-03-27T20:04:19.126 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:19.140 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:19.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:19.251 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-03-27T20:04:20.884 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:20.930 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:20.935 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:20.947 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:20.947 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:23.440 INFO:teuthology.orchestra.run.smithi172.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T20:04:23.479 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/683 2023-03-27T20:04:23.480 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/683 2023-03-27T20:04:23.480 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:23.508 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:23.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:23.645 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-03-27T20:04:25.235 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:25.289 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:25.292 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:25.302 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:25.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:34.065 INFO:teuthology.orchestra.run.smithi172.stdout:generic/684 8s 2023-03-27T20:04:34.121 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/684 2023-03-27T20:04:34.121 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:34.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:34.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:34.318 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-03-27T20:04:36.185 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:36.240 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:36.245 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:36.254 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:36.255 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:38.872 INFO:teuthology.orchestra.run.smithi172.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-03-27T20:04:38.915 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/685 2023-03-27T20:04:38.916 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/685 2023-03-27T20:04:38.917 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:38.940 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:39.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:39.106 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-03-27T20:04:40.917 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:40.965 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:40.969 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:40.973 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:40.974 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:43.430 INFO:teuthology.orchestra.run.smithi172.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-03-27T20:04:43.462 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/686 2023-03-27T20:04:43.463 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/686 2023-03-27T20:04:43.463 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:43.486 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:43.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:43.634 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-03-27T20:04:45.206 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:45.248 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:45.254 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:45.264 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:45.265 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:47.695 INFO:teuthology.orchestra.run.smithi172.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-03-27T20:04:47.718 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/687 2023-03-27T20:04:47.720 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/687 2023-03-27T20:04:47.720 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:47.756 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:47.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:47.903 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-03-27T20:04:49.497 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:49.551 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:49.557 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:49.569 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:49.570 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:51.625 INFO:teuthology.orchestra.run.smithi172.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-03-27T20:04:51.666 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/688 2023-03-27T20:04:51.666 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/688 2023-03-27T20:04:51.667 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:51.695 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:51.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:51.816 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-03-27T20:04:53.456 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:53.510 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:53.516 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:53.520 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:53.520 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:55.256 INFO:teuthology.orchestra.run.smithi172.stdout:generic/689 [not run] vfstest not support by ceph 2023-03-27T20:04:55.296 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/689 2023-03-27T20:04:55.297 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/689 2023-03-27T20:04:55.297 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:55.325 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:55.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:55.415 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-03-27T20:04:56.929 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:04:56.980 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:04:56.984 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:04:56.991 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:04:56.991 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:59.159 INFO:teuthology.orchestra.run.smithi172.stdout:generic/690 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T20:04:59.173 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/690 2023-03-27T20:04:59.173 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/690 2023-03-27T20:04:59.173 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:04:59.187 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:04:59.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:04:59.327 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-03-27T20:05:00.927 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:05:00.979 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:05:00.985 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:05:00.999 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:05:00.999 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:02.699 INFO:teuthology.orchestra.run.smithi172.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-03-27T20:05:02.724 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/691 2023-03-27T20:05:02.725 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/691 2023-03-27T20:05:02.725 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:05:02.750 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:02.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:05:02.874 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-03-27T20:05:04.464 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:05:04.504 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:05:04.509 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:05:04.519 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:05:04.520 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:06.301 INFO:teuthology.orchestra.run.smithi172.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-03-27T20:05:06.337 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/692 2023-03-27T20:05:06.338 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/692 2023-03-27T20:05:06.339 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:05:06.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:06.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:05:06.483 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-03-27T20:05:07.990 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:05:08.033 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:05:08.034 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:05:08.037 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:05:08.038 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:10.821 INFO:teuthology.orchestra.run.smithi172.stdout:generic/693 [not run] xfs_io get_encpolicy doesn't support -t 2023-03-27T20:05:10.919 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/693 2023-03-27T20:05:10.920 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/693 2023-03-27T20:05:10.921 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:05:10.947 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:11.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:05:11.057 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-03-27T20:05:12.710 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:05:12.770 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:05:12.774 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:05:12.779 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:05:12.780 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:54.955 INFO:teuthology.orchestra.run.smithi172.stdout:generic/694 41s 2023-03-27T20:05:55.031 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/694 2023-03-27T20:05:55.031 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:05:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:55.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:05:55.224 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-03-27T20:05:56.986 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:05:57.030 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:05:57.035 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:05:57.043 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:05:57.043 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:58.777 INFO:teuthology.orchestra.run.smithi172.stdout:generic/695 [not run] require 172.21.15.172:6789:/scratch to be valid block disk 2023-03-27T20:05:58.804 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/695 2023-03-27T20:05:58.805 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/695 2023-03-27T20:05:58.807 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:05:58.832 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:05:58.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:05:58.954 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-03-27T20:06:00.342 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:00.381 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:00.384 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:00.394 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:00.394 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:03.137 INFO:teuthology.orchestra.run.smithi172.stdout:generic/696 3s 2023-03-27T20:06:03.186 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/696 2023-03-27T20:06:03.186 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:06:03.206 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:03.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:06:03.280 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-03-27T20:06:04.717 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:04.761 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:04.765 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:04.770 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:04.770 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:06.760 INFO:teuthology.orchestra.run.smithi172.stdout:generic/697 1s 2023-03-27T20:06:06.820 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/697 2023-03-27T20:06:06.820 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:06:06.839 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:06.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:06:06.963 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-03-27T20:06:08.420 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:08.454 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:08.460 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:08.467 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:08.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:10.185 INFO:teuthology.orchestra.run.smithi172.stdout:generic/698 [not run] vfstest not support by ceph 2023-03-27T20:06:10.209 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/698 2023-03-27T20:06:10.210 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/698 2023-03-27T20:06:10.210 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:06:10.221 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:10.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:06:10.368 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-03-27T20:06:11.763 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:11.795 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:11.797 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:11.805 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:11.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:13.270 INFO:teuthology.orchestra.run.smithi172.stdout:generic/699 [not run] vfstest not support by ceph 2023-03-27T20:06:13.307 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/699 2023-03-27T20:06:13.307 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/699 2023-03-27T20:06:13.307 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:06:13.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:13.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:06:13.470 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-03-27T20:06:14.803 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:14.849 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:14.852 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:14.859 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:14.859 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:16.327 INFO:teuthology.orchestra.run.smithi172.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-03-27T20:06:16.349 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/700 2023-03-27T20:06:16.350 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/700 2023-03-27T20:06:16.350 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:06:16.361 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:16.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:06:16.713 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-03-27T20:06:18.260 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:18.289 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:18.293 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:18.299 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:18.299 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:38.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:06:38.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:06:38.650 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T20:06:38.652+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139947) UID: 0 2023-03-27T20:06:38.651 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T20:06:38.652+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139947) UID: 0 2023-03-27T20:06:38.651 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T20:06:38.652+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139947) UID: 0 2023-03-27T20:06:38.651 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T20:06:38.652+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 139947) UID: 0 2023-03-27T20:06:38.853 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T20:06:38.854+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 748493) UID: 0 2023-03-27T20:06:38.854 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T20:06:38.855+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 748493) UID: 0 2023-03-27T20:06:52.028 INFO:teuthology.orchestra.run.smithi172.stdout:generic/701 33s 2023-03-27T20:06:52.065 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/701 2023-03-27T20:06:52.066 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:06:52.077 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:06:56.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:06:56.455 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-03-27T20:06:58.314 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:06:58.376 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:06:58.379 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:06:58.389 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:06:58.389 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:01.043 INFO:teuthology.orchestra.run.smithi172.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-03-27T20:07:01.086 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/702 2023-03-27T20:07:01.086 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/702 2023-03-27T20:07:01.086 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:07:01.108 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:01.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:07:01.401 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-03-27T20:07:03.049 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:07:03.104 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:07:03.113 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:07:03.120 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:07:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:04.786 INFO:teuthology.orchestra.run.smithi172.stdout:generic/703 [not run] kernel does not support IO_URING 2023-03-27T20:07:04.804 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/703 2023-03-27T20:07:04.804 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/703 2023-03-27T20:07:04.804 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:07:04.814 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:04.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:07:04.929 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-03-27T20:07:06.569 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:07:06.618 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:07:06.621 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:07:06.630 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:07:06.630 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:08.461 INFO:teuthology.orchestra.run.smithi172.stdout:generic/704 [not run] require 172.21.15.172:6789:/test to be valid block disk 2023-03-27T20:07:08.501 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/704 2023-03-27T20:07:08.501 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/704 2023-03-27T20:07:08.502 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:07:08.527 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:08.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:07:08.644 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-03-27T20:07:10.173 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:07:10.214 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:07:10.219 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:07:10.230 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:07:10.230 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:12.597 INFO:teuthology.orchestra.run.smithi172.stdout:generic/705 [not run] ceph does not support shutdown 2023-03-27T20:07:12.696 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/705 2023-03-27T20:07:12.697 INFO:teuthology.orchestra.run.smithi172.stdout:Not run: generic/705 2023-03-27T20:07:12.698 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:07:12.727 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:12.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:07:12.863 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-03-27T20:07:14.536 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:07:14.589 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:07:14.593 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:07:14.606 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:07:14.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:19.871 INFO:teuthology.orchestra.run.smithi172.stdout:generic/706 4s 2023-03-27T20:07:19.936 INFO:teuthology.orchestra.run.smithi172.stdout:Ran: generic/706 2023-03-27T20:07:19.936 INFO:teuthology.orchestra.run.smithi172.stdout:Passed all 1 tests 2023-03-27T20:07:19.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:07:20.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-03-27T20:07:20.122 DEBUG:teuthology.orchestra.run.smithi172:> (cd /tmp/tmp.Bd5h2Tmv1Lxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-03-27T20:07:22.019 INFO:teuthology.orchestra.run.smithi172.stdout:FSTYP -- ceph 2023-03-27T20:07:22.065 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM -- Linux/x86_64 smithi172 6.3.0-rc3-g1776e8f494e9 #1 SMP PREEMPT_DYNAMIC Mon Mar 27 03:45:47 UTC 2023 2023-03-27T20:07:22.073 INFO:teuthology.orchestra.run.smithi172.stdout:MKFS_OPTIONS -- 172.21.15.172:6789:/scratch 2023-03-27T20:07:22.082 INFO:teuthology.orchestra.run.smithi172.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAvayFk0r/bEBAAgoVLuFvmXpptnYeislUINA== -o context=system_u:object_r:root_t:s0 172.21.15.172:6789:/scratch /tmp/tmp.4XPvpb2vjxscratch 2023-03-27T20:07:22.082 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-03-27T20:14:09.830 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T20:14:09.829+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 753625) UID: 0 2023-03-27T20:14:09.831 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T20:14:09.829+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 753625) UID: 0 2023-03-27T20:14:09.831 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T20:14:09.829+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 753625) UID: 0 2023-03-27T20:14:09.832 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T20:14:09.829+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 753625) UID: 0 2023-03-27T20:20:29.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:20:29.712 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:21:00.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:21:00.019 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:21:30.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:21:30.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:22:00.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:22:00.653 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:22:30.879 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:22:30.891 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:23:01.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:23:01.204 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:23:31.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:23:31.497 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:24:01.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:24:01.750 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:24:32.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:24:32.033 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:25:03.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:25:03.069 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:25:33.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:25:33.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:26:03.675 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:26:03.680 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:26:34.033 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:26:34.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:27:04.381 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:27:04.394 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:27:04.685 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T20:27:04.687+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757694) UID: 0 2023-03-27T20:27:04.685 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T20:27:04.687+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757694) UID: 0 2023-03-27T20:27:04.686 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T20:27:04.687+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757694) UID: 0 2023-03-27T20:27:04.686 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T20:27:04.687+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757694) UID: 0 2023-03-27T20:32:42.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:32:42.499 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:32:42.880 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T20:32:42.882+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 759039) UID: 0 2023-03-27T20:32:42.881 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T20:32:42.882+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 759039) UID: 0 2023-03-27T20:32:42.881 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T20:32:42.882+0000 7f539d1f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 759039) UID: 0 2023-03-27T20:32:42.881 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T20:32:42.882+0000 7fe3c07f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 759039) UID: 0 2023-03-27T20:38:07.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:38:07.256 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:38:37.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:38:37.569 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:39:07.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:39:07.855 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:39:38.271 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:39:38.282 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:40:08.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:40:08.528 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:40:38.805 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:40:38.810 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:41:09.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:41:09.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:41:39.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:41:39.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:42:09.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:42:09.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:42:39.871 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:42:39.885 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:43:10.160 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:43:10.177 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:43:40.484 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:43:40.497 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:44:10.771 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:44:10.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:44:41.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:44:41.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:45:11.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:45:11.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:45:41.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:45:41.725 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:46:11.983 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:46:12.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:46:42.280 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:46:42.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:47:12.553 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:47:12.560 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:47:42.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:47:42.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:48:13.172 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:48:13.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:48:43.429 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:48:43.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:49:13.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:49:13.722 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:49:44.029 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:49:44.035 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:50:14.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:50:14.305 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:50:44.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:50:44.579 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:51:14.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:51:14.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:51:45.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:51:45.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:52:15.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:52:15.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:52:45.792 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:52:45.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:53:16.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:53:16.080 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:53:47.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:53:47.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:54:17.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:54:17.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:54:48.006 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:54:48.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:55:18.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:55:18.256 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:55:48.527 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:55:48.539 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:55:48.635 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T20:55:48.636+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141606) UID: 0 2023-03-27T20:55:48.635 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T20:55:48.636+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141606) UID: 0 2023-03-27T20:55:48.636 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T20:55:48.636+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141606) UID: 0 2023-03-27T20:55:48.636 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T20:55:48.636+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 141606) UID: 0 2023-03-27T20:58:45.075 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:58:45.087 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:59:15.366 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:59:15.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:59:45.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T20:59:45.673 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:00:16.015 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:00:16.026 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:00:47.070 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:00:47.078 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:01:17.315 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:01:17.326 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:01:47.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:01:47.668 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:02:17.932 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:02:17.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:02:48.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:02:48.232 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:03:18.489 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:03:18.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:03:48.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:03:48.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:04:19.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:04:19.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:04:49.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:04:49.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:05:19.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:05:19.654 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:05:49.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:05:49.943 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:06:20.221 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:06:20.232 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:06:50.552 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:06:50.567 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:07:20.867 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:07:20.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:07:51.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:07:51.168 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:08:21.465 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:08:21.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:08:51.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:08:51.761 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:09:21.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:09:22.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:09:22.102 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T21:09:22.103+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142270) UID: 0 2023-03-27T21:09:22.102 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T21:09:22.103+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142270) UID: 0 2023-03-27T21:09:22.103 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T21:09:22.104+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142270) UID: 0 2023-03-27T21:09:22.103 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T21:09:22.104+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142270) UID: 0 2023-03-27T21:12:13.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:12:13.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:12:13.968 INFO:tasks.ceph.osd.3.smithi172.stderr:2023-03-27T21:12:13.969+0000 7f12a6bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 772247) UID: 0 2023-03-27T21:12:13.969 INFO:tasks.ceph.osd.1.smithi172.stderr:2023-03-27T21:12:13.971+0000 7f50ae7f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 772247) UID: 0 2023-03-27T21:12:13.970 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T21:12:13.972+0000 7fe3c07f8700 -1 Fail to open '/proc/772247/cmdline' error = (2) No such file or directory 2023-03-27T21:12:13.970 INFO:tasks.ceph.osd.0.smithi172.stderr:2023-03-27T21:12:13.972+0000 7fe3c07f8700 -1 received signal: Hangup from (PID: 772247) UID: 0 2023-03-27T21:12:13.971 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T21:12:13.972+0000 7f539d1f8700 -1 Fail to open '/proc/772247/cmdline' error = (2) No such file or directory 2023-03-27T21:12:13.971 INFO:tasks.ceph.osd.2.smithi172.stderr:2023-03-27T21:12:13.972+0000 7f539d1f8700 -1 received signal: Hangup from (PID: 772247) UID: 0 2023-03-27T21:18:40.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:18:40.673 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:19:10.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:19:10.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:19:41.196 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:19:41.210 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:20:11.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:20:11.562 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:20:41.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:20:41.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:21:12.111 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:21:12.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:21:42.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:21:42.341 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:22:12.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:22:12.615 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:22:42.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:22:42.849 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:23:13.129 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:23:13.142 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:23:43.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:23:43.430 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:23:43.534 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T21:23:43.536+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142690) UID: 0 2023-03-27T21:23:43.535 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T21:23:43.536+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142690) UID: 0 2023-03-27T21:23:43.535 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T21:23:43.536+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142690) UID: 0 2023-03-27T21:23:43.536 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T21:23:43.536+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 142690) UID: 0 2023-03-27T21:26:35.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:26:35.819 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:27:06.107 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:27:06.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:27:36.274 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:27:36.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:28:06.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:28:06.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:28:36.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:28:36.702 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:29:06.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:29:06.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:29:37.138 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:29:37.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:30:07.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:30:07.353 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:30:37.533 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:30:37.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:31:08.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:31:08.489 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:31:38.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:31:38.744 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:32:09.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:32:09.033 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:32:39.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:32:39.231 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:33:09.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:33:09.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:33:39.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:33:39.727 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:34:09.924 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:34:09.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:34:40.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:34:40.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:35:10.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:35:10.349 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:35:40.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:35:40.547 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:35:40.741 INFO:tasks.ceph.mds.c.smithi172.stderr:2023-03-27T21:35:40.743+0000 7f3f82bf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 795697) UID: 0 2023-03-27T21:35:40.742 INFO:tasks.ceph.mds.a.smithi172.stderr:2023-03-27T21:35:40.743+0000 7f61acdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 795697) UID: 0 2023-03-27T21:39:18.972 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:39:18.981 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:39:49.203 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:39:49.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:40:19.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:40:19.420 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:40:49.617 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:40:49.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:41:19.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:41:19.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:41:50.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:41:50.047 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:41:50.132 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-27T21:41:50.135+0000 7feee0bf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143455) UID: 0 2023-03-27T21:41:50.133 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-27T21:41:50.135+0000 7f345fdf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143455) UID: 0 2023-03-27T21:41:50.133 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-27T21:41:50.135+0000 7f0dc85f8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143455) UID: 0 2023-03-27T21:41:50.134 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-27T21:41:50.135+0000 7f7d32ff8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 143455) UID: 0 2023-03-27T21:44:16.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:44:16.644 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:44:47.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:44:47.090 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:45:17.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:45:17.554 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:45:47.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:45:47.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:46:17.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:46:17.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:46:48.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:46:48.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:47:18.571 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:47:18.580 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:47:48.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:47:48.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:48:18.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:48:18.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:48:49.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:48:49.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:49:19.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:49:19.447 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:49:49.632 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:49:49.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:50:19.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:50:19.847 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:50:50.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:50:50.044 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:51:20.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:51:20.306 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:51:50.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:51:50.513 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:52:20.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:52:20.711 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-27T21:52:47.818 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-27T21:52:47.819 DEBUG:teuthology.task.console_log:Killing console logger for smithi172 2023-03-27T21:52:47.820 DEBUG:teuthology.task.console_log:Killing console logger for smithi191 2023-03-27T21:52:47.820 DEBUG:teuthology.exit:Finished running handlers